Progressive Rain Removal Based on the Combination Network of CNN and Transformer

Figure 5

The architecture of self-attention module and cross-attention module. R means reshape operation; S means softmax operation; × means matrix multiplication. “Left” means to the left of the operator, while “right” means to the right of the operator. (a) The architecture of self-attention module and (b) the architecture of cross-attention module.

(a)

(b)