A Model for Surface Defect Detection of Industrial Products Based on Attention Augmentation

Figure 5

Attention block, where q, k, v and r refer to query, key, value, and position encoding, and Rh and Rw refer to height and height relative position encoding width.