SANet
Self-Attention Network
**Self-Attention Network** (**SANet**) proposes two variations of self-attention used for image recognition: 1) pairwise self-attention which generalizes standard [dot-product attention](https://paperswithcode.com/method/dot-product-attention) and is fundamentally a set operator, and 2) patchwise self-attention which is strictly more powerful than [convolution](https://paperswithcode.com/method/convolution).
Exploring Self-attention for Image Recognition
https://paperswithcode.com/paper/exploring-self-attention-for-image
Exploring Self-attention for Image Recognition