LeViT Attention Block
LeViT Attention Block
**LeViT Attention Block** is a module used for [attention](https://paperswithcode.com/methods/category/attention-mechanisms) in the [LeViT](https://paperswithcode.com/method/levit) architecture. Its main feature is providing positional information within each attention block, i.e. where we explicitly inject relative position information in the attention mechanism. This is achieved by adding an attention bias to the attention maps.
LeViT: a Vision Transformer in ConvNet's Clothing for Faster Inference
https://paperswithcode.com/paper/levit-a-vision-transformer-in-convnet-s
LeViT: a Vision Transformer in ConvNet's Clothing for Faster Inference