DeepViT
DeepViT
**DeepViT** is a type of [vision transformer](https://paperswithcode.com/method/vision-transformer) that replaces the self-attention layer within the [transformer](https://paperswithcode.com/method/transformer) block with a [Re-attention module](https://paperswithcode.com/method/re-attention-module) to address the issue of attention collapse and enables training deeper ViTs.
DeepViT: Towards Deeper Vision Transformer
https://paperswithcode.com/paper/deepvit-towards-deeper-vision-transformer
DeepViT: Towards Deeper Vision Transformer