Vision Transformer
Vision Transformer
The **Vision Transformer**, or **ViT**, is a model for image classification that employs a [Transformer](https://paperswithcode.com/method/transformer)-like architecture over patches of the image.  An image is split into fixed-size patches, each of them are then linearly embedded, position embeddings are added, and the resulting sequence of vectors is fed to a standard [Transformer](https://paperswithcode.com/method/transformer) encoder. In order to perform classification, the standard approach of adding an extra learnable “classification token” to the sequence is used.
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
https://paperswithcode.com/paper/an-image-is-worth-16x16-words-transformers-1
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale