Sinkhorn Transformer
Sinkhorn Transformer
The **Sinkhorn Transformer** is a type of [transformer](https://paperswithcode.com/method/transformer) that uses [Sparse Sinkhorn Attention](https://paperswithcode.com/method/sparse-sinkhorn-attention) as a building block. This component is a plug-in replacement for dense fully-connected attention (as well as local attention, and sparse attention alternatives), and allows for reduced memory complexity as well as sparse attention.
Sparse Sinkhorn Attention
https://paperswithcode.com/paper/sparse-sinkhorn-attention
Sparse Sinkhorn Attention