FoPE
Fourier Position Embedding
Fourier Position Embedding: Enhancing Attention's Periodic Extension for Length Generalization
https://paperswithcode.com/paper/fourier-position-embedding-enhancing
Fourier Position Embedding: Enhancing Attention's Periodic Extension for Length Generalization