PoolFormer
PoolFormer
PoolFormer is instantiated from MetaFormer by specifying the token mixer as extremely simple operator, pooling. PoolFormer is utilized as a tool to verify MetaFormer hypothesis "MetaFormer is actually what you need" (vs "Attention is all you need").
MetaFormer Is Actually What You Need for Vision
https://paperswithcode.com/paper/metaformer-is-actually-what-you-need-for
MetaFormer Is Actually What You Need for Vision