FFF
Fast Feedforward Networks
A log-time alternative to feedforward layers outperforming both the vanilla feedforward and mixture-of-experts approaches.
Fast Feedforward Networks
https://paperswithcode.com/paper/fast-feedforward-networks
Fast Feedforward Networks