SqueezeBERT
SqueezeBERT
**SqueezeBERT** is an efficient architectural variant of [BERT](https://paperswithcode.com/method/bert) for natural language processing that uses [grouped convolutions](https://paperswithcode.com/method/grouped-convolution). It is much like BERT-base, but with positional feedforward connection layers implemented as convolutions, and grouped [convolution](https://paperswithcode.com/method/convolution) for many of the layers.
SqueezeBERT: What can computer vision teach NLP about efficient neural networks?
https://paperswithcode.com/paper/squeezebert-what-can-computer-vision-teach
SqueezeBERT: What can computer vision teach NLP about efficient neural networks?