Charformer
Charformer
**Charformer** is a type of [Transformer](https://paperswithcode.com/methods/category/transformers) model that learns a subword tokenization end-to-end as part of the model. Specifically it uses [GBST](https://paperswithcode.com/method/gradient-based-subword-tokenization) that automatically learns latent subword representations from characters in a data-driven fashion. Following GBST, the soft subword sequence is passed through [Transformer](https://paperswithcode.com/method/transformer) layers.
Charformer: Fast Character Transformers via Gradient-based Subword Tokenization
https://paperswithcode.com/paper/charformer-fast-character-transformers-via
Charformer: Fast Character Transformers via Gradient-based Subword Tokenization