Adaptive Input Representations
Adaptive Input Representations
**Adaptive Input Embeddings** extend the [adaptive softmax](https://paperswithcode.com/method/adaptive-softmax) to input word representations. The factorization assigns more capacity to frequent words and reduces the capacity for less frequent words with the benefit of reducing overfitting to rare words.
Adaptive Input Representations for Neural Language Modeling
https://paperswithcode.com/paper/adaptive-input-representations-for-neural
Adaptive Input Representations for Neural Language Modeling