Slanted Triangular Learning Rates
Slanted Triangular Learning Rates
**Slanted Triangular Learning Rates (STLR)** is a learning rate schedule which first linearly increases the learning rate and then linearly decays it, which can be seen in Figure to the right. It is a modification of Triangular Learning Rates, with a short increase and a long decay period.
Universal Language Model Fine-tuning for Text Classification
https://paperswithcode.com/paper/universal-language-model-fine-tuning-for-text
Universal Language Model Fine-tuning for Text Classification