1cycle
1cycle learning rate scheduling policy
A disciplined approach to neural network hyper-parameters: Part 1 -- learning rate, batch size, momentum, and weight decay
https://paperswithcode.com/paper/a-disciplined-approach-to-neural-network
A disciplined approach to neural network hyper-parameters: Part 1 -- learning rate, batch size, momentum, and weight decay