Cyclical Learning Rate Policy
Cyclical Learning Rate Policy
A **Cyclical Learning Rate Policy** combines a linear learning rate decay with warm restarts.

Image: [ESPNetv2](https://paperswithcode.com/method/espnetv2)