ATMO
AdapTive Meta Optimizer
This method combines multiple optimization techniques like [ADAM](https://paperswithcode.com/method/adam) and [SGD](https://paperswithcode.com/method/sgd) or PADAM. This method can be applied to any couple of optimizers.

Image credit: [Combining Optimization Methods Using an Adaptive Meta Optimizer](https://www.mdpi.com/1999-4893/14/6/186)
Combining Optimization Methods Using an Adaptive Meta Optimizer
https://paperswithcode.com/paper/combining-optimization-methods-using-an
Combining Optimization Methods Using an Adaptive Meta Optimizer