AdEMAMix
Adaptive EMA Mixture
Please enter a description about the method here
The AdEMAMix Optimizer: Better, Faster, Older
https://paperswithcode.com/paper/the-ademamix-optimizer-better-faster-older
The AdEMAMix Optimizer: Better, Faster, Older