ADOPT
ADaptive gradient method with the OPTimal convergence rate
Please enter a description about the method here
ADOPT: Modified Adam Can Converge with Any $β_2$ with the Optimal Rate
https://paperswithcode.com/paper/adopt-modified-adam-can-converge-with-any-b-2
ADOPT: Modified Adam Can Converge with Any $β_2$ with the Optimal Rate