Sophia
Second-order Clipped Stochastic Optimization
Please enter a description about the method here
Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training
https://paperswithcode.com/paper/sophia-a-scalable-stochastic-second-order
Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training