Sharpness-Aware Minimization
Sharpness-Aware Minimization
**Sharpness-Aware Minimization**, or **SAM**, is a procedure that improves model generalization by simultaneously minimizing loss value and loss sharpness. SAM functions by seeking parameters that lie in neighborhoods having uniformly low loss value (rather than parameters that only themselves have low loss value).
Sharpness-Aware Minimization for Efficiently Improving Generalization
https://paperswithcode.com/paper/sharpness-aware-minimization-for-efficiently-1
Sharpness-Aware Minimization for Efficiently Improving Generalization