Model Generalization: A Sharpness Aware Optimization Perspective. (arXiv:2208.06915v1 [cs.LG])

Sharpness-Aware Minimization (SAM) and adaptive sharpness-aware minimization
(ASAM) aim to improve the model generalization. And in this project, we
proposed three experiments to valid their generalization from the sharpness
aware perspective. And our experiments show that sharpness aware-based
optimization techniques could help to provide models with strong generalization
ability. Our experiments also show that ASAM could improve the generalization
performance on un-normalized data, but further research is needed to confirm
this.

arxiv lg model generalization optimization perspective