Zhi-Wei Zhai

Sharpness-Aware Muon: Matrix-Aware Optimization with Momentum-Guided Perturbations

Muon is a matrix-aware optimizer that combines momentum with orthogonalization to produce structured update directions with strong empirical behavior. However, it only shapes the geometry of the update itself and does not explicitly control neighborhood worst-case loss or bias training toward flat regions, which are of...