Skip to content

Author

Run-Sheng Yu

We have 2 of 11 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#artificial intelligence Preprint Oct 2026

DGA-Muon: Decoupled Geometry-Aligned Adaptive Scaling for Muon

While NorMuon has achieved strong empirical performance in pretraining, its underlying adaptive mechanism remains largely heuristic and poorly understood. In this work, we provide the first systematic theoretical analysis of NorMuon's adaptivity, revealing that it primarily arises from orthogonalization-induced geometr...

Wen-Peng Zhang, Run-Sheng Yu · 0 citations
#artificial intelligence Preprint Sep 2026

Matrix AdaGrad: Row-wise and Column-wise Adaptive Subgradient Methods

An Online Mirror Descent framework with adaptive proximal functions for matrix-valued parameters, providing a principled methodology for deriving matrix-aware adaptive optimization through online regret minimization and yields Row-wise Matrix AdaGrad and Column-wise Matrix AdaGrad as concrete instantiations with regret...

Wen-Peng Zhang, Run-Sheng Yu, Pei-Lin Zhao · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.