Author

Xin-Yu Luo

2 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#machine learning Preprint Oct 2026

Ori: Drift-Aware Streaming $k$-PCA for Very Low-Rank LLM Training

A prominent family of low-rank LLM optimizers, pioneered by GaLore, performs gradient-subspace projection: at each step, they project the gradient into a low-dimensional subspace and map the update back to the full model. Most existing work either recomputes the gradient subspace at certain intervals, or performs post-...

Xin-Yu Luo, Jin-Cheng Zhou, Meng-Bo Wang et al. · 0 citations

#artificial intelligence Preprint Oct 2026

MuonIO: Principled Norm-Aware Descent for Embedding Tables and Language Model Heads

The Muon optimizer derives its update rule for hidden linear layers by solving a local linearization of the loss penalized by the spectral norm, motivated by an RMS-stability argument for dense linear layers. Standard Muon implementations, however, exclude the input (embedding table) and output (language model head) la...

Lin-Kai Ma, Xin-Yu Luo, Meng-Bo Wang et al. · 0 citations