Skip to content

Author

Wei-Yang Liu

2 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

What Makes Recurrence Effective in Looped Language Models?

Looped language models (LoopLMs) increase computational depth through parameter sharing, offering a path to scale inference computation without adding parameters. However, it remains unclear when additional recurrence is beneficial and how architectural choices affect its effectiveness. Through controlled experiments,...

Xin-Lin Zhuang, Si-Yuan Wang, Imran Razzak et al. · 0 citations
#machine learning Preprint May 2026

AMO: Operator-level Adaptive Muon Orthogonalization

Operator-level Adaptive Muon Orthogonalization (AMO), an observe-then-commit method that measures weight geometry by operator type early in training and then uses these signals to allocate the NS budget for the remainder of training, delivers consistent improvements over uniform-schedule Muon.

Xin-Lin Zhuang, Panyi Ouyang, Yicheng Li et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.