Author

Jiaye Teng

h-index 3 View on Semantic Scholar

We have 3 of 13 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#machine learning Preprint Oct 2026

A Fine-Grained Analysis of the LoRA Fine-Tuning Landscape with Implications for Data Selection

Low-Rank Adaptation (LoRA) has become a standard approach for parameter-efficient fine-tuning, yet a fundamental practical question remains unresolved: how should the adapter rank be chosen? An overly small rank may lead to a poorly conditioned optimization landscape, whereas an unnecessarily large rank sacrifices the...

Bo-Wen Zhang, Chang-Rui Fang, Xin-Song Ma et al. · 0 citations

#artificial intelligence Preprint Sep 2026

Normalize-Then-Precondition: A Hierarchical Approach to Marginal Scale and Interaction Geometry for LLM Training

Matrix optimizers have emerged as a promising direction, with Muon standing out as a prominent design. Revisiting Muon through its full-Gram representation, we observe that it jointly processes marginal-scale and interaction information. This opens an alternative way to organize geometric information hierarchically, mo...

Zi-Xuan Gong, Ze-Yu Gan, Jia-Ye Teng et al. · 0 citations

Jul 2026

Hyperball May Not Be a Free Lunch

An angular effective learning rate is derived that accounts for the parameter-update angle, parameter norm, and update norm, and shows that the conventional norm-based measure is a special case under parameter-update orthogonality.

Yihao Xiao, Jialong Sun, Zitian Gao et al. · arXiv.org · 3 citations