Skip to content

Author

Tian-Yu Li

2 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Looped Transformers as Optimizers

This framework derives loop transitions in closed form from a projection, a local objective and an optimizer update rule, which combines explicit weight decay, adaptive step size and a delta objective and improves average generative performance over the compared looped and non-looped baselines under matched training FL...

Yu-Long Huang, Chen-Yu Jiang, Zhan-Peng Zhou et al. · 0 citations
#machine learning Preprint Sep 2026

HyperTransfer: Understanding the Equivalence between Base Optimizer and Hyperball

HyperTransfer is proposed, which constructs a Hyperball optimizer that reproduces the dynamics of a target Base Optimizer using only its initialization and learning-rate schedule, without running the target optimizer itself, to extend the framework to non-scale-invariant networks.

Jinghui Yuan, Hong-Tao Zhang, Jade Zou et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.