Skip to content

Author

Yihang Sun

We have 4 of 21 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#machine learning Preprint Oct 2026

From Gradients to Capabilities: Understanding Multi-Teacher On-Policy Distillation

Multi-teacher on-policy distillation (MOPD) aims to combine the strengths of RL-trained teachers in a single student, but how teacher signals affect parameter changes remains underexplored. We study Qwen3-1.7B with four domain teachers trained with RL from the same initialization as the student, comparing gradients, op...

Si-Qi Zhu, Suo-Zhi Huang, Kai-Xuan Zhang et al. · 0 citations
#natural language process... Preprint Sep 2026

Learning from Teacher Continuations at Student States

We present OLIVE (OnLine InterVEntion). At each iteration, the evolving student policy generates a new prefix, the teacher continues it autoregressively, and the student is updated using cross-entropy computed on the teacher-generated tokens. Each design choice targets a corresponding limitation of existing distillatio...

Hao-Jin Wang, Dylan Zhang, Huai-Bo Chen et al. · 0 citations

GMTRouter: Personalized LLM Router over Multi-turn User Interactions

This work proposes GMTRouter, which represents multi-turn user-LLM interactions as a heterogeneous graph with five node types: user, LLM, query, response and turn, thereby maximally preserving the rich relational structure of the interaction.

Encheng Xie, Yihang Sun, Tao Feng et al. · 6 citations
Jul 2026

MemOps: Benchmarking Lifecycle Memory Operations in Long-Horizon Conversations

It is argued that, in dynamic long-horizon interactions, memory is not a static collection of facts but a lifecycle of explicit operations, including remembering, forgetting, updating, reflecting, and their compositions, which reveal that current systems remain far from uniformly reliable.

Xixuan Hao, Zeyu Zhang, Zehao Lin et al. · 3 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.