Multi-teacher on-policy distillation (MOPD) aims to combine the strengths of RL-trained teachers in a single student, but how teacher signals affect parameter changes remains underexplored. We study Qwen3-1.7B with four domain teachers trained with RL from the same initialization as the student, comparing gradients, op...
Si-Qi Zhu, Suo-Zhi Huang, Kai-Xuan Zhang et al.· 0 citations
We present OLIVE (OnLine InterVEntion). At each iteration, the evolving student policy generates a new prefix, the teacher continues it autoregressively, and the student is updated using cross-entropy computed on the teacher-generated tokens. Each design choice targets a corresponding limitation of existing distillatio...
Hao-Jin Wang, Dylan Zhang, Huai-Bo Chen et al.· 0 citations
This work proposes GMTRouter, which represents multi-turn user-LLM interactions as a heterogeneous graph with five node types: user, LLM, query, response and turn, thereby maximally preserving the rich relational structure of the interaction.
Encheng Xie, Yihang Sun, Tao Feng et al.· arXiv.org· 6 citations
It is argued that, in dynamic long-horizon interactions, memory is not a static collection of facts but a lifecycle of explicit operations, including remembering, forgetting, updating, reflecting, and their compositions, which reveal that current systems remain far from uniformly reliable.
Xixuan Hao, Zeyu Zhang, Zehao Lin et al.· arXiv.org· 3 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.