On-policy distillation (OPD) consolidates expert capabilities into a single student by matching teacher and student final-layer distributions on student-generated rollouts. We investigate whether depthwise prediction transitions, the changes in predictions between layers, can provide additional task-relevant supervisio...
Run-Yang You, Yong-Qi Li, Tie-Zheng Yu et al.· 0 citations
These findings show that EngramEdit turns conditional memory into an editable knowledge interface, extending its role beyond model scaling to support decoupled knowledge updates.
Hong-Ru Cai, Ran Wei, Wen-Jie Wang et al.· 0 citations
Surrogate Latent Policy Optimization (SLPO) is introduced to bring outcome-reward RL to autoregressive latent reasoners: an empirical surrogate policy density over latent transitions for trajectory-level credit assignment, and a correctness-supervised stopping head that outcome-reward optimization refines into a variab...
Runyang You, Zhiyuan Liu, Yongqi Li et al.· arXiv.org· 1 citation
Large Language Model (LLM) agents have moved beyond generating responses to executing multi-step tasks by calling tools, observing the results, and iteratively deciding the next action. Most agent systems run on desktops or servers, which support tool use and task automation. Mobile devices are also important agent env...
Hongru Cai, Yongqi Li, Ran Wei et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.