On-policy distillation (OPD) trains agents on their own trajectories using supervision from a stronger teacher. We uncover a counterintuitive phenomenon in multi-turn agentic tasks: a smaller, initially weaker student can substantially outperform its teacher during training, only to regress as distillation continues. W...
Ji-Ke Zhong, Ming Li, Yu-Xiang Lai et al.· 0 citations
The results suggest context learning hinges on not only content acquisition but also specification acquisition, and designs a deliberately simple intervention PSCI (private specification-contract induction) which extracts local specifications and enforces them through adversarial checking and repair.
Jike Zhong, Ming Li, Yuxiang Lai et al.· 1 citation
Analysis shows that BRANCH's advantage arises not only from exploring multiple reasoning paths, but also from recovering from truncation: its gains strongly correlate with the baseline rate of empty, budget-exhausted outputs, weakening the hypothesis that different problems require routing among test-time reasoning ope...
Sheng Zhang, Xiao-Min Wu, Xi-Yang Wu et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.