On-policy distillation (OPD) is increasingly used for language model post-training, yet how teacher supervision shapes learning and forgetting remains unclear. We present OPDArena, a framework comparing supervised fine-tuning (SFT), reinforcement learning with verifiable rewards (RLVR), and OPD across five pretrained m...
This work proposes Learning to Coach (L2C), a framework that trains a dedicated LLM-as-a-Coach to extract actionable experiential knowledge from an actor model's previous trajectory, and studies two such rewards: a same-instance reward, which improves subsequent responses on the original problem, and a cross-instance r...
Guan-Heng Chen, Tian-Zhu Ye, Li Dong et al.· 0 citations
Experiential Learning is proposed, which repurposes the feedback model from an LLM-as-a-Judge into an LLM-as-a-Coach, and establishes experiential knowledge as a richer and more generalizable learning signal for post-training on non-verifiable tasks.
Tianzhu Ye, Li Dong, Guanheng Chen et al.· arXiv.org· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.