Teacher-Student Gaps Are Not Enough: Outcome-Guided On-Policy Distillation for Multi-Turn Autonomous Agents
Outcome-Guided On-Policy Distillation is proposed, which applies trajectory-relative weighting to teacher supervision and calibrates these weights using final task outcomes from paired student continuations and selectively strengthens supervision on the student's original trajectories at turns where teacher guidance be...
Tong Zhang, Zhou Liu, Yi-Hao Liu et al.
· 0 citations