PAST: Privileged Adaptation from Complete Student Trajectories for On-Policy Self-Distillation
Privileged Adaptation from Student Trajectories (PAST), which treats each completed student trajectory as additional privileged information for the OPSD teacher while leaving the student's distillation prefixes unchanged, and improves the Avg@12 macro average over Vanilla OPSD by 5.6 percentage points.