TISD: On-Policy Self-Distillation with Trajectory Intervention
On-policy self-distillation (OPSD) provides dense teacher targets, but evaluates them only along student-sampled rollouts. When the privileged teacher favors an alternative action at a visited prefix, OPSD can provide a target for the branch decision but cannot supervise the successor contexts induced by that action un...
Taeckyung Lee, Rinat Amankos, Jeonghye Kim et al.
· 0 citations