Hindsight Compacts but Does Not Repair: Rethinking On-Policy Self-Distillation in Reasoning Models
It is hypothesized that in long traces, hindsight reveals which steps were unnecessary more readily than which steps would have repaired the solution, and that changing the divergence, enriching or reinjecting the privileged context, and training longer only move OPSD along the same accuracy-length tradeoff.
Jaehoon Kim, Dong-Ha Lee
· 4 citations