Dense Is Not Enough: Hierarchical Supervision Allocation for Long-Horizon On-Policy Distillation
This work forms long-horizon OPD as hierarchical supervision allocation as well as a coarse-to-fine framework that organizes supervision through Locate, Validate, and Refine and suggests that effective long-horizon distillation requires teaching at the right depth, the right decision, and the right token.