SPOT: Sparse Probing and Outcome Calibration for On-Policy Distillation
Sparse Probing and Outcome-calibrated Targets OPD is introduced, which addresses two coupled decisions, where to probe and what to distill, through an acquisition--exploration--exploitation procedure and demonstrates the effectiveness of SPOT in improving reasoning performance while balancing solution quality and cover...