#artificial intelligence
Sep 2026
SIPO: Unifying Reinforcement Learning with On-Policy Self-Distillation
This work proposes self-instructing policy optimization (SIPO) with a contrastive self-teacher to provide dense credit, and demonstrates that SIPO outperforms both RLVR and OPSD baselines without an external teacher or additional generation.
Zhenrui Yue, Hui-Min Zeng, Yue-Qi Wang et al.
· arXiv.org · 1 citation