UniOPSD: Unifying Outcome and Hindsight Feedback for Agentic Reinforcement Learning
UniOPSD (Unified On-Policy Self-Distillation) is introduced, which unifies these feedback sources through adaptive local credit arbitration and constructs comparable credit estimates from environmental returns and successful-peer hindsight at shared interaction anchors.