MileGPO: Milestone Inference with Local Evidence for Graph-Based Policy Optimization of Long-Horizon LLM Agents
MileGPO (Milestone Inference with Local Evidence for Graph-Based Policy Optimization) is proposed, which derives process-level credit from grouped on-policy rollouts through three designs and indicates that reliability weighting, local progress, and same-state branch evidence complement milestone discovery and resolve...