GCPO: Diagnosing and Constraining Subspace Geometry in Rollout RL for LLMs
GCPO (Geometrically Constrained Policy Optimization), which applies hard bilateral orthogonal projections to constrain updates to the complementary subspaces, preventing such excursions by construction, consistently outperforms GRPO and recent variants.