Aug 2026
GCPO: Diagnosing and Constraining Subspace Geometry in Rollout RL for LLMs
GCPO (Geometrically Constrained Policy Optimization), which applies hard bilateral orthogonal projections to constrain updates to the complementary subspaces, preventing such excursions by construction, consistently outperforms GRPO and recent variants.
Kai Yang, Jingwei Xu, Wan-Yu Wang et al.
· arXiv.org · 0 citations