After Cooperation Is Learned: Gradient Routing and Optimizer-Dependent Maintenance in Multi-Agent Reinforcement Learning
This work studies cooperation maintenance, defined as the survival of a behaviorally verified cooperative policy under continued training, and identifies a conditional, scale-sensitive maintenance risk associated with direct value-gradient routing rather than a universal failure of critics.