Arin Agarwal

Do Language Models Know Their Own Constraints?

Comparing supervised fine tuning and Group Relative Policy Optimization against an untrained baseline on a four tier Constraint Awareness Benchmark shows the reward based signal is the more destructive of the two: a reward that penalizes banned ingredient tokens regardless of framing learns a context independent suppre...