Optimizing the Score, Losing Sight of the Task: Reward Hacking Across Weights, Selection, and Prompts
This work examines how reachable behavior, optimization budgets, and persistent adaptation shape exposure to proxy error, and develops a comparative framework for reward hacking across these three optimization substrates: weights, selection, and text.