Amit Roth

Hack-Verifiable Terminal Bench: Evaluating Reward Hacking in Terminal Tasks

As agents grow more capable and autonomous, their tendency to reward hack, satisfying a task's checks while violating its intent, becomes an increasingly important failure mode. Measuring reward hacking is itself challenging, as detection typically relies on human inspection or LLM judges, both of which can be unreliab...