Set-shifting Behavioral Test for Harnessed Agents
This work borrows the notion of set-shifting from cognitive psychology to study how well LLM agents adapt to hidden reliability shifts, and introduces a suite of measures to quantify agent behavior after reliability shifts.
Zi-Hao Ye
· 0 citations