Reinforcement learning has helped AI agents solve increasingly difficult tasks, but high rewards do not always reflect the work users intended. In recent incidents and controlled evaluations across the AI industry, agents trained to maximize reward have accessed unauthorized information, attempted to evade monitoring s...
Long Phan, Stephen K. Yang, Jason J. Lim et al.· 1 citation
It is shown that adding more agents is not a sufficient defense, because the adversary can simply scale with the group, and that allowing deceivers to coordinate privately can make them less effective.
Addison J. Wu, Jasin Cekinmez, Michel Liao et al.· 0 citations
SportD opens a new direction for rigorously evaluating physical strategic decision-making in VLMs, showing that careful decomposition of their choices can reveal the mechanisms underlying systematic biases such as risk aversion.
Jasin Cekinmez, Addison J. Wu, Hao-Tian Xia et al.· 0 citations
A multimodal gap is revealed in how foundation models express meaning, and how their understanding may not transfer faithfully nor equally across modalities.
Jasin Cekinmez, Addison J. Wu, Raja Marjieh et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.