Running the Gauntlet: Hard Agentic Tasks
GauntletBench, a web-based benchmark for evaluating agent generalisation in challenging scenarios, focusing on three underexplored capabilities (temporal perception, graphical understanding, and 3D reasoning), is introduced, revealing the substantial gap between current agent capabilities and those required for complex...
Mykola Vysotskyi, Runqi Lin, Grzegorz Biziel et al.
· 0 citations