It is shown that ZebraArena requires a combination of in-depth reasoning and accurate external tool calling, which remains a challenge as frontier reasoning models such as GPT-5 and Gemini 2.5 Pro only achieves 60% accuracy on the hard instances.
Wan-Jia Zhao, Ludwig Schmidt, Ye-Jin Choi et al.· arXiv.org· 1 citation
This work proposes LabAgent, a reproduce and discovery harness tailored for a lab's continuous work that ranks first over commercial generalist agents in every domain, and demonstrates accurate reproduction of a published figure.
Lei Liu, Yi-Kun Zhang, Jia-Lin Chen et al.· 0 citations
Over 10,000 communities of language-model agents that repeatedly exchange messages and revise their opinions across objective mathematics questions and subjective political statements demonstrate that collective behavior of AI agents, like that of other complex systems, follows compact and predictive dynamical laws.
Batu El, J. Paeng, Fatih Dinç et al.· 9 citations· ⚡1
AI agents increasingly operate as part of interacting systems rather than in isolation. As agents exchange information and jointly make decisions, their interactions can improve collective reasoning but may also produce herding, polarization, or amplify shared biases. Understanding and predicting these collective dynam...
Batu El, Jinhee Paeng, Fatih Dinç et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
