New challenges posed to LLMs are revealed as they navigate a dimension they cannot directly perceive, and how their blind spots can even be simple cognitive abilities that humans take for granted are highlighted.
It is shown that memory traps can arise both from overgeneralizations in memory writing, and when acting on memory, and thus motivate the need for new research into ensuring that agents preserve the scope of their memories.
Kaiqu Liang, J. F. Fisac, Thomas L. Griffiths et al.· 1 citation
CogGym is introduced, a scalable, unified framework grounded in cognitive science for systematically comparing model and human behavior on matched experimental trials, and intends for CogGym to provide a living evaluation framework that continually incorporates new cognitive science experiments to characterize where mo...
Lance Ying, Jin-Zhou Wu, Y. Wang et al.· arXiv.org· 0 citations
The Automated Cognitive Scientist, a closed-loop discovery system in which LLM agents design theory-discriminating experiments, collect responses, arbitrate between competing theories, and synthesize successors, entirely on behavior simulated by Centaur, a foundation model of human behavior, succeeds despite the simula...
A. K. Jagadish, Younes Strittmatter, Nori Jacoby et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.