CogGym is introduced, a scalable, unified framework grounded in cognitive science for systematically comparing model and human behavior on matched experimental trials, and intends for CogGym to provide a living evaluation framework that continually incorporates new cognitive science experiments to characterize where mo...
Lance Ying, Jinzhou Wu, Y. Wang et al.· 0 citations
In many forms of reasoning, including arithmetic reasoning, generalizing across superficial changes in input format is effortless for humans: anyone who can solve 2+5 can also solve'two plus five'. In contrast, LLMs are more brittle to surface variations of the prompts: for example, they solve numeric arithmetic proble...
Andrea Gregor de Varda, Sana Pandey, Peng-Rui Han et al.· 0 citations
This paper investigates how knowledge transfers across different dialogue games by finetuning LLM models on games from the clembench suite and finds that some games benefit more from transfer than finetuning, and that the visuospatial family transfers best.
Filippo Momentè, Mir Nafis Sharear Shopnil, Andrea Gregor de Varda et al.· 0 citations
Human language processing can be studied through both behavior and brain activity, yet it remains unclear whether these two data types reflect sensitivity to the same information. One influential view holds that both behavioral and neural responses are largely determined by processing effort, often estimated by word su...
Andrea Gregor de Varda, Y. Berzak, Evelina Fedorenko et al.· bioRxiv· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.