Different capacities for mentalization across LLMs are demonstrated, and cognitive computational modeling is highlighted as a formal method for assessing comparative intelligence across humans and machines.
Abstract
Mentalization - the ability to infer others'beliefs and intentions to guide one's own choices - is a key cognitive function underlying human social interactions. Large language models (LLMs) demonstrate behaviour consistent with humans on theory-of-mind tasks, yet whether these models can guide adaptive behaviour through mentalization is unknown. Here we use two economic games with cognitive computational modeling to uncover the latent strategies underlying mentalization in LLMs. We tested individual LLM agents across four model families, DeepSeek, GPT-4.1, GPT-5 and Gemini 2.0 Flash (N = 2,099), against opponents of varying sophistication and examined whether a prompting strategy designed to elicit strategic reasoning improved performance. We benchmarked results against human participants (N = 251) as a comparative measure. Across both games, LLMs showed clear behavioural and computational signatures of mentalizing that differed markedly by model provider and size. Strategic prompting generally improved performance by inducing more sophisticated reasoning, yet the extent of the benefit differed across the two tasks. Last, GPT-5 agents flexibly adapted their recursive depth of reasoning to increasingly sophisticated opponents, demonstrating superior performance to human participants. Collectively, we demonstrate different capacities for mentalization across LLMs, and highlight cognitive computational modeling as a formal method for assessing comparative intelligence across humans and machines.
Teaching is a foundational social behaviour that can result from mentally effortful reasoning or cognitively frugal heuristics. When do people use these strategies to teach? Here we investigated this using behavioural experiments and computational modelling with adult participants recruited via Prolific. Experiment 1 (...
S. Harootonian, Thomas L. Griffiths, Y. Niv et al.· Nature Human Behaviour· 2 citations
Small cognitively fine-tuned models show promise as noise ceiling estimators for psychological experiments, though their scope remains bounded by the paradigms seen in training.
Large language models (LLMs) are often compared with the human mind because their decision-making is complex, non-linear and difficult to interpret. Psychological methods developed to investigate unobservable mental processes may therefore help examine LLM behaviour, particularly in government and healthcare. Building...
Oliver A. Guidetti, Reza Ryan· arXiv.org· 0 citations
A novel framework for evaluating metanorm reasoning in Large Language Models (LLMs) along two dimensions: emotional appraisal and behavioral response, and proposes new classification tasks, namely, predicting self-regulation in violators, and other-regulation in observers.
Sunny Rai, Jin-Yi Kuang, Reyhan Jamalova et al.· 0 citations
CogArena is introduced, a procedurally generated 13-paradigm benchmark built around a multimethod framework for determining when cognitive-task scores warrant dimensional labels across five theory-motivated groupings, and theory-aligned prompting produces a small in-battery diagonal tendency, but the present evidence d...
Dengzhe Hou, Lingyu Jiang, Fangzhou Lin et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.