Skip to content
Preprint

Assessing mentalization in humans and large language models

Aug 2026 · 0 citations · 200 references
Computer Science Biology

TL;DR

Different capacities for mentalization across LLMs are demonstrated, and cognitive computational modeling is highlighted as a formal method for assessing comparative intelligence across humans and machines.

Abstract

Mentalization - the ability to infer others'beliefs and intentions to guide one's own choices - is a key cognitive function underlying human social interactions. Large language models (LLMs) demonstrate behaviour consistent with humans on theory-of-mind tasks, yet whether these models can guide adaptive behaviour through mentalization is unknown. Here we use two economic games with cognitive computational modeling to uncover the latent strategies underlying mentalization in LLMs. We tested individual LLM agents across four model families, DeepSeek, GPT-4.1, GPT-5 and Gemini 2.0 Flash (N = 2,099), against opponents of varying sophistication and examined whether a prompting strategy designed to elicit strategic reasoning improved performance. We benchmarked results against human participants (N = 251) as a comparative measure. Across both games, LLMs showed clear behavioural and computational signatures of mentalizing that differed markedly by model provider and size. Strategic prompting generally improved performance by inducing more sophisticated reasoning, yet the extent of the benefit differed across the two tasks. Last, GPT-5 agents flexibly adapted their recursive depth of reasoning to increasingly sophisticated opponents, demonstrating superior performance to human participants. Collectively, we demonstrate different capacities for mentalization across LLMs, and highlight cognitive computational modeling as a formal method for assessing comparative intelligence across humans and machines.

View source

Similar papers

Open access Aug 2026

Mentalizing and heuristics as distinct cognitive strategies in human teaching.

Teaching is a foundational social behaviour that can result from mentally effortful reasoning or cognitively frugal heuristics. When do people use these strategies to teach? Here we investigated this using behavioural experiments and computational modelling with adult participants recruited via Prolific. Experiment 1 (...

S. Harootonian, Thomas L. Griffiths, Y. Niv et al. · 2 citations
Preprint Aug 2026

Small Foundation Models of Human Cognition and Behaviour

Small cognitively fine-tuned models show promise as noise ceiling estimators for psychological experiments, though their scope remains bounded by the paradigms seen in training.

Nick Oh, F. Gobet · 1 citation
Jul 2026

From Minds to Models: The Intersection of Psychology and LLM Behaviours

Large language models (LLMs) are often compared with the human mind because their decision-making is complex, non-linear and difficult to interpret. Psychological methods developed to investigate unobservable mental processes may therefore help examine LLM behaviour, particularly in government and healthcare. Building...

Oliver A. Guidetti, Reza Ryan · 0 citations
#artificial intelligence Preprint Jul 2026

Beyond Right and Wrong: Evaluating Second-order Social Reasoning in Large Language Models

A novel framework for evaluating metanorm reasoning in Large Language Models (LLMs) along two dimensions: emotional appraisal and behavioral response, and proposes new classification tasks, namely, predicting self-regulation in violators, and other-regulation in observers.

Sunny Rai, Jin-Yi Kuang, Reyhan Jamalova et al. · 0 citations
Jul 2026

CogArena: A Multimethod Evaluation of Cognitive Ability Structure in Large Language Models

CogArena is introduced, a procedurally generated 13-paradigm benchmark built around a multimethod framework for determining when cognitive-task scores warrant dimensional labels across five theory-motivated groupings, and theory-aligned prompting produces a small in-battery diagonal tendency, but the present evidence d...

Dengzhe Hou, Lingyu Jiang, Fangzhou Lin et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.