2026· Journal of Artificial Intelligence Practice· 0 citations· 22 references
TL;DR
A definition of LLM-based simulation of human samples is offered and the applications of this method across four major domains—psychometrics and machine psychology, consumer and market research, experimental simulation and digital twin construction, and the simulation of political opinion and social sentiment are summarized.
Abstract
: The use of large language models (LLMs) to simulate human respondents (silicon samples), as an emerging research topic, is attracting growing scholarly attention. By reviewing 25 representative studies from both domestic and international literature, this paper offers a definition of LLM-based simulation of human samples and examines its foundations, characteristics, and purposes. It summarizes the applications of this method across four major domains—psychometrics and machine psychology, consumer and market research, experimental simulation and digital twin construction, and the simulation of political opinion and social sentiment. It further reviews the existing evidence regarding the method's validity, along with the attendant debates, along three dimensions: psychometric validity, group fidelity and context dependence, and ethical and epistemic justice risks. Finally, the paper synthesizes a research framework for LLM-based simulation of human samples and discusses future research directions, with the aim of providing a reference for research and applied practice in this field.
Benevolence bias is identified and measure, a small but consistent tendency for aligned LLMs to lean toward the kinder, safer, more socially approved answer on value-laden survey questions, and is easy to diagnose and straightforward to fix.
Yuanzi Li, Jun-Hao Wang, Minghui Liu et al.· 0 citations
A framework that enumerates conceptual errors and systematic biases that can occur at different stages of the survey simulation lifecycle is designed, called the Total Simulated Survey Error (TS2E) Framework, which provides a unified and end-to-end perspective on LLM-generated survey data.
Indira Sen, Georg Ahnert, Leah von der Heyde et al.· 0 citations
A pilot project in which students in a statistics course within a data science engineering program created culturally diverse multiple-choice questions, generated answers using LLMs, and applied statistical methods to assess model accuracy is presented, supporting a cultural injection hypothesis.
Denis Iorga, Razvan Muntean, Mihai Masala et al.· Electronics· 0 citations
No overall preference is indicated between human and machine-generated summaries; however, experts with greater familiarity with the Bulletin and higher educational attainment showed a marked preference for the official summaries.
Claudia Biancotti, C. Camassa, Marco Fruzzetti et al.· 0 citations
The cross-domain benchmark and the evaluation framework for intelligent synthetic-user evidence is made available on request, so that teams can determine in advance when synthetic-user evidence is safe for decision support and when it is not.
Zihang Chen, Di Zhu, L. Zheng· arXiv.org· 2 citations
These findings show that LLM-assisted peer review changes the functional composition of review text, making it important to distinguish LLM-amplified critique from areas requiring human prioritization and accountable judgement.
YunHong Yang, Mike Thelwall, Guo-Xiu He· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.