Skip to content

Green Bots versus Red Bots: Evaluating Large Language Models for Simulating Persuasion Dynamics in Online Influence Campaigns

2026 · International Conference on Language Resources and Evaluation · pp. 11152-11171 · 1 citation · 43 references
Computer Science

TL;DR

A dual-level evaluation framework to assess LLM-based agents at both the individual and collective levels is proposed, finding that while agents capture broad partisan orientations, they underestimate within-group variability and reproduce stereotypical ideological biases.

View source

Similar papers

#natural language process... Preprint Aug 2026

Do LLMs Change Their Minds Like Humans? Diagnosing Human--LLM Divergence in Single-Turn Persuasion Judgments

A systematic comparison using a naturally occurring online persuasion corpus in which original posters explicitly verify whether a reply changed their view is conducted, highlighting the risk of treating LLM judgments as faithful proxies for human belief updating and point to structural differences in how LLMs and huma...

Lin Chen, Yi-Tong Chen, Yong Li · 0 citations
Review Open access Sep 2026

Persona-prompted LLM agents achieve modest but genuine prediction of human social media reactions

Social media platforms mediate how billions form opinions and engage with public discourse. As autonomous AI agents increasingly participate in these spaces, understanding their behavioral fidelity becomes critical for platform governance and democratic resilience. Previous work demonstrates that LLM-powered agents can...

Ljubiša Bojić, Alexander Felfernig, Bojana M. Dinić et al. · 0 citations
#artificial intelligence Review Sep 2026

Thinking Less to Simulate Better: Intuitive Prompting Improves LLM Agents Simulating Individual Social Media Reactions, Including Unfamiliar Content

The present study profiled eight Serbian participants through a questionnaire, a deep interview, and a written self-presentation, recorded their reactions to sixty-eight social media posts, and asked four language models to predict those reactions under five prompt conditions varying profile content and instruction sty...

Ljubiša Bojić, Tijana Stanić, Joerg Matthes et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Persona and Persuasive Framing in AI Voice Agents: A $2\times2$ Field Experiment with Children

Conversational agents increasingly interact with children, yet evidence on how their design shapes children's susceptibility to persuasion comes almost entirely from the lab. We report a $2\times2$ randomized field experiment embedded in a public German Santa Claus telephone hotline. Children's calls were randomly rout...

Thilo Tamme, David Steck, Anton Hantel Technical University of Munich et al. · 0 citations
Book Open access Sep 2026

Who Changes Their Mind? Exploring Stance Shifts in LLM-Based Social Media Simulations

Understanding the dynamics of stance change on social media is crucial for addressing polarization and information integrity, yet observational studies face challenges including limited experimental control, restricted data access, and algorithmic confounds. We leverage Generative Agent-Based Modeling (GABM)—a novel si...

Valerio La Gatta, Gian Marco Orlando, Marco Perillo et al. · 0 citations
#artificial intelligence Review Aug 2026

The Failure Happens Before the Drift: The Social Dynamics of Values in LLM Agent Societies

Large Language Model (LLM)-based agents are increasingly used as proxies for human participants in social science research, yet it remains unclear whether they can faithfully simulate diverse and conflicting human value systems. We present a World Values Survey (WVS)-grounded simulation framework where culturally diver...

Farah Atif, Sougata Saha, Monojit Choudhury · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.