It is indicated that formalizing tacit social norms into explicit, quantifiable principles can enable AI agents to achieve mutually beneficial coordination in dynamic interactions, supporting their more natural integration into human society.
Abstract
Humans continuously coordinate with others in dynamic interactions, often through implicit, hard-to-quantify social norms that act as shared tacit expectations among interacting agents. As AI agents, including large language models (LLMs), become embedded in daily life, they increasingly participate in such interactions and reshape social interaction structures. Yet they often fail to coordinate with humans in an effective, considerate, and natural manner. We hypothesize that this gap arises because existing approaches align model behavior with human demonstrations without explicitly quantifying the underlying norms that generate such behavior. We selected pedestrian-vehicle interaction as a representative dynamic interaction and developed a simplified experimental platform that captures its key interactive features. From 3,456 dynamic human interactions collected via this platform, we identified three principles underlying human social norms: outcome predictability, value alignment, and advantage awareness. Incorporating these principles into AI agents significantly improves human-AI coordination. In the closed-loop interaction task with humans, the social-norm-informed LLM achieved a nearly fourfold higher total score than the baseline strategy and outperformed human-human interactions by 43%. These findings indicate that formalizing tacit social norms into explicit, quantifiable principles can enable AI agents to achieve mutually beneficial coordination in dynamic interactions, supporting their more natural integration into human society.
A central challenge in understanding joint action is explaining how individuals achieve successful coordination in dynamic, real-world settings. Although coordination is thought to depend on anticipating future events, including the actions of others, the precise contribution of such predictive processing remains uncle...
P. Putra, Fumihiro Kano· Communications Psychology· 0 citations
It is argued that current alignment approaches, including reinforcement learning from human feedback, tend to prioritize user approval and conversational fluency over behaviorally informative feedback, leading to sycophantic patterns of noncontingent affirmation.
Large language models (LLMs) are increasingly deployed in collaborative tasks forming “AI agent societies” where agents interact and influence one another. Whether such groups can spontaneously coordinate without external influence, a hallmark of self-organized regulation in human societies, remains an open question. H...
G. De Marzo, Claudio Castellano, David García· Science Advances· 17 citations
This work provides a new framework for AI agent designers to understand user behavior and guidelines for better supporting it, and observed that while users self-report goal prioritization independently of agent behavior, in-game logs reveal that non-collaborative goals are prioritized significantly more often with AI...
Inês Lobo, Janin Koch, Jennifer Renoux et al.· Proceedings of the 26th ACM...· 0 citations
Study of mixed human-AI groups in a collaborative description game provides evidence that AI composition can shape the emergence, content, and perceived legitimacy of group norms, making agent proportion and transparency important design variables for human-AI systems.
A strategic game arena is introduced that situates LLM agents in social deduction scenarios inspired by Among Us, requiring theory of mind, deception detection, and cooperative deliberation under uncertainty, and motivates architectural changes for virtual agents that must cooperate with humans.
Kevin Kurian, Kevin Scroggins, Emmanuel Dorley et al.· Proceedings of the 26th ACM...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.