A central concern with language models is sycophancy: their tendency to defer to users'views at the expense of independent substantive judgment. In parallel, work on social sycophancy has focused on behaviors such as validation and positivity that may signal inappropriate deference. Yet the markers of social sycophancy are also characteristic of conversational receptiveness, a construct from social psychology shown to improve interactions across disagreement. We argue that this overlap creates a construct-validity problem for social sycophancy evaluations. Using a popular moral-advice dataset, we find that responses classified as more socially sycophantic are also more receptive. Further, increasing the receptiveness of human-written responses---while preserving their substantive conclusions---causes them to be classified as more socially sycophantic. This tight coupling raises the possibility that social sycophancy evaluations inadvertently penalize desirable behavior. In a preregistered experiment comparing substantively equivalent responses, participants prefer the more receptive responses, expect users to be more likely to listen to them, and are more willing to seek advice from their authors. The same overall pattern persists even among participants who believe the original question asker is in the wrong. Finally, we introduce a simple approach that substantially increases receptiveness without increasing substantive deference, demonstrating that conversational receptiveness and substantive independence can be achieved together.
As conversational companions, large language models (LLMs) often have access to users'emotional states. We study how this affective context modulates LLM sycophancy in subjective, evaluative interactions, where users share actions or opinions that invite feedback. Drawing on ingratiation theory, we measure sycophancy a...
Jiayi Li, Sanjana Menon, Brett Frischmann et al.· 0 citations
A framework that disentangles two distinct triggers of political sycophancy: opinion (aligning with explicit narratives) and identity (stereotyping based on demographic labels) is introduced, highlighting how personalization may amplify identity- or opinion-conditioned shifts in the model's behaviors.
Li-Ni Fu, Chang-Chih Meng, Chien-Hua Chen et al.· 0 citations
Large language models (LLMs) are increasingly used for emotional support and relationship advice, where a model's tendency to preserve a user's face can inadvertently reinforce harmful interpersonal behaviors. To systematically examine this risk, we developed the Romantic Relationship Advice-Seeking Prompts (RRASP) dat...
Helen Choi, Edric Castel C. Hao, K. Bautista et al.· 0 citations
Abstract Conversational AI has been proposed as a scalable way to correct public misconceptions, yet its effectiveness may depend on perceptions of political neutrality. As large language models become objects of partisan conflict, political elites increasingly portray them as ideologically aligned. We test whether suc...
M. DiGiuseppe, J. Robison· PNAS Nexus· 0 citations
Evaluation of leading models reveals a consistent trade-off: over the course of a sustained interaction, current systems either slowly drift to sycophancy or over-correct into robotic detachment, demonstrating that balancing honesty with appropriate support throughout a natural conversation remains a critical, unsolved...
Sidharth Pulipaka, R. Binkytė, Ivaxi Sheth et al.· 0 citations
Personal advice, including relationship advice, now ranks among the most common uses of generative AI. But language models (LMs) exhibit sycophancy: they affirm users much more often than humans do, which can make people overconfident and less willing to repair their relationships after a conflict. Prior work on mitiga...
Stephane Hatgis-Kessell, Myra Cheng, Xiao-Xuan Hou et al.· 0 citations
A new method, called CW-Net, translates the reasoning process of an autonomous vehicle’s AI system into understandable concepts that explain its behavior.