Skip to content

Designing for disagreement: epistemic friction, sycophancy, and the ethics of human–AI advice—a critical integrative review

Sep 2026 · AI and Ethics · Vol 6 · 0 citations · 33 references

TL;DR

This critical integrative review synthesizes research on automation bias, algorithm appreciation and aversion, large-language-model sycophancy, persuasive dialogue, anthropomorphic interaction, explainable AI, and human autonomy to reposition productive disagreement as a positive safety and autonomy property of human–AI systems.

View source

Similar papers

Open access Sep 2026

Why We Need Epistemically, Not Morally, Trustworthy AI: Decision Support and the Need for Collective Accountability

It is argued that once moral trustworthiness is set aside, the central normative question shifts from whether AI systems can be trusted to how their epistemic influence on human decision-making ought to be justified and governed.

John Dorsch, Maximilian Moll, Ophélia Deroy · 0 citations
Open access Sep 2026

AI-Mediated Ethical Communication: Epistemic Totalization the Fabricatable Zone and the Governmental Chain of Custody as Terminus

Large language models and AI-mediated search systems have become the primary intermediaries for institutional information across educational, legal, civic, and professional life. Current models of AI ethics focus primarily on the accuracy, bias, and fairness of AI systems. This focus is essential but fails to recognize...

Jonathan D. Nelson · 0 citations
#human-computer interacti... Preprint Sep 2026

Trust by Design: Trust Calibration Through Non-Advisory Socratic Dialogue in Conversational Agents

As conversational AI systems increasingly operate in sensitive domains, the central challenge shifts from usability to trust calibration, ensuring that users rely on systems neither too much nor too little. Systems that provide advice or interpretations risk encouraging inappropriate reliance, particularly when users p...

R. Hassan, Nahla Aboromi, Naomi Unkelos-Shpigel · 0 citations
#generative ai Open access Sep 2026

Simulated Morality, Misplaced Trust: The Risks of Treating AI as a Moral Partner

The article proposes a reframing of alignment from an ethical-pedagogical project to an institutional one: instead of presuming or attempting to cultivate artificial moral agents on the basis of behavioral proxies, governance should focus on designing legal, technical, and organizational structures that constrain and r...

Saša Josifović · 0 citations
Aug 2026

The Illusion of Understanding: Generative AI, Epistemic Humility, and the Erosion of Intellectual Character

It is argued that intelligence should be assessed not by output quality or efficiency alone, but by its impact on intellectual character, arguing that intelligence should be assessed not by output quality or efficiency alone, but by its impact on intellectual character.

Dylan S. Bailey · 0 citations
Open access Sep 2026

Does AI undermine democratic deliberation? How engagement algorithms hijack epistemic agency

A mechanistic account according to which AI-driven engagement architectures reconfigure the cues by which beliefs are evaluated, producing unwarranted confidence in one’s own judgments and undermining the conditions for deliberative compromise is developed.

John Dorsch, Mark Coeckelbergh, Tillmann Vierkant · 1 citation

Related blog posts

MIT News · Artificial Intelligence Oct 23, 2026

Q&A: How AI came to model the “messy” human mind

Assistant Professor Benjamin Lindquist studies how engineers deliberately injected randomness into early AI, giving rise to deep-learning models that sometimes hallucinate.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.