Skip to content
Preprint

Credible, Not Always Correct: How Reddit Users Verify AI-Generated Legal Advice

Aug 2026 · 0 citations · 65 references
Computer Science

TL;DR

Findings show that AI-assisted legal self-help operates within an emerging informal infrastructure which redistributes the work of verification to those least equipped to bear it.

Abstract

Large language models (LLMs) are increasingly used by laypeople to resolve real legal problems, against a backdrop of persistent access-to-justice deficits. This article presents evidence that the practical force of AI-generated legal advice depends not on its accuracy but on the social production of its credibility. While existing research has assessed the accuracy of legal AI, less is known about how machine-generated guidance is verified and made credible enough for lay users to act on. Drawing on a dual-method analysis of 153 Reddit narratives and 5,341 community reactions, this article maps a spectrum of verification practices. At one end, a minority of users verify AI-generated legal advice by triangulating across models, and some submit AI-generated guidance to platform communities for evaluation before acting, a configuration we term distributed counsel. Far more commonly, however, narratives are silent on verification. AI-generated legal advice is acted on the strength of its lawyer-like form and emotional reassurance alone. These findings show that AI-assisted legal self-help operates within an emerging informal infrastructure which redistributes the work of verification to those least equipped to bear it.

View source

Similar papers

Review Aug 2026

Can Legal AI Know When It Is Wrong? And Do Students Know When It Is?

This work identifies the 'inertia of confidence'--an overconfidence phenomenon analogous to the Dunning-Kruger effect where LLMs provide incorrect legal verdicts with near-maximum confidence, driven by a hypothesized'precedent overfitting'bias and proposes shifting toward adversarial legal research pedagogy and impleme...

Angel Mary John, Vipin Kumar Singh, J. T. Panachakel · 0 citations

JudgmentLens: Human-AI Sensemaking of Complex Legal Judgments

Judicial judgments are increasingly available, yet dense language and distributed relationships among facts, evidence, reasoning, and rulings remain difficult for non-experts to interpret. Through a mixed-methods formative study with Chinese non-expert readers (survey N=34; interviews N=6), we identified structural, in...

Xin-Yi Chen, Rui-Ji Li, Yue-Lu Li et al. · 0 citations
#artificial intelligence Preprint Oct 2026

LLM Persuasion Is in the Eye of the Evaluation

Large language models (LLMs) have already been shown to match or exceed human experts in persuasion. While their persuasive capabilities hold promise for beneficial uses such as education and health communication, they can also be used to manipulate and misinform, making their evaluation a growing priority for develope...

Kamile Dementaviciute, Julija Vaitonyte, T. De Bie · 0 citations
Conference Aug 2026

LegalRes: An Intelligent, Fairness-Aware Legal Services Platform

Finding and booking a lawyer remains surprisingly difficult for most people — not because lawyers are scarce, but because the systems connecting them to clients are broken. This paper introduces LegalRes, a web platform built on Next.js and React that takes a fresh approach to this problem. Rather than building another...

Aryan Mehra, Dhruv Desai, A. M · 0 citations
Open access Oct 2026

AI-Generated Authorities and the Integrity of Judicial Proceedings: Reconstructing the Lawyer's Duty of Verification in India

A tiered, source-anchored verification standard is proposed, keyed to source authoritativeness, procedural stage, and research-responsibility allocation within a legal team, capable of catching fabricated authorities before a judge relies on them rather than after an entire tier of appeal already has.

Sonia Arora · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.