Skip to content

JudgmentLens: Human-AI Sensemaking of Complex Legal Judgments

Sep 2026 · 0 citations · 99 references
Computer Science

Abstract

Judicial judgments are increasingly available, yet dense language and distributed relationships among facts, evidence, reasoning, and rulings remain difficult for non-experts to interpret. Through a mixed-methods formative study with Chinese non-expert readers (survey N=34; interviews N=6), we identified structural, interpretive, verification, and action breakdowns. We developed JudgmentLens, an AI-augmented reading system combining persistent case representations, adaptive explanations, and traceable links from generated interpretations to judgment passages. In a counterbalanced within-subject evaluation (N=16), participants completed tasks faster with JudgmentLens than with conventional PDF reading and reported lower workload and greater self-reported decision understanding, while rubric-scored comprehension did not differ reliably. An exploratory PDF+DeepSeek probe suggested that conversational AI supported formulated questions while leaving question formulation, answer integration, and source checking largely to users. We contribute an empirical account of non-expert judgment sensemaking and design strategies for inspectable, source-grounded AI mediation.

View source

Similar papers

#artificial intelligence Conference Open access Sep 2026

Ordinary, Reasonable Chatbots: Do AI Models Track Human Legal Judgments?

This study studies how large language model (LLM)-powered chatbots respond to series of questions about legal reasonableness, and suggests that chatbot responses generally track those of human participants.

Nirav Patel, Emily Wenger, C. Buccafusco · 0 citations
Open access Sep 2026

Plausible nonsense and deliberative reasoning: Benchmarking LLMs against human judgment.

Large Language Models (LLMs) are entering democratic contexts as instruments of governance, where the challenges at hand are ill-structured, marked by ambiguity and contestation. Ill-structured democratic problems demand more than factual precision; they call for intersubjective reasoning: context-sensitive judgments t...

F. Veri, Gustavo Kreia Umbelino · 0 citations
Review Open access 2026

Accountable NLP for Evidence-Grounded Decision Briefings: A Critical Review and Evaluation Framework

This review synthesizes 104 sources spanning explainable natural language processing (NLP), faithful explanation, hallucination and factuality evaluation, RAG, citation faithfulness, uncertainty communication, causal language, human–AI interaction, engineering and regulatory decision support, and institutional accounta...

Jihoon Moon · 0 citations
#large language models Conference Open access Aug 2026

The Deliberative Deficit: An Empirical Critique of LLMs in Democratic Discourse

Large language models (LLMs) are increasingly deployed in settings that require collective reasoning on complex, value-laden problems. Confidence in these deployments rests largely on benchmarks for verifiable tasks (mathematics, coding, coordination games), yet many of these applications concern problems where no obje...

Maurice Flechtner · 2 citations

Does Reasoning Improve Psychological Depth in Large Language Models? It Depends on Who's Judging

The results suggest that development-set performance is insufficient evidence for deployment validity on a shifted distribution, and that point-estimate judges can obscure the heterogeneity in subjective human evaluation.

Rui-Chen Zheng, Yin-He Wang, Fabrice Y. Harel-Canada et al. · 0 citations
#machine learning Preprint Sep 2026

Legibility is Not Interpretability: Comparing Judged and Actual Importance in Chain-Of-Thought Reasoning

This work operationalizes the importance of a reasoning step as its advantage: the change in expected reward, e.g., producing the correct final answer, from including that step, estimated via Monte Carlo rollouts, and evaluates whether LLM judges can identify high-advantage steps and finds that sufficiently capable LLM...

Kevin Du, A. Hoyle, L. Ruis et al. · 1 citation

Related blog posts

MIT News · Artificial Intelligence Nov 17, 2026

Putting a spotlight on AI, society, and humanity

Supported by the MIT Human Insight Collaborative, scholars are exploring how AI is impacting the human experience and reshaping higher education.

MIT News · Artificial Intelligence Nov 17, 2026

Learning the language of machine learning

By studying the computational foundations of language learning, Associate Professor Jacob Andreas builds intelligent systems that can communicate effectively with humans.

Microsoft Research Blog Nov 16, 2026

TokenEconomizer: Learning from Experience to Make AI Coding Agents More Efficient

AI coding agents are increasingly help developers fix bugs and build features largely on their own, but every interaction with their models consumes tokens. In each session, an agent sends instructions, tool descriptions, and session history to its model. Most efforts to reduce this cost focus on individual tasks. Yet developers return to the same […] The post TokenEconomizer: Learning from Experience to Make AI Coding Agents More Efficient appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.