Skip to content

JusticeAxis: Benchmarking Legal Judgment between Rigid Rule Application and Ungrounded Discretion

Sep 2026 · 0 citations · 33 references
Computer Science

Abstract

A sound judgment applies the law to established facts and weighs the circumstances in which they arose. However, existing methods swing between rigid statute matching and ungrounded discretion, benchmarks score a label or a rubric, and the experience that would supply the balance stays unverified. We formalize legal judgment as a reference-anchored task, whose object is a single decision that stays tied to the statute and to the circumstances at once. We introduce JusticeAxis, 256 real-world criminal cases from 18 countries with audio, image, and text evidence, and three lawyer-written judgments for every case: the recorded one and one for each failure. We further propose JusticeAgent, a harness whose element agents establish the facts and whose judge agent applies the law under skills carrying experience of the circumstances. Skills are distilled from execution trajectories and admitted only under Bayesian credible bounds. Experiments show that failure turns direction with scale: open-weight backbones drift to unsupported grounds, frontier models to the statutory default. We further verify that JusticeAgent, as a simple yet effective plugin, carries a frozen open-weight backbone to commercial level. Project resources are available at https://github.com/beita6969/JusticeAxis.

View source

Similar papers

#artificial intelligence Open access Oct 2026

Cited but Not Consulted: A Counterfactual Audit of Legal Chain-of-Thought Faithfulness

Large language models increasingly justify legal decisions by naming the statute or precedent behind a verdict, treated as evidence that the decision follows from it. We test this directly: holding case facts fixed, we substitute the named legal authority for an unrelated one and decode a model's evolving verdict from...

Saisab Sadhu, Shreeyans Arora, Pratinav Seth · 0 citations
Review Open access Sep 2026

Office and unowned architecture: public judgment in the age of algorithmic governance

Modern states increasingly use AI systems in public decision-making, including benefits eligibility, risk classification, immigration adjudication, and judicial administration. Defenders often argue that democratic authorization, validation, and review are sufficient to render such systems legitimate; critics often rep...

S. Wong · 1 citation
Open access Sep 2026

Negotiated Outcomes and Abbreviated Trials in Criminal Cases: Balancing Fairness and Efficiency in Three Legal Systems

Facing expanded criminal dockets, justice systems around the world are looking for ways to expedite proceedings and save resources while still offering credible procedures for adjudicating criminal cases. In the United States, defendants tend to face an all-or-nothing choice between two alternatives: a full trial at...

Michele Caianiello, Jenia Turner, Thomas Weigend · 0 citations
Sep 2026

Enforcement Of Civil Court Decisions and Structural Challenges with Legal Implications for Certainty, Contractual Reliability, and the Investment Climate in Indonesia

This article examines the enforcement gap in Indonesia’s civil justice system and evaluates whether digital integration can restore legal certainty and market confidence. Using a normative legal method enriched by secondary empirical data from the Supreme Court’s Directorate General for General Courts, we analyze statu...

Bambang Myanto · 0 citations
Open access Jan 2026

Are sentencing disparities unavoidable? Lessons from centralized judicial training

Sentencing disparities arise when judges impose different penalties in similar cases. Fundamentally unjust, such disparities have been a persistent target of reform. Instead of adopting numerical guidelines, Poland chose to centralize training and assessment of its judiciary in an effort to harmonize sentences. To meas...

Andrzej Uhl, Kamil Mamak · 3 citations

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.