Skip to content

One Example Is Enough to Pass Fairness Benchmarks: Rethinking Fairness Evaluation for Aligned LLMs

Sep 2026 · Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing · Vol abs/2609.14860 · 0 citations · 42 references
Computer Science

TL;DR

It is argued that BBQ-style multiple-choice abstention benchmarks measure a single structural cue, and a model that solves them does not thereby become fair, and is called for evaluation suites that cover a broader spectrum of fairness alignment.

Abstract

Warning: This submission studies stereotypes and biases, and contains toxic and offensive examples, used for illustration purposes only. Fairness benchmarks such as BBQ have become the de facto standard for fairness evaluation across major model families. We argue that these benchmarks are too easy to support their role: training Qwen 2.5 7B Base with Group Relative Policy Optimization (GRPO) on a single BBQ example, or placing that example in context as a one-shot demonstration for in-context learning (ICL), lifts mean BBQ accuracy from 79.9% to 92.9% and 99.0%, respectively, closing 80% of the gap to its large-scale RLHF counterpart (96.1%) with GRPO, and surpassing it with ICL. These effects generalize across model families. A cross-conditioning analysis shows the improvement is carried by the reasoning traces generated by the model, and one example suffices to elicit a category-agnostic ``missing evidence''reasoning pattern. We argue that BBQ-style multiple-choice abstention benchmarks measure a single structural cue, and a model that solves them does not thereby become fair. We call for evaluation suites that cover a broader spectrum of fairness alignment.

Read PDF

Similar papers

Review Open access 2026

A Fairness–Utility Evaluation Framework for Assessing Large Language Models (LLMs)

Large language models are increasingly used in contexts where their outputs can affect people directly, including hiring, admissions, and lending. This growing role makes it important to consider not only how well these models perform, but also whether their behavior is fair. Although many fairness metrics, bias benchm...

Samah Alhazmi · 0 citations
#artificial intelligence Preprint Aug 2026

Fair Like Us? Auditing LLM Alignment in Resource Allocation

It is found that large language models tend to prefer stricter fairness constraints than humans, show more self-interested behavior, are sensitive to how information is framed, and are difficult to align with human judgments using fine-tuning with current datasets.

Qi-Shen Han, Hadi Hosseini, Joshua Kavner et al. · 0 citations

When Post-Processing Fairness Constraints Help and When They Harm: Evidence from Eight Cross-Domain Evaluations

FAPE (Fairness Auditing for Production Environments), a four-stage framework evaluating a single post-processing intervention, Fairlearn's ThresholdOptimizer, across eight domain evaluations: criminal justice, income prediction, legal admissions, credit lending, agricultural lending, a multi-domain benchmark corpus, he...

Nithin Raghava Ramachandra Narla · 0 citations
Preprint Aug 2026

Follow the Norm: Accounting for Fine-Tuning and Prompt Effects on Model Rationales

It is demonstrated in controlled experiments that norm-breaking fine-tuning yields norm-divergent actions justified by self-interested rationales, suggesting a systematic shift in patterns of justification.

Long Hoang Nguyen, Brice Valentin Kok-Shun, Guangyu Du et al. · 0 citations
Open access Sep 2026

Individual and group fairness assessments via counterfactual explanations

This study explores the potential of counterfactual explanations to assess artificial intelligence (AI) fairness, especially in critical decision-making systems. Predictive models may amplify biases inherent in data sets or algorithms, and given the absence of a universally accepted fairness metric, a case-specific app...

Federico Sabbatini, Roberta Calegari · 0 citations
#natural language process... Preprint Sep 2026

SCM-based Fairness and Faithful Explainability for Legal Document Classification

Transformer models such as LegalBERT are increasingly used in legal decision support, raising concerns about both fairness and the transparency of model explanations. These properties are usually evaluated separately, leaving open whether a debiasing intervention that changes fairness also changes how faithfully explan...

Yasmina El Kacemi, S. S. M. Ziabari, A. M. Alsahag · 0 citations

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.