Skip to content

Who Pays the Review Cost? Triage, Fairness, and Accountability in AI-authored Pull Requests

Oct 2026 · 0 citations · 107 references
Computer Science

TL;DR

AIPR governance is reframe around making human judgment observable before generated contributions consume scarce reviewer attention, and conceptualize missing rationale, validation, and ownership as reviewability debt, the work reviewers must absorb when generated code lacks sufficient human grounding.

Abstract

AI coding agents are moving from local code assistance into pull-based workflows, where generated contributions must be reviewed, explained, and maintained within existing project norms. Although recent work has begun to characterize AI-authored pull requests (AIPRs), less is known about how reviewers govern their entry into review, how AI authorship reshapes credibility and fairness, and what intake mechanisms protect review sustainability. We report a mixed-method questionnaire survey of 239 practitioners from 31 countries with code-review experience and varying exposure to AIPRs. In the scenarios and self-reports elicited by the survey, AI authorship was not a categorical rejection signal. Instead, respondents described review effort as conditional on whether an AIPR arrived as an accountable contribution, with bounded scope, project-grounded rationale, validation beyond Continuous Integration (CI), contributor responsiveness, and identifiable post-merge ownership. This conditional logic extended to newcomer AIPRs, where respondents emphasized visible participation in the current review process over profile-level reputation alone. Qualitative responses further described shifts in mentoring, scrutiny, deferral, and routing when human stewardship was difficult to observe. We conceptualize missing rationale, validation, and ownership as reviewability debt, the work reviewers must absorb when generated code lacks sufficient human grounding. These findings reframe AIPR governance around making human judgment observable before generated contributions consume scarce reviewer attention.

View source

Similar papers

#artificial intelligence Review Sep 2026

When No One Owns the Judgment: Accountability Under Contribution Dissolution in Human-AI Collaboration

This work exposes the limits of disclosure rules and provenance records as responses to AI-mediated collaboration and offers three directions for discussion: distinguishing the roles AI plays, identifying judgments that require clear human ownership, and creating conditions in which AI involvement can be disclosed with...

Heng-Zhi Ye · 0 citations
Review Oct 2026

Plausible Is Not Enough: Trust and Evidence in AI-Authored Pull Request Review

Code review is where AI-authored pull requests (AIPRs) must earn reviewer trust before integration, yet it is unclear whether reviewers apply the same criteria used for human-authored pull requests (HPRs). We surveyed 239 practitioners from 31 countries using matched HPR and AIPR questions to compare trust, evidence re...

Md Shamimur Rahman, Khairul Alam, Banani Roy et al. · 0 citations
Review Open access Oct 2026

The Algorithm-Mediated Inequality Regime in Hiring: A Systematic Review and Integrative Framework

AI-driven hiring has become widespread, yet concerns about fairness persist. Technical and behavioral research have evolved in largely disconnected streams. This paper conducts a systematic review following the PRISMA 2020 guidelines, synthesizing 50 studies to propose an “algorithm-mediated inequality regime” framewor...

Nuo-Heng Wang · 0 citations
#generative ai Open access Oct 2026

When disclosure rules are not enough: authorial warrant and judgment in ai-supported scholarship

Editorial policies increasingly require authors to disclose substantive uses of generative AI, but such requirements commonly focus on whether, where, and how a model was used. Even function-specific disclosure may locate a model in the research or writing process without showing how its outputs entered scholarly judgm...

M. Mirończuk · 0 citations
Open access Sep 2026

When Algorithms Meet Ethics: Systematic Evidence of Framing Effects in LLM Organizational Decision-Making

Large language models (LLMs) are increasingly deployed as decision-support tools in organizational contexts, yet their susceptibility to contextual framing remains poorly understood. This preregistered experimental study systematically examines how six framing dimensions—procedural justice, outcome severity, stakeholde...

Jonathan H. Westover · 2 citations · ⚡1

Related blog posts

MIT News · Artificial Intelligence Oct 23, 2026

Q&A: How AI came to model the “messy” human mind

Assistant Professor Benjamin Lindquist studies how engineers deliberately injected randomness into early AI, giving rise to deep-learning models that sometimes hallucinate.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.