Skip to content

Beyond Code Generation: Reliability, Verification, and Cost Economics in the Agentic Software Development Lifecycle

Sep 2026 · 1 citation · ⚡ 1 influential · 43 references
Computer Science

TL;DR

This paper synthesizes peer-reviewed software-engineering research, university studies, benchmark audits, production reports from major technology companies, developer telemetry, and cost-management evidence released primarily from 2024 through September 2026 and proposes four engineering concepts: the Agentic SDLC Throughput Paradox, Production-Qualified Change (PQC), the Verification Tax, and an Agentic SDLC Control Plane that allocates autonomy subject to cost, reliability, and human-attention budgets.

Abstract

AI coding systems are moving from autocomplete and chat toward agents that can inspect repositories, edit multiple files, run tools, write tests, open pull requests, and work for long periods with limited supervision. This capability changes the bottleneck in software delivery. Recent field studies show meaningful gains in coding activity, but newer evidence also shows that those gains attenuate sharply between writing code and shipping reliable software. Review, integration, testing, security, deployment, and production operations remain constraining stages, while the economics are shifting from predictable per-seat licensing toward variable token, tool, sandbox, CI, and rework costs. This paper synthesizes peer-reviewed software-engineering research, university studies, benchmark audits, production reports from major technology companies, developer telemetry, and cost-management evidence released primarily from 2024 through September 2026. No new model experiment is claimed; numerical findings remain attributed to their original studies. The synthesis proposes four engineering concepts: the Agentic SDLC Throughput Paradox, Production-Qualified Change (PQC), the Verification Tax, and an Agentic SDLC Control Plane that allocates autonomy subject to cost, reliability, and human-attention budgets. An evidence-based horizon then maps today's supervised agents to future policy-bounded software factories. The central research question shifts from how much code an agent can generate to how much production-qualified value an engineering system can deliver per dollar, per reviewer-hour, and per unit of operational risk.

View source

Similar papers

#artificial intelligence Review Sep 2026

From Code to Requirements: Agentic Reverse Engineering of Business Rules at Enterprise Scale

Business requirements for enterprise software systems are rarely captured in structured form; the logic resides instead in source code, configuration files, and institutional memory. When these systems must be migrated, extended, or audited, the absence of formal requirements artifacts forces teams into expensive, know...

Garima Agrawal, Prasun Das, L. Priyanka et al. · 0 citations
Review Open access Aug 2026

From Code Generation to Code Orchestration: Evaluating the Impact of Agentic AI on Software Development Productivity, Quality and Security

This paper reviews recent empirical literature to ask what the developer's job is shifting from typing code to directing agents that type code a change often summarized as a move from code generation to code orchestration.

P. N. Nesarajan, P. Thenmozhi, S. A. et al. · 0 citations
#software testing Preprint Sep 2026

A Large-Scale Empirical Study of Quality Assurance Practices and Gaps in AI Agents

A large-scale empirical study of quality assurance (QA) practices in 157 open-source LLM-based agent projects with at least 100 GitHub stars highlights the need to move beyond feature-level testing toward systematic end-to-end validation that ensures agent workflows remain within intended boundaries when interacting wi...

Wu-Yang Dai, Moses Openja, Jiho Shin et al. · 0 citations
Review Aug 2026

Loop Engineering: Building Blocks, Adoption, and Impact

An exploratory review of the emerging gray literature, which largely agrees on what a well-engineered loop contains: triggered agent runs bounded by machine-checkable stop conditions, persistent state files, verifier sub-agents, token budgets, and defined points of escalation to humans.

Jai Lal Lulla, Vahram Nersesyan, Seyedmoein Mohsenimofidi et al. · 0 citations
Review Open access Sep 2026

Generative AI Assistants in Software Development: Productivity Gains, Code Quality, and Security Trade-offs

Generative artificial intelligence (AI) coding assistants promise to shorten software-development tasks, yet task speed alone cannot establish an improvement in engineering productivity. This critical narrative review asks whether assistants help developers complete work faster without increasing functional defects, ma...

Rikelmy Rodrigues Menezes · 2 citations
Preprint Aug 2026

The Specification Paradox: Rethinking Requirements Engineering in the Age of AI

The growing adoption of Large Language Models (LLMs) in Software Engineering has reinforced the expectation that coding activities can be largely automated. However, this perception may represent yet another historical search for a solution capable of eliminating the inherent challenges of software development. This ar...

T. Sirqueira, Jessica Faciroli · 1 citation

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.