This research note examines distinctions and evaluation questions for AI-assisted software production through a hypothetical enrollment failure and a selective reading of the literature, and considers how quality engineering can evaluate both generated implementations and the processes that produce them.
Abstract
AI-assisted programming raises distinct questions about who produces code, who feels ownership of it, and who is responsible when it fails. This research note examines these distinctions through a hypothetical enrollment failure and a selective reading of the literature. Identifying the producer of a defective expression does not, by itself, determine the duties of reviewers, release decision-makers, or service operators. Collective ownership likewise leaves those duties to be specified. The discussion then considers how quality engineering can evaluate both generated implementations and the processes that produce them. Acceptance criteria should be justified by the required service outcome, with component checks contributing evidence toward that outcome. This perspective also permits comparison with systems that perform a task without generating a separate program for it. Such substitution would change the object of authorship while leaving the service obligation intact. The note reports no new empirical results; it proposes distinctions and evaluation questions for AI-assisted software production.
Tests play two roles in automated program repair (APR): they are the evidence that accepts a patch, and they are repository artifacts that may themselves need repair. Benchmarks resolve the tension by making evaluator-owned tests immutable; deployment cannot, because tests legitimately evolve with the code they check....
Bardia Mohammadi, Laurent Bindschaedler· Proceedings of the 7th Inter...· 0 citations
Generative AI is making software changes increasingly cheap to produce, shifting the bottleneck from implementation to validation. This keynote argues that software changes offer a uniquely tractable setting for establishing correctness. Unlike an arbitrary program, a change comes with an existing implementation whose...
Michael Pradel· Proceedings of the 41st IEEE...· 0 citations
The results show that harness-managed control flow can substantially improve the effectiveness of the smallest models and suggest that small models can be useful for repository repair when responsibilities are divided across explicit stages that can be independently assigned to the component best suited to each.
Francesco Dente, Dario Satriani, Donatello Santoro et al.· Proceedings of the 1st Inter...· 0 citations
Preliminary evidence is found that a single sentence added to the developer's own prompt substantially improves disclosure, and a benchmark scored on attack success alone cannot rank agents on the risk a developer actually carries.
Aaron Su, Rong-Xing Lu· Inquiry@Queen's Undergraduat...· 0 citations
Some defects in an AI-generated study can be identified from its artifacts; others require knowledge of what was approved before execution. We propose study contracts that bind declared experimental choices, run obligations and claim scope to recorded execution evidence, and distinguish this contract-relative verificat...
A small core retains implementation authority while a broader community continues to shape the software without writing code, and access to coding increasingly depends on approval rather than self-initiated contribution, forming a stewardship community.
G. Robles, D. German· 0 citations
Related blog posts
MIT News · Artificial Intelligence· news.mit.eduOct 13, 2026
Machine-learning networks can learn without detailed instructions from a designer. Those that do may offer insight into how the brain reorganizes itself during learning.
With $2.1 million funding from Google.org, the open-source Public Transit Intelligence Hub will unify public transit monitoring, operations, and passenger communication.