This work reports a candidate phenomenon, an integration bottleneck, that lies in Norman's gulf of evaluation: a repair-relevant contribution reaches the user and fails to become actionable at the point of receipt.
Abstract
Research on AI-assisted programming has concentrated on the gulf of execution -- how users write successful prompts. We report a candidate phenomenon, an integration bottleneck, that lies in Norman's gulf of evaluation: a repair-relevant contribution reaches the user and fails to become actionable at the point of receipt. Two cases in an eighteen-case corpus of publicly shared AI-assisted-development accounts report this, from a peer and from the system's own output; both fall at evaluation's interpretation stage, and a third, which would fall at comparison, is reached only on an inferential reading and reported as a boundary case. A within-case contrast is consistent with actionability turning on whether the contribution can be restated as an instruction without an intervening judgement. We report this as a candidate warranting dedicated study, not an established regularity; its evidence base is retrospective author self-reports. On the submission side, medium alone did not sort the corpus contrasts; immediate uptake aligned with a checkable condition across four decisive contrasts, while a fifth case shows checkability sufficient for immediate uptake did not guarantee persistence. A twenty-trial multi-turn probe across two current models observed no constraint loss in fifteen judgeable narrow trials, and a ten-trial extension with an explicit restructuring request none in eight. Study 2 is not a replication attempt: it isolates regeneration, the mechanism the corpus authors invoke, and removes it as a sufficient explanation. We specify four interaction requirements for an accepted-constraint ledger; a conformance analysis of twelve mechanisms found none documented to satisfy all four.
We present: (i) a new dataset consisting of the full development history of a 21,000-line Python tool built entirely by Claude AI, with no human-authored code or tests, (ii) two code-provenance tracing tools, (iii) three taxonomies for instruction intent, commit provenance, and response reliability, (iv) application of...
This paper treats prompt engineering as a discipline for turning informal human intent into structured AI work specifications. It develops the practice as a sequence of reusable design moves: define the work, construct only the context the answer depends on, choose a role, or a moderated panel of roles, as an attention...
Erfan Loweimi, Hadi Daneshvar, Samira Loveymi et al.· 0 citations
This work analyzes three public corpora: CoAuthor (1,447 keystroke-level co-writing sessions), RealHumanEval (editor telemetry from 243 programmer records), and a pre-LLM CS1 corpus as a human-only baseline, comparing minimal-AI work, collaborative AI use, and simulated wholesale delegation.
It is found that AI exhibits significant efficiency issues in programming, and a series of safety and efficiency issues are found in AI programming, such as code redundancy and over-coupling when writing large projects.
This survey examines agentic artifact creation, which is defined as stateful construction in which an AI system materially constructs or revises a deliverable and intermediate observations redirect later work, and formulate principles for keeping commitments and responsibility explicit, turning feedback into targeted r...
Tianfu Wang, Zhe-Zheng Hao, Xinchi Xia et al.· 1 citation
AI-assisted development tools enable software engineers to generate implementations at substantially higher speed and volume than in traditional workflows, yet relatively little is known about how existing guardrails evolve in response.
M. Stolze, Mirco Strässle· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.