Skip to content

How Agent Skills Fail under Long Contexts: A White-Box Study in Code Auditing

2026 · arXiv.org · Vol abs/2607.17937 · 1 citation · 23 references
Computer Science

TL;DR

A production-derived, white-box code-audit workflow whose instructions, edited files, tool logs, and expected checks are observable is examined, showing how a few omitted requirements can invalidate an otherwise complete artifact.

View source

Similar papers

#artificial intelligence Preprint Sep 2026

StateTape: Action-Conditioned Evidence Lifecycle Modeling for Long-Horizon Coding Agents

A novel and scalable framework that rewrites a coding agent's context as the repository changes rather than as the context grows, and can achieve a higher resolve rate in all experiments spanned by six coding agents and three edit-heavy benchmarks with little computational overhead.

Zi-Yang Yu, Liang Zhao, Bo-Wen Zhu et al. · 0 citations
#artificial intelligence Preprint Sep 2026

How Strongly Should Task State Influence an LLM Agent?

Across three models, two reasoning regimes, and two domains, four findings hold without per-turn reasoning: displaying accurate state is unreliable, an unverified ledger the agent writes itself beats an accurate checklist it is shown, directives help in proportion to the model's obedience, and enforcement needs no obed...

C. Zhang, Wonbin Kweon, Jia-Wei Han · 0 citations
#artificial intelligence Preprint Sep 2026

Staying on Task: Testing the Foundations of Long-Horizon Agent Reliability

Long-horizon agentic workflows require models to sustain repeated state-dependent actions all while the context grows, sub-task complexity changes, and new data arrives. Each situation represents an independent axis along which an agent may fail. An agent reconciling a long ledger, for example, must repeatedly read its...

Jeffrey Willette, Krishna C. Puvvada, Boris Ginsburg · 0 citations
Preprint Aug 2026

When May an Agent Stop? Evidence-Carrying Termination for Tool-Using LLMs

Evidence-Carrying Termination (ECT): an agent may return COMPLETE only when a typed certificate binds every required answer claim to valid, in-scope trace evidence and a deterministic replay reconstructs the claimed value.

Jason Liu · 3 citations
#artificial intelligence Preprint Sep 2026

How Do Agent Harnesses Create Value? Planning Information and Release Control in Stateful LLM Agents

Which component matters more depends on the loss assigned to erroneous acceptance: at low liability the planning gain dominates; at high liability the verifier's avoided false passes dominate; and a standalone verifier captures nearly all the false-pass benefit of the full planning-plus-verification stack at a fraction...

Yu-Kun Zhang, Ke-Mu Xu, Yi-Shen Chen · 2 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.