Skip to content
Preprint

Agent Mesh: Reliability Primitives for Non-Idempotent Agent Delegation - Identity Adequacy and Evidence Adequacy

Aug 2026 · 0 citations · 26 references
Computer Science

TL;DR

A failure study of a production agentic software-delivery platform over 147 numbered incidents spanning 81 runs, finding seven reliability primitives whose enforcement unit is the delegation rather than the message, and derives seven reliability primitives whose enforcement unit is the delegation rather than the message.

Abstract

Autonomous agents increasingly perform bounded software tasks under an orchestrator that retries, resumes, and budgets them. The machinery such orchestrators reach for is the service mesh's: retry, timeout, and error-rate circuit breaking. We report a failure study of a production agentic software-delivery platform over 147 numbered incidents spanning 81 runs, each with a measured cost and, in most cases, a mutation proof reproducing the failure. All three assumptions those primitives rest on are violated in practice, and we quantify the consequences: a loop of fifty-four consecutive successful tool calls no error-rate breaker could see; a progress signal constant by construction, guaranteeing a false trip on the third repair round and driving one run from six of six components to three; twenty-one events accumulated across six invocations of one delegation, making a correct, idempotent component unwinnable; a misrouted failure that woke five components for a two-component fault, leaving three bystanders regressing working code; and twelve incidents in which the enforcement layer blocked correct work, the most expensive costing 107 agent turns and zero accepted writes. We find one cross-cutting cause and its dual. Identity adequacy: in five separate subsystems an identity that failed to discriminate produced a confident wrong answer, and two of them derived the corrective rule independently. Evidence adequacy: a reliability decision may be taken only on evidence capable of moving, attributable to what it measures, and deterministic under identical conditions. From the findings we derive seven reliability primitives whose enforcement unit is the delegation rather than the message, and specify the controlled evaluation the study motivates but does not constitute.

View source

Similar papers

Book Open access Oct 2026

AgentChaosBench: Benchmarking External Fault Detection and Localization in Agentic Systems

Reliability in LLM-based agentic systems is a property of the whole execution (its tool calls, model calls, guardrails, and inter-agent messages), not of the final answer alone, yet evaluating only task outcomes reveals little about how or why a run fails. We present AgentChaosBench, a benchmark for detecting and local...

Chen-Kai Zhang, Yi-Ran Li, Yi-Fang Tian et al. · 0 citations
#artificial intelligence Preprint Sep 2026

SINGED: Correct Outputs Do Not Certify Safe Execution in LLM Agents

This work introduces SINGED (Source Integrity and the Nonidentifiability Gap in Execution Decisions for LLM Agents), a controlled benchmark covering five primary and two held-out task families and exposes a rank-, evidence-, and choice-sensitive outcome-to-execution gap.

XiaoYu Xu, Zi Liang, Min-Xin Du et al. · 0 citations
Book Open access Oct 2026

R²: Repairability-Preserving Recursive Repair for Multimodal Agentic Systems

Current-incident success does not show whether a persistent repair preserves the evidence and rollback paths needed for the next failure. R² audits whether the repaired system can detect, localize, repair, and verify a different unseen fault within budget. It separates pre-authorization probes from sealed faults, confi...

Dominic Dabish · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.