Skip to content

VITAL-RAG: Invariance Race for Context Allocation in Coding Agents

Jul 2026 · arXiv.org · Vol abs/2607.26937 · 0 citations
Computer Science

TL;DR

VITAL-RAG is introduced, which organizes evidence by canonical code object, keeps one query-relevant companion only when it adds semantics not already represented, and renders selected evidence under per-object and global token budgets.

Abstract

Coding agents often retrieve code from an entire repository, but only limited evidence can fit into the final model input. Conventional retrieval-augmented generation (RAG) for coding agents treats fragments from the same code object as separate results, so redundant views can occupy multiple context positions and crowd out useful code. Grouping fragments by code object reduces this redundancy, but can discard local information needed for the task. We describe this tension as an invariance race: allocation should stay stable under redundant renderings but change when a fragment adds task-relevant semantics. To address this race, we introduce VITAL-RAG, which organizes evidence by canonical code object, keeps one query-relevant companion only when it adds semantics not already represented, and renders selected evidence under per-object and global token budgets. On RepoBench, VITALRAG improves Recall@4K from 39.59% to 63.67% while reducing evidence tokens by 35.63%. Across three model backends, it matches or outperforms recent baselines on RepoClassBench and achieves the highest raw Pass@1 on RepoExec.

View source

Similar papers

#natural language process... Preprint Sep 2026

Record Grouping Controls Evidence Weight in Language Models

Retrieved records are presentation units; a supplied partition determines which records enter a language model as one evidential contribution. We characterize the invariant group-content state that removes within-group copies while retaining complementary canonical content, show that equal group counts can encode diffe...

Zhong-Xuan Liu, Si-Cheng Zhou, Hong-Zhi Wang · 0 citations
Preprint Aug 2026

Can Coding Agents Solve Repository-Level Issues with Rendered Code? An Exploratory Study of Visual Representations

This study evaluates rendered code in repository-level repair workflows and introduces controlled agent settings to separate unguided repository exploration from more structured repair stages, and positions rendered code as a viable but conditional compression mechanism for realistic coding agents.

Weijie Liang, Yuanfeng Song, Xing Chen et al. · 0 citations
Review Jul 2026

Zero-Mem: Zero-Token Memory Operations for LLM Agents

The results show that structured agent memory need not generate an intermediate representation of the past, and Zero-Mem achieves competitive performance while eliminating LLM calls and LLM-token consumption from memory operations.

Yi-Lin Xiao, Zhe-Han Zhu, Yujing Zhang et al. · 1 citation
#artificial intelligence Preprint Sep 2026

The Missing Complement: State-Conditioned Minimal Sufficient Evidence for Coding Agents

Retrieval assembles repository context by ranking passages for relevance to the current query. A coding agent halfway through an issue has already read much of what such a ranker returns. Relevance is scored per passage, but sufficiency belongs to the set: independently scored passages can fill the budget with support...

Zhe-Xi Feng, Rui-Yi Zhang, Yong-Bo Yang et al. · 0 citations
Preprint Aug 2026

Paritok-4B: Intent-Conditioned Context Compression for Coding Agents

This work presents Paritok-4B, a 4B LoRA compressor for coding-agent trajectories built on two commitments, and distil a gpt-4.1-mini teacher over 67,074 real OpenHands trajectories into 40,606 validated examples and fine-tune Qwen3-4B.

Jiayu Shi, Lu Chen · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.