Skip to content
Book Open access

Query-Aware Context Selection for Retrieval-Augmented Generation

Jul 2026 · Annual International ACM SIGIR Conference on Research and Development in Information Retrieval · pp. 3805-3810 · 0 citations · 33 references
Computer Science

TL;DR

This work conducts an empirical study of how irrelevant retrieved passages affect downstream generation, and proposes a lightweight, context-size classification module that dynamically predicts how much context is required based on query-specific needs.

Abstract

Retrieval augmented generation (RAG) combines language models with external corpora to support knowledge-intensive tasks, such as open-domain question answering. Standard RAG systems typically employ a fixed top-k retrieval strategy, retrieving the same number of passages regardless of query needs. This can lead to either insufficient evidence, or the inclusion of irrelevant contexts that lead to a degradation of generation performance. In this work, we conduct an empirical study of how irrelevant retrieved passages affect downstream generation, analyzing their impact across multiple standard generator models. Building on these insights, we propose a lightweight, context-size classification module that dynamically predicts how much context is required based on query-specific needs. We integrate this approach into a full RAG pipeline and demonstrate improved performance over several baselines.

Read PDF

Similar papers

Conference Jul 2026

FUSE-RAG: A Unified Architecture for Retrieval-Augmented Generation

Large language models may suffer from insufficient context use and unsupported generation in question answering tasks that require external knowledge. This study compares the main strategies affecting retrieval and generation performance in retrieval-augmented generation systems within a common experimental setting. In addition to a standard dense retrieval baseline, we evaluate multi-query, hypothetical document, hypothetical question, sparse-dense hybrid retrieval, and chunk compression, and we also propose an integrated method (FUSERAG) that combines these components. Experiments are conducted on a dataset containing 223 documents, 7933 chunks, and 1488 question-answer instances. Results show that the proposed method achieves the highest Mean Reciprocal Rank, nDCG at 5, and recall at 5 at the retrieval level, while the sparse-dense hybrid approach yields the best generation results.

Buğra Şimşek, Korhan Sevinç, Helen Parlar et al. · 0 citations
Open access 2026

SAC-RAG: Semantic Adaptive Context Compression for Retrieval-Augmented Generation

Experimental results show that SAC-RAG reduces token consumption by 38%–58% at the cost of only a 1–2 percentage point EM drop, with EM actually improving after compression for reasoning-type questions, achieving the optimal quality–efficiency trade-off in terms of token consumption.

Deyu Zhang, Hongqiang Yu, Jinze Huo et al. · 0 citations
Preprint Jul 2026

Testing Retrieval-Augmented Generation Systems with Chunk Coverage

Chunk Coverage (CC), an oracle-independent test adequacy criterion for testing the retrieval component of RAG systems, is introduced and results show that CC captures retrieval diversity relevant to effective testing without requiring test oracles.

Jinhan Kim, Samuele Pasini, Paolo Tonella · 1 citation
#small language model Preprint Aug 2026

Query Expansion Is More Than Generation: Improving Dense Retrieval through Better Integration

This work introduces AnchorQE, a training-free method that separately encodes the original query and its expansion before interpolating them, and shows that AnchorQE improves retrieval effectiveness by up to 12.89% when compared to widely-used expansion-only or text-level concatenation baselines across TREC-DL, LoTTE, and BEIR.

Sixia Sun, Mihai Surdeanu · 0 citations
Conference Jul 2026

A Reproducible and Budget-Aware Framework for Evaluating Local Retrieval-Augmented Generation (RAG) Robustness to Perturbations

The idea of context is no longer considered secondary in the construction of language-model systems. With the use of local Retrieval-Augmented Generation, even a tiny modification of the prompt or the context might produce another set of retrievals, citations, and ultimately different answers; however, in practice, tests are often performed with only one version of the question. In this work, we suggest a local context-engineering framework for exploring perturbation robustness, reproducibility, and budgetfriendly assessment in one unified pipeline. Local RAG is built on several small teaching packs for the models; perturbations are introduced to the queries, each experiment is recorded in capsule format, and a gate mechanism based on the decision tree is used to judge if the whole perturbation suite can be skipped, minimized, or run. As a result, the augmented capsule-derived data set contains 3,570 perturbation rows, out of which 2,619 labeled rows are used for retraining. In this labeled subset, BLEU scores are available in 446 cases, answer perplexity and semanticjudgment scores are available in 1,668 cases, citation overlap is available for all rows, and retrieval overlap is available for 2,099 rows. The final decision tree obtains 0.915 ROC-AUC, 0.891 PR-AUC, 0.913 accuracy, 0.863 F1 score, and expected savings of 76.5% on the held-out augmented test split. A more conservative threshold setting lowers the stable-risk value from 0.084 to 0.062, while reducing expected savings to 57.4%. Thus, we provide a local study pipeline to examine the effect of perturbations on answer stability, contradictions, robustness, and budget-friendly evaluation.

Rahul Reddy Gangapuram, William B. Andreopoulos · 0 citations