Skip to content
Preprint

Coverage Is Not Redundancy: Maintenance Cost and Exposure of Query-Aware Admission Indexes in Vector Databases Under Workload Drift

Aug 2026 · 0 citations · 30 references
Computer Science

TL;DR

The law under real (COVID-19) workload drift is validated, the gate in PostgreSQL/pgvector at a 0.33% ingest tax is implemented, and the bound is turned into a provisioning rule that sizes the sentinel budget per emerging region.

Abstract

In a vector database serving production-scale retrieval, a single inserted document can be retrieved for an anomalously large share of the query workload -- a retrieval hub -- and dominate the evidence returned for an entire topic. An emerging defense guards against this at ingest with an admission check: it maintains a set of sentinel queries and admits a document only if its reverse-kNN count against them stays below a threshold tau. Under workload drift this sentinel set is a query-aware auxiliary index that must be maintained online, and we study the cost that maintenance imposes on the ingest path. We identify a structural limit -- coverage is not redundancy: a monitor stops promoting sentinels once a region is covered, but the predicate rejects a hub only once tau sentinels witness it, so exposure has an observation-limited floor that no reduction in update or enforcement latency can close. On real HNSW, IVF-Flat, and IVF-PQ indexes over an 8.8M-vector MS MARCO corpus this floor is only a best case: as index recall falls, exposure and churn rise above it, and below recall ~0.5 the gate stops containing altogether -- worst on the memory-compressed IVF-PQ used at billion scale -- while a recall-aware witness probe restores containment at a fixed O(|S|d) admission cost, under 0.1% of the ANN insert. We validate the law under real (COVID-19) workload drift, implement the gate in PostgreSQL/pgvector at a 0.33% ingest tax, and turn the bound into a provisioning rule that sizes the sentinel budget per emerging region. A count test contains the hub where retrieval-time score normalizers (NNN, QB-Norm) do not, and a pre-registered causal suite isolates the missing-coverage mechanism from retrieval fragmentation across two embedding families (BGE-1024, E5-768).

View source

Similar papers

Preprint Aug 2026

Coverage Is Not Containment: A Fundamental Limit of Admission-Time Defenses Against Coordinated Poisoning of Vector Retrieval

The one signal that separates an attack from legitimate niche ingestion -- a query's demand -- is invisible before retrieval, which is also the escape: a retrieval-time detector that observes demand catches 100% of the attacks at the same 1% false-positive rate.

P. Pathak, T. Sharma · 0 citations
Preprint Aug 2026

Which Eviction Policy Should an LLM Cache Use? A Systematic Study Across Workloads, Capacities, and Encoders

The cross-encoder study shows that thresholds do not transfer between embedding models, and LFU is the strongest simple default in this protocol; deployment decisions should first establish answer validity and then test sub-point policy differences with exact search.

Y. Kulkarni, Shubham Harkare, A. Babu · 0 citations
Preprint Sep 2026

ChurnBench: A Drift-Aware Benchmark Demonstrating That Refresh Scheduling, Not Cache Age, Governs Staleness in Agentic AI

ChurnBench is presented, an open-source benchmark that generates a four-source enterprise data fabric as a timeline rather than a snapshot, and it is found that when a system refreshes on a schedule, cache age does not predict staleness.

V. Singh, Preeti Priyam, Gautam Bhowmick · 0 citations
Open access Sep 2026

Implementation and experimental evaluation of mint for workload-aware approximate nearest neighbor index tuning in multi-vector databases

Approximate nearest neighbor (ANN) search is an integral part of contemporary vector databases; however, the performance of this algorithm highly depends on the specifics of data, recall requirements, storage capabilities, and query workload. All these factors complicate ANN even further in multi-vector databases, wher...

S. Salunkhe, K. Vayadande, H. Khandagale et al. · 0 citations
Conference Aug 2026

Assessing the Impact of CQRS Pattern Implementation on Query Latency in .NET Blazor CRUD Systems

Modern web applications are increasingly reliant on Object-Relational Mapper (ORM) frameworks to bridge the gap between high-level application logic and relational databases. However, in standard Create, Read, Update, and Delete (CRUD) architectures, the use of a unified data model often leads to significant performanc...

Justin Evan Surya, Kenny Jingga · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.