G. Davydenko

AdaMem: Adaptive Memory Token Allocation for Soft Compression in Retrieval-Augmented Generation

AdaMem is a relevance-guided soft-compression framework that maps learned passage-relevance estimates to a query-dependent allocation of a fixed memory-token budget and retains an efficiency profile comparable to the uniform-compression baseline, while achieving up to $4\times lower inference latency than full-context...