REVA: Reusable Evidence View Aggregation for Context-Efficient RAG Serving
Retrieval-augmented generation (RAG) improves knowledge-intensive large language model (LLM) applications by conditioning generation on retrieved documents, but longer contexts increase latency, key-value (KV) cache memory, and token cost. Post-retrieval compression can reduce this cost, yet existing compressors often...
T. Nguyen, Qi-Ran Hu, Ban-Ruo Liu et al.
· 0 citations