CacheGraft: Enhancing Retrieval-Augmented Generation via Latent-Space Document Enrichment
Recent work in machine learning has demonstrated that transformer-based language model agents can communicate state not only through text, but also directly in latent space via key-value (KV) caches. In this paper, we argue that such cache-to-cache translation can provide utility beyond the original motivating applicat...