CacheRepair: Learning to Repair Cross-Chunk Context in RAG for KV Cache Fusion
This work introduces CacheRepair, a lightweight network that learns the difference between independently computed KV caches and those produced by processing the chunks together, and shows that repair reduces KV errors both near chunk boundaries and throughout chunk interiors.