Preprint
Nov 2026
CacheWeave: Learning to Recompute for Efficient Position-Independent KV Caching
Position-independent caching reuses chunk KV caches across positions and requests. Independent encoding, however, omits cross-chunk interactions and can degrade accuracy. In our study, neither PIC training nor rule-based recomputation, alone or combined, consistently recovers full-prefill accuracy. Oracle-guided recomp...
Yue-Yang Pan, Qian-Chao Zhu, Yu-Liang Liu et al.
· 0 citations