Preprint
Oct 2026
Rethinking KV Cache Eviction for Agentic LLM Serving
This work proposes preserving shared prefixes and evicting the KV cache from the beginning of the remaining history while retaining the cached suffix and builds Penelope around this strategy by co-designing the eviction policy, KV recomputation, and unified GPU-CPU cache management.
Jia-Kun Fan, Han Meng, Yu-Xin Xia et al.
· 0 citations