AvoKV-E: Payload-Aware KV Cache Eviction for Long Reasoning
Long-output reasoning shifts the KV-cache bottleneck from the fixed prompt to the generated trace. Existing reasoning-cache eviction methods largely treat cached entries as routing objects, estimating whether an old key will still be read, will recur, or can be replaced. This routing-only view overlooks two effects: lo...
Han Yu, Wen-Hui Zhu, Xi-Wen Chen et al.
· 0 citations