Preprint
Jul 2026
General Non-Clairvoyant KV-Cache Scheduling via Regime-Aware Routing
This work presents the first constant-competitive algorithm for arbitrary prompt lengths and arbitrary response lengths with no additional assumptions, built on a novel regime-aware routing framework.
Yiding Feng, Siyu Liu, Zonghan Yang et al.
· 1 citation