Does Execution Require Target KV Fidelity? A Mixed-Fidelity KV Runtime for LLM Serving
This work presents ElasticKV, a mixed-fidelity KV runtime built on the observation that target fidelity need not gate execution, and demonstrates the effectiveness and generality of ElasticKV across diverse workloads, model families and scales, and GPU platforms.