Zhao-Ning Zhang

Compression Does Not End at Selection: Post-Selection Positional Geometry for Sparse KV Caches

Sparse KV compression reduces long-context inference costs by retaining selected historical states, yet these states typically keep their coordinates from the full history. Under Rotary Position Embedding (RoPE), gaps left by evicted tokens continue to affect query-key matching, potentially limiting the use of retained...