Trust the Mass: Forced Weights in KV-Cache Eviction
ContourKV, a training-free allocator built from the dropped-mass statistic, wins $93$ of $160$ paired comparisons against that state of the art and loses $22$ at the byte count of the budget-enforcing baselines, and it ties the strongest of them.
Jack Shi, Jerry Gu
· 0 citations