ECOKV: Geometry-Aware KV Cache Eviction via Complementary Diversity Metrics
This work proposes a geometry-aware composite metric that jointly leverages Euclidean distance and cosine similarity to capture token diversity from complementary perspectives and uses these two metrics to estimate the redundancy level of each attention head, allowing adaptive weighting between diversity and importance...
Chin-Ting Hsu, Yu-Syuan Xu, Ling Zou et al.
· 0 citations