Yu-Syuan Xu

ECOKV: Geometry-Aware KV Cache Eviction via Complementary Diversity Metrics

This work proposes a geometry-aware composite metric that jointly leverages Euclidean distance and cosine similarity to capture token diversity from complementary perspectives and uses these two metrics to estimate the redundancy level of each attention head, allowing adaptive weighting between diversity and importance...