VertiKV: Vertical-Integrity KV Cache Compression for Efficient Multimodal Long-Context Inference
As multimodal large language models (MLLMs) are increasingly applied in scenarios with long textual contexts and high-resolution images, KV cache memory footprint during inference has grown substantially. To optimize inference efficiency, existing compression methods mostly rely on scoring-based strategies, which estim...