CommunityKV: Efficient Long-Context Decoding via Graph Partitioning
CommunityKV, a framework that formulates sparse attention as a community detection problem, is introduced, a framework that formulates sparse attention as a community detection problem and is evaluated on Qwen3 and Llama-3.1 models across three long-context benchmarks.
J. McKenna, Anastasios Alexandridis, Nathan Susanj et al.
· 0 citations