Semantically Aligned KV Cache Compression for Efficient Agentic Autoregressive Video Generation
SemanticKV is the first KV cache compression method for agentic autoregressive video generation that explicitly uses planner-extracted semantic constraints to guide retention and achieves a 1.22x speedup over Full KV and reduces KV-cache memory from 6.04 GB to 1.81 GB, a 3.35x reduction.
Wei-Zhong Huang, Huai-Jia Kou, Tian-Yu Xie et al.
· 0 citations