Zi-Zhong J. Wang

PuzzleKV: Page-Wise Low-Rank Decomposition for KV Cache Compression

P PuzzleKV is proposed, a training- and calibration-free method that treats each completed page as an independent compression unit that achieves more than 96% of Full KV performance across both evaluated models and all benchmark settings, with substantial gains over Global SVD on RULER and competitive performance on Lo...