KV-COBRA: KV Cache Compression via Co-Optimized Bit-Rank Allocation
KV-COBRA (Co-Optimized Bit-Rank Allocation) shows the smallest accuracy degradation among evaluated methods at low bpd, with no per-token overhead.
S. Ha, Jaeho Lee, Yo-Seb Jeon
· 0 citations