SPECTRA: Pushing the KV Cache Beyond the 2-Bit Cliff via Spectral Transform Coding
SPECTRA is developed, a training-free, drop-in codec that re-encodes the cache into a coordinate system and concentrates the bit budget on the channels that carry the signal, pushing usable compression past the 2-bit cliff so the same GPU holds longer contexts and larger batches.