LeapQuant: Efficient Linear Attention with Accurate Recurrent State Quantization
LeapQuant is proposed, a training-free method that achieves near-lossless performance under 8-bit recurrent-state quantization and substantially reduces memory and compute costs during inference.