E8-QAT: Efficient 2-Bit Quantization-Aware Training with Implicit Lattice Codebooks
Low-bit quantization reduces the memory footprint of large language models, but preserving accuracy with efficient training remains challenging. Scalar quantization encodes weights independently, while explicit-codebook vector quantization introduces costly search during training. We propose E8-QAT, a 2-bit quantizatio...
Xin-Yu Lei, Hong Huang, Jie-Bin Zhang et al.
· 0 citations