Escaping Rounding Barriers in Large Language Model Quantization via Transverse-Field Ising Optimization
Weight-only post-training quantization (PTQ) pipelines such as AWQ ultimately commit to a deterministic rounding decision for every scalar weight, and recent discrete coordinate-descent quantizers refine those decisions one weight at a time. We show that both are blocked by the same obstacle: correlated activation chan...
Anh Nguyen Duc, Linh Ngo Van, Sang Dinh Viet et al.
· 0 citations