Ankit Kariryaa

ApexQuant: Data-Free Elastic Quantization by Residual Re-Isotropization

We introduce ApexQuant, a calibration-free quantization method that recursively re-quantizes the residual error, serving as a refinement layer on top of existing quantizers. We establish that a fresh random rotation returns each residual to the uniform distribution on the hypersphere, which characterizes the rate of pr...