OCGQuant: Outlier-Companion Grouping for NVFP4 Quantization
OCGQuant is proposed, a post-training quantization method centered on Outlier-Companion Grouping (OCG), which adaptively pairs outlier channels with low-magnitude companion channels to improve NVFP4 activation block composition.
Yi-Shan Yao, Bin-Jun Li, Han-Ling Yi et al.
· 0 citations