Skip to content

GLF-Q: Global-Local Feature-based Quantization for Vision Transformers

Sep 2026 · arXiv.org · Vol abs/2609.34564 · 0 citations · 38 references
Computer Science

TL;DR

Extensive experiments across representative ViT architectures demonstrate that GLF-Q with standard uniform quantizers substantially outperforms state-of-the-art methods under 3-bit quantization on image classification and exhibits strong out-of-domain calibration robustness and achieves speedups under 8-bit GPU deployment.

Abstract

Post-training quantization (PTQ) efficiently compresses Vision Transformers (ViTs) without retraining, yet suffers severe accuracy degradation at low bit-widths. Existing optimization-based PTQ methods guide block reconstruction via either soft logits or second-order Hessian proxies. Logit supervision is prone to overfitting on limited calibration data, while Hessian approximations incur structural truncation errors. To address these limitations, we propose \textbf{GLF-Q}, a novel PTQ framework guided by Global-Local Feature alignment. GLF-Q propagates quantized block outputs through downstream full-precision layers to align penultimate-layer representations under local output regularization, providing downstream feature supervision without explicitly approximating the Hessian or using a Taylor expansion. Furthermore, offline Hadamard transformations are introduced with zero runtime overhead to disperse activation outliers across channels, effectively contracting dynamic ranges and reducing quantization errors. Meanwhile, optimizing this loss via a Straight-Through Estimator (STE) achieves rapid convergence, bypassing continuous relaxation rounding formulations such as AdaRound. Extensive experiments across representative ViT architectures demonstrate that GLF-Q with standard uniform quantizers substantially outperforms state-of-the-art methods under 3-bit quantization on image classification. In addition, GLF-Q exhibits strong out-of-domain calibration robustness and achieves speedups under 8-bit GPU deployment.

View source

Similar papers

#machine learning Preprint Oct 2026

TR-PTQ: High-Accuracy Integer-Only Transformer Post Training Quantization via Taylor Region Reformulation

TR-PTQ, a unified integer-only formulation using shared Taylor Region exponential and logarithm primitives, is introduced, which eliminates the need for floating-point hardware units for nonlinearities and achieves less than 1.5\% absolute accuracy degradation across vision and language benchmarks.

Eli S. Levy, Adam Teman, Yoni Pugachov · 0 citations
Book Open access Nov 2026

PEQuant: Prompt-Driven Activation Reconstruction for Elastic Quantization of Vision Transformers

Elastic precision quantization enables efficient multi-bit deployment through a single optimization process. However, extending it to Vision Transformers (ViTs) remains challenging due to high optimization costs and unstable activation distributions with extreme outliers, which severely disrupt multi-bit optimization....

Ke Xu, Tian-Yu Ma, Xiao-Zheng Shen et al. · 0 citations

G2PTQ: Improving LLM Post-Training Quantization with Generalized Gradient Compensation

G$^2$PTQ is presented, a unified PTQ framework with Generalized Gradient Compensation that integrates both first- and second-order information under a globally supervised, block-wise optimization objective and enables better alignment with the full-precision model, outperforming state-of-the-art baselines.

Rui-Kang Liu, Hao-Li Bai, Yuxuan Sun et al. · 0 citations
Preprint Nov 2026

SPA-Q: Structure-Preserving Adaptive Post-Training Quantization for Monocular Depth Estimation

Monocular depth estimation (MDE) has advanced rapidly with the emergence of foundation models such as Depth Anything. Their transformer-based architectures provide strong generalization across diverse scenes and domains, but also incur high computational and memory cost, making efficient deployment challenging. Post-Tr...

J. Choi, Jincheol Yang, Nahyun Lim et al. · 0 citations
#artificial intelligence Preprint Oct 2026

A Unified Hessian-Guided Framework for Post-Training Quantization

Low-bit quantization enables efficient deployment of large language models by reducing memory footprint and computational cost. Achieving high accuracy at low precision requires selecting quantization ranges, linear transformations, and weight rounding decisions. Existing approaches typically optimize these components...

M. Toftrup, Marco Federici, Boris van Breugel et al. · 0 citations

Beyond Reconstruction Loss in Post-Training Quantization: Balanced Fitting for Large Vision-Language Models

Experiments on multiple LVLMs show that the Balanced Fitting method consistently outperforms prior PTQ approaches under both weight-only and weight-activation quantization, while lower reconstruction loss does not reliably translate into better downstream performance.

Min-Chan Kang, Kyeonghye Park, Seungyeon Sa et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.