Skip to content
Book Open access

HAP: Efficient Quantization Harnessing Adaptive Precision for DNN Hardware Acceleration

Jul 2026 · Design Automation Conference · 0 citations · 24 references
Computer Science

TL;DR

A novel quantization and accelerator design harnessing adaptive-precision (HAP), leverages a per-group dynamic zero-point to generalize APQ and achieves superior accuracy compared with existing PTQ solutions at the level of 4 or 5 bits for a variety of DNN families.

Abstract

Post-training quantization (PTQ) avoids expensive training processes and is effective in accelerating deep neural networks (DNNs). Since the representation capacity of a quantizer decreases exponentially with precision, PTQ encounters fundamental limitations in the low-precision domain. As an alternative, adaptive-precision quantization (APQ) leverages the coding redundancy in binary representations to reduce precision without sacrificing resolution. This is especially suitable for activations, as they exhibit greater exploitable redundancy and lesser robustness than weights in PTQ. However, existing APQ approaches require data to heavily cluster near zero, which is not guaranteed in asymmetric quantization that is preferred for activations. Moreover, the precision variability in APQ leads to an unbalanced computational workload, making it difficult to effectively harvest the theoretical performance gain. To address these challenges, a novel quantization and accelerator design harnessing adaptive-precision (HAP), leverages a per-group dynamic zero-point to generalize APQ. Its intra-channel grouping strategy further enables balancing workloads through reordering. Leveraging a dual-precision vulnerable channel protection scheme for weights, it achieves superior accuracy compared with existing PTQ solutions at the level of 4 or 5 bits for a variety of DNN families. A novel bit-serial accelerator features a lightweight reorder engine, achieving a 2.65× speedup and a 55% energy reduction on average compared to existing designs.

Read PDF

Similar papers

#machine learning Preprint Oct 2026

Q-PACE: Dynamic Precision Allocation for Quantization-Aware Training

A new approach, called Q-PACE, consisting of a second-order sensitivity model that predicts the loss increase as a sum of quantization noise MSE weighted by per-layer curvature coefficients, and its stability during training allows for infrequent, cheap recalibration.

Alexandra Volkova, Matin Ansaripour, Erik Schultheis et al. · 0 citations
Preprint Aug 2026

SSDi8: Accurate and Efficient 8-bit Quantization for State Space Duality

SSDi8 is presented, the first post-training quantization framework specifically designed for SSD to maintain a persistent INT8 path, and introduces a reformulation that decouples element-wise multiplications from matrix multiplications, enabling reuse of quantized activations across modules.

Hyunwoo J. Kim, Byoungchan Ko, Minseok Kang et al. · 3 citations · ⚡1
#machine learning Preprint Oct 2026

TR-PTQ: High-Accuracy Integer-Only Transformer Post Training Quantization via Taylor Region Reformulation

TR-PTQ, a unified integer-only formulation using shared Taylor Region exponential and logarithm primitives, is introduced, which eliminates the need for floating-point hardware units for nonlinearities and achieves less than 1.5\% absolute accuracy degradation across vision and language benchmarks.

Eli S. Levy, Adam Teman, Yoni Pugachov · 0 citations
Preprint Aug 2026

APT: Accelerating Diffusion Transformers via Attention Probability-Guided Pruning and Quantization

APT, a software-hardware co-designed accelerator for high-resolution DiTs that leverages attention probabilities as a unified importance metric to jointly optimize computation through fine-grained pruning and adaptive precision scaling, and is evaluated on SOTA DiT models including PixArt, Stable Diffusion 3, and FLUX.

Sungyeob Yoo, Seeyeon Kim, Joonyong Park et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.