Luka Kričković

CASQ: Configuration-Aware Sensitivity for Mixed-Precision Quantization of Vision Transformers

Deploying vision-transformer backbones on edge devices requires low-bit quantization, and mixed-precision methods must assign each layer a bit-width under a memory budget. Allocation is usually driven by per-layer sensitivity estimated from loss curvature (Hessian traces), following HAWQ. We propose CASQ (Configuration...