PEQuant: Prompt-Driven Activation Reconstruction for Elastic Quantization of Vision Transformers
Elastic precision quantization enables efficient multi-bit deployment through a single optimization process. However, extending it to Vision Transformers (ViTs) remains challenging due to high optimization costs and unstable activation distributions with extreme outliers, which severely disrupt multi-bit optimization....