Quantizing Looped Transformers: Feedback Exposure and Calibration Blindness
Accumulating the GPTQ Hessian across recurrence steps outperforms both one-step GPTQ and RTN on all nine checkpoints and recovers bf16-level accuracy on Huginn.
Nux Li
· 1 citation