GPTQ-style quantization damps the calibration Hessian by a fixed fraction of its mean diagonal (one percent in the GPTQ authors' code, five percent in a maintained implementation), a choice that ignores how many calibration rows there are. Small tabular, time-series and text-embedding foundation models can be calibrate...
Guan-Yuan Chen, Ya-Fen Yeh· Zenodo (CERN European Organi...· 0 citations
GPTQ-style quantization damps the calibration Hessian by a fixed fraction of its mean diagonal (one percent in the GPTQ authors' code, five percent in a maintained implementation), a choice that ignores how many calibration rows there are. Small tabular, time-series and text-embedding foundation models can be calibrate...
Guan-Yuan Chen, Ya-Fen Yeh· Zenodo (CERN European Organi...· 0 citations
GPTQ-style quantization damps the calibration Hessian by a fixed fraction of its mean diagonal (one percent in the GPTQ authors' code, five percent in a maintained implementation), a choice that ignores how many calibration rows there are. Small tabular, time-series and text-embedding foundation models can be calibrate...
Guan-Yuan Chen, Ya-Fen Yeh· Zenodo (CERN European Organi...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.