ResCom: Activation Residual Compensation for Large Language Model Quantization
ResCom, a low-rank correction that uses the activation rounding residual to compensate for the resulting layer-output error, is proposed, a low-rank correction that uses the activation rounding residual to compensate for the resulting layer-output error.