Alignment Collapse Under KV Cache Quantization: Diagnosis and Mitigation
Per-Channel Reduction (PCR) is proposed, a diagnostic that classifies each model into one of three mechanistic failure modes: outlier-crushes-safety, where safety lives in non-outlier channels collaterally damaged by outlier-driven scale factors; outlier-as-safety, where safety overlaps outlier channels and finer granu...