When Safety Routing Breaks: Understanding Alignment Fragility under Benign Fine-Tuning
Overall, safety failure is best understood as a disruption of a low-rank output-routing mechanism, and it is shown that LoRA and ASAM mitigate early collapse by suppressing output-side sharpness, but their protection weakens at larger fine-tuning scales.
Yi-Tong Guo, Xiaoyi Chen, Si-Yuan Zhang et al.
· 0 citations