Kai Shen

How Fragile Is Safety Alignment at Frontier Scale? A Single-Direction Attack on a 320B MoE

Directional ablation removes an aligned language model's ability to refuse by projecting a single"refusal direction" out of the weights that write the residual stream, and whether it survives the shift to frontier mixture-of-experts (MoE) models whose residual streams are no longer a single tensor and whose weights shi...