Beyond Routine Compliance: Cunning Data Cultivates Safety Vigilance in Large Language Models
Experiments show that Cunning training improves robustness to out-of-distribution jailbreak attacks and strengthens subsequent safety fine-tuning, and suggest that cunning data can strengthen model vigilance and complement conventional safety alignment.
You-Jia Wang, Lin Xu, Yang Sun et al.
· 0 citations