DataRx: Missingness-Aware Sampling for Safer Large Language Model Task-Specific Fine-Tuning
This paper proposes DataRx, a missingness-aware sampling method for selecting safety-critical examples based on the hypothesis that a safety sample is more effective when the selected examples provide safety signals that fill the missing parts of LLMs'safety capabilities.