Drift-Constrained Optimization: Only Direction Matters in Fine-Tuning Instruct Models
The results suggest that fine-tuning is not just about how much a model changes, but how that change is spent, and that changing the accessible directions can qualitatively alter the outcome of fine-tuning.
Fei Yuan, Changjiang Gao, Yi-Le Tu et al.
· 0 citations