Neuron-Guided Fine-Tuning: Unlocking Efficient Alignment Mechanisms for Large Language Models
Existing Supervised Fine-Tuning paradigms, particularly Full Parameter Fine-Tuning are often plagued by parameter redundancy, inconsistent data quality, and catastrophic forgetting, which current methods typically address in isolation and lack a unified optimization signal to bridge data selection, parameter updates, a...
Ze-Yu Wu, Junchao Wu, Shu-Dong Liu et al.
· 0 citations