CoMerge: Conflict-Driven Preference Optimization for Multi-Task Model Merging
A conflict-driven preference optimization framework for model merging (CoMerge), which reformulates model merging as a preference optimization problem and utilizes a self-supervised, conflict-driven strategy that leverages the defects of naive merging methods as hard negative samples to construct preference pairs witho...
Ming-Jie Zheng, Zi-Hao Chen, Wen-Qing Chen et al.
· 0 citations