Xuefeng Li

UMoE:Unlocking Every Expert in Domain-Specific Training

A simple, budget-preserving pipeline is proposed that realigns the expert pool to the target domain before fine-tuning, and turns this redundant capacity into useful domain capacity and achieves lower training loss, with gains spanning all difficulty levels in downstream evaluation.