Dynamic Expert Pruning for Multi-Agent Systems
Across diverse tasks and roles, model scales, and MoE architectures, DEP achieves better overall accuracy than static pruning and merging baselines, and generalizes to workflows unseen in training without retraining.
Jabin Koo, Soheil Abbasloo, Sungjae Lee et al.
· 0 citations