Rong-Qian Zhang

PRIME: Frequency-Aware Unified Pruning and Merging for MoE Compression

Mixture-of-Experts (MoE) models have emerged as an effective paradigm for scaling large language models, yet their massive parameter footprint poses severe memory challenges for deployment. Existing compression methods typically treat expert pruning and merging as disjoint operations and rely on greedy heuristics, ofte...