Beyond Retraining-Free MoE Compression: A Cost-Normalized Study of Post-Compression Adjustment
This work argues that retraining-free compression should be paired with small post-compression adjustment to recover a substantial portion of the performance lost during compression, and suggests that retraining-free compression should be paired with small post-compression adjustment to recover a substantial portion of...