EAT: Expert Account Tracker for Efficient MoE Inference
EAT is proposed, a novel method called Expert Account Tracker (EAT), which utilizes history-awareness metrics and adaptive thresholding to dynamically select the most important experts, thereby reducing the activated expert number while effectively maintaining the model performance.