Yu Yang

CRISP: Co-designing Pruning and Scheduling for Efficient MoE Inference on Edge Servers

Mixture-of-Experts (MoE) inference on memory-constrained edge platforms is often dominated by expert-weight movement rather than computation. Although each token activates only a small subset of experts, routing is input-dependent, so all experts must remain accessible and memory movement dominates latency. Existing ap...