#machine learning
Sep 2026
Mira: Memory-Efficient MoE Inference Using Adaptive Caching and Predictive Expert Staging
Mira is proposed, an algorithm-system co-design that enables high-capacity MoE inference on a single GPU by coupling predictive expert management with a tailored quantization format, and reduces expert-induced stalls.
Sanjali Yadav, Bahar Asgari
· arXiv.org · 0 citations