Ashish Khetan

MonoMoE: An Efficient Fused Mega-kernel for Quantized MoE Decoding

MonoMoE is a weight-major persistent megakernel for block-wise quantized MoE decode that supports multiple model shapes through generated kernel specializations and offline schedule tuning, integrated with vLLM and supports multiple model shapes through generated kernel specializations and offline schedule tuning.