Preprint
Jul 2026
Fine-grained Computation-Communication Overlap via Tile-level Signaling and Scheduling for Mixture-of-Experts
This work presents a fine-grained approach that overlaps expert compute with the second all-to-all via tile-level signaling and scheduling, making it practical for improving distributed MoE execution efficiency on multi-GPU systems.
Minyu Cui, Anna Wingkvist, Morgan Ericsson
· 1 citation