Epoch: Compiling Diffusion Blocks for Sparse MoE Serving
A serving system that treats the diffusion block as a compilation unit that improves end-to-end execution time by up to 2.7 times over the strongest surviving baseline under the same 8-GPU placement and remains feasible at the largest batch sizes where multiple baselines run out of memory, while preserving task quality...