Preprint
Sep 2026
Every Kernel Is a Join: Automatic Multi-GPU Parallelism for AI Computations in Einsummable
Distributing an AI computation across the GPUs of a multi-GPU server is one of the central problems in systems-for-AI. We present Einsummable, a prototype system that accepts a PyTorch-like description of an AI computation and automatically distributes it across a multi-GPU server, with no device assignments, sharding...
Zhi-Min Ding, Chen-Kuan Liao, Chima Adiole et al.
· 0 citations