Preprint
Aug 2026
ShardMeter: Sharded and Geo-Distributed Training Without the Guesswork
ShardMeter is introduced, a lightweight analytical performance model that predicts the end-to-end runtime of transformer-based workloads across arbitrary sharded, distributed, and even decentralized training.
Tim Beringer, Patrick Diem, Felix Wolf et al.
· 0 citations