Zephon: Elastic Determinism for Online, Stateful Foundation Model Data Loading Pipelines
Zephon is presented, a data loader for foundation models that supports online, stateful pipelines while providing elastic determinism and efficient resumption from checkpoints and achieves competitive throughput while providing a combination of guarantees that no existing loader offers for online, stateful pipelines.
Maximilian Bother, Josh Wills, Ties Robroek et al.
· 0 citations