GPUs are increasingly in demand for AI workloads, yet often remain substantially underutilized, motivating workload colocation. However, colocation introduces interference that can degrade latency-critical workloads. Existing approaches mitigate interference using either heuristic-based scheduling or interference predi...
F. Strati, Ethan Graham, Leo Stephan et al.· 0 citations
Zephon is presented, a data loader for foundation models that supports online, stateful pipelines while providing elastic determinism and efficient resumption from checkpoints and achieves competitive throughput while providing a combination of guarantees that no existing loader offers for online, stateful pipelines.
Maximilian Bother, Josh Wills, Ties Robroek et al.· 0 citations
OpenTela is presented, a user-space orchestration overlay that turns existing fragmented HPC clusters into a unified, cross-institutional serving platform and provides a replicable blueprint for other sovereign AI initiatives to harness their own federated GPU infrastructure.
Xiaozhe Yao, Youhe Jiang, Ilia Badanin et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.