The rapidly growing demand for distributed training has motivated providers to deploy large-scale GPU clusters. As a provider, we manage multiple clusters that hosts numerous distributed model training jobs that generate voluminous, highly dynamic concurrent flows. These flows may traverse the same link, causing severe...
Jian-Feng Bao, Wen-Peng Zhu, Gong-Ming Zhao et al.· IEEE Transactions on Network...· 0 citations
HOCCCL, a zero-SM collective communication framework consisting of three components: a stream manager, a point-to-point (P2P) executor, and a collective scheduler, which improves end-to-end training throughput by up to 5%.
Yao Fei, Gong-Ming Zhao, Hong-Li Xu et al.· arXiv.org· 0 citations
VarioPath, an efficient AlltoAllv scheduling framework for PCIe GPU systems that combines an offline topology-aware analyzer with an online demand-aware scheduler, and shows average AlltoAllv speedups of 5.88x over FAST and 1.72x over DeepEP.
Yao Fei, Jin Fang, Si-Ze Zheng et al.· arXiv.org· 0 citations
A GPU-native, topology-aware load-balancing system for large-scale MoE training that converts the current routing result into hot-expert replication and token-rerouting decisions and executes the resulting plan without data-dependent host synchronization, reducing critical-path overhead.
Regarding the computational intensity and stringent latency requirements of modern applications comprised of many dependent subtasks, collaborative edge computing (CEC) emerges as a solution to guarantee the service-level objectives (SLOs) by offloading subtasks to multiple distributed edge servers. However, existing o...
Zi-Xuan He, Yan-Jing Sun, Zhen-Guo Ma et al.· IEEE Transactions on Mobile...· 0 citations
Hestia is proposed, a framework that achieves long-term stable oversubscription through workload aggregation through a smoothing-based method to classify workloads suitable for aggregation according to their periodicity, and an aggregation algorithm to minimize the overall MCV.
Baoqing Wang, Gongming Zhao, Hongli Xu et al.· Conference on Applications,...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.