CrystalLLM is presented to decouple large-scale execution from the need to access large clusters, enabling engineers to run and observe ranks of interest under faithful large-scale behavior using only a few GPUs.
Shao-Ke Xi, ChonLam Lao, Bo-Yi Jia et al.· Proceedings of the ACM SIGOP...· 0 citations
This paper presents our experiences in deploying YU, Alibaba’s in-house traffic load verification system for wide area networks (WAN), in data center networks (DCN). We encounter two key challenges: the opaque ISP challenge, where the opaque nature of the configurations of peering ISPs results in low accuracy of inter-...
Zijian Zhang, Yi-Fan Li, Xing Fang et al.· IEEE Transactions on Network...· 0 citations
This paper designs ACDC, a task-aware offline serving system that leverages inherent determinism and throughput orientation and designs a hybrid-serving mechanism that harvests these bubbles for offline tasks, improving end-to-end throughput by up to 35.7% over the state-of-the-art alternative.
Le-Ping Yang, Xue Li, Kun Qian et al.· Proceedings of the ACM SIGOP...· 0 citations
Vela is a predictive compiler that replaces the manual tuning loop with fast, automated analysis, using a novel, state-centric analytical model to estimate the throughput ceiling of any given resource allocation plan, complemented by a lightweight runtime that dynamically manages cache contents within the compiled memo...
Shao-Ke Xi, Jia-Qi Gao, Fu-Liang Li et al.· 0 citations
By embedding container addresses in the 128-bit IPv6 space, NetPila integrates the container network with the physical network, reducing packet-processing complexity and improving scalability.
Jiaqi Gao, Chao Qin, Sheng Cheng et al.· Conference on Applications,...· 0 citations
EPIC mitigates imbalance via performance-aware expert migration and runtime expert activation, and then improves communication with topology-adaptive transport kernels and fine-grained computation-communication overlap.
Jia-Min Cao, Qingxu Li, Yaozhong Liu et al.· Conference on Applications,...· 2 citations· ⚡1
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.