AFlex is a framework that jointly optimizes resource provisioning and GPU frequency scaling for disaggregated A/F serving and reduces energy per token by up to 49% over state-of-the-art disaggregated serving and 48% over frequency-scaling systems while satisfying TTFT and TPOT SLOs.
Cun-Chen Hu, Liangliang Xu, Tianyu Liu et al.· 0 citations
UVirtio introduces a device-profile-based virtual hardware abstraction layer that minimizes performance overhead, and implements a live migration mechanism using differential packing, providing a scalable and agile virtualization solution for the ubiquitous computing frontier.
Muliang Shou, Yufan Jiang, Tianlei Xiong et al.· ACM Transactions on Architec...· 0 citations
LEVELLER is proposed, the first communication scheduling system that achieves max-min fairness specifically for DLT workloads and introduces a novel online metric, normalized progress rate, which quantifies training experience by measuring actual progress against a contention-free ideal.
Geng Li, Yang Li, Mingyuan Zang et al.· Conference on Applications,...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.