Sasank Varma Sarpella

AI-Augmented Dynamic GPU Scheduling: A Trace-Based Workload Analysis and Conceptual Framework for Large-Scale Machine Learning Inference

Large-scale machine learning inference environments nowadays are evolving into clusters of non-uniform GPUs with different workload durations, computational needs and submission rates. The study does not test a GPU scheduling algorithm, but rather it performs workload analysis and runtime prediction based on workload t...