The GPU Resilience Lottery: Understanding and Taming Real-World Hardware Errors in Heterogeneous AI Infrastructure
The booming LLM demand is driving a rapid increase in the scale and heterogeneity of modern AI infrastructure. To achieve high availability for sustained LLM workloads, infrastructure providers must contend with frequent and severe hardware errors. Without a holistic resilience understanding, providers may inadvertentl...