Koushik Bhupathiraju

Energy-Efficient AI for Foundation Models: Algorithms, Hardware, and Data Center Infrastructure

Data centers consumed 415 TWh of electricity in 2024, about 1.5% of global demand, and foundation model training and inference are a growing part of this load. As training and inference continue to grow, energy-efficient foundation models are becoming essential. An efficiency gain may come from the model, the accelerat...