Carbon- and Cost-Aware Scheduling of Cloud AI Inference Workloads Across Geo-Distributed Regions
Running artificial-intelligence inference in the cloud carries a rising energy and carbon cost, and where a request is served turns out to matter. Both the price of electricity and the carbon intensity of the local power grid differ from one region to another and change through the day. Most carbon-aware methods reduce...