Jul 2026· Fall Joint Computer Conference· pp. 81-88· 0 citations· 37 references
Abstract
The increasing use of renewable energy in data centers creates an opportunity to reduce the carbon footprint of energy-intensive LLM inference workloads. Unlike traditional stable power supply, renewable generation fluctuates over time, making it difficult to match computation demand with available energy. However, existing LLM serving systems primarily optimize latency and throughput without considering energy supply dynamics, leading to underutilization of renewable energy and unnecessary reliance on thermal power, and consequently, higher carbon emissions. We present GreenAlign, a renewable-aware scheduling framework that addresses this mismatch by treating best-effort (BE) requests as temporally shiftable load. GreenAlign enforces a power-constrained policy that executes BE requests using only residual renewable energy under normal conditions, and introduces a backlog risk metric to selectively relax this constraint when deadline violations are imminent. To ensure responsiveness, it maintains standby capacity to absorb unpredictable latencycritical (LC) bursts and uses lightweight length estimation to handle request uncertainty. Simulation results show that GreenAlign significantly reduces thermal energy usage while preserving LC latency and BE deadline satisfaction.
This work introduces a novel LLM-based predictive scheduling system designed to enhance operational efficiency while reducing the environmental impact of data centers, using an LLM to predict key metrics such as execution time and energy consumption from source code.
Hanzhao Wang, Jingxuan Wu, Yumeng Li et al.· 0 citations
RAPID is proposed, a region-aware and power-informed scheduling framework that integrates static and online heuristic schedulers for large-scale AI request scheduling that significantly reduces carbon emissions, electricity costs, and total energy consumption.
B. Ding, Cai-Ning Wang, Ka-Fei Tang et al.· Sustainability· 0 citations
CELLServe formalizes SLO-constrained joint resource provisioning as an optimization problem with a dedicated algorithm, and introduces an opportunistic instance merging strategy for decode phase functions to reclaim fragmented resources.
Ze-Jian Wang, Nan Lin, Zi-Nuo Cai et al.· ACM Transactions on Architec...· 0 citations
A new paradigm for satisfying the ever-growing demands of real-time Sixth Generation (6G) applications is Mobile Edge Computing (MEC). Additionally, base stations and Internet of Things devices that incorporate renewable energy harvesting capabilities have the potential to lower grid energy use. To maximize system pote...
Mamoon M. Saeed, Rashid A. Saeed, M. A. Ahmed et al.· 2026 6th International Confe...· 0 citations
PRISM, a prediction-guided runtime framework that jointly selects model variants and CPU allocations for containerized edge microservices, and adapts each pipeline stage in place and minimizes predicted CPU-package energy under deadline, resource, and offline model-level Quality of Result constraints is presented.
Uwe Gropengießer, Thomas Reuter, Dominik Schön et al.· 0 citations
This work proposes an adaptive resource allocation framework that leverages Digital Twins for real-time system monitoring and integrates Large Language Models to support context-aware decision-making under multi-objective constraints, enabling intelligent workload orchestration across heterogeneous data center environm...
Pedro Henrique Sachete Garcia, A. F. Lorenzon, M. Luizelli et al.· SN Computer Science· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.