Carbon-Aware Routing for Function Calling in Edge-Cloud LLM Systems
Large Language Models (LLMs) with function-calling capabilities are becoming critical for modern agentic AI systems. Nevertheless, current deployments typically route inferences to powerful cloud-based models, incurring significant energy use and carbon emissions. We address this sustainability challenge with a carbon-...
Aikaterini Maria Panteleaki, Varatheepan Paramanayakam, S. Tragoudas et al.
· 0 citations