Book
Open access
Sep 2026
Congestion-Aware Serving of Agentic LLM Applications
CALM-MAS is proposed, a congestion-aware serving framework for LLM applications that treats LLM test-time computation as an elastic resource, dynamically adjusting the compute profile of admitted tasks to tame congestion.
Mouheb Ben Nasr, Muhammad Bilal, Alessandro Cornacchia et al.
· Proceedings of the 17th ACM... · 0 citations