Preprint
Oct 2026
TAO: Tool-Aware Joint Scheduling for LLM-Based Agentic Serving
TAO is presented, a tool-aware joint scheduling framework for LLM-based agentic serving that combines near-term tool readiness, node-specific cache credit with time-aware decay, and token footprint; a dynamic program jointly selects and places waiting sessions under capacity constraints.
Shu-Hua Li, Sheng-Dong Ye, Dong-Dong Ge et al.
· 1 citation