Modern AI backend services have evolved from single-turn prompt completion into complex workflows that interleave retrieval, task planning, external tool invocation, and multi-step generation. Existing caching mechanisms—KV-cache reuse, RAG document caching, and model cold-start reduction—optimise individual pipeline c...
Feng Wang, Mu-Zi Li, Feng-Jiao Sheng et al.· 2026 6th International Confe...· 0 citations
SAGF (SLO-Aware Graph Forecasting), an integrated prediction-and-control framework for proactive autoscaling, encodes six per-service metrics on a spatio-temporal call graph, predicts per-service SLO risk via GCN with temporal gating, and feeds these scores to a constrained RL controller for dependency-aware scaling.
Kang Yang, Feng Wang, Ruili Jiang· 2026 8th International Confe...· 2 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.