Modern AI backend services have evolved from single-turn prompt completion into complex workflows that interleave retrieval, task planning, external tool invocation, and multi-step generation. Existing caching mechanisms—KV-cache reuse, RAG document caching, and model cold-start reduction—optimise individual pipeline c...
Feng Wang, Mu-Zi Li, Feng-Jiao Sheng et al.· 2026 6th International Confe...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.