Skip to content
Log in
Sponsored AI Networking Cookbook: Practical recipes for AI-assisted network automation and development AI Networking Cookbook: Practical recipes for AI-assisted network automation and development

Author

Masahiro Tanaka

h-index 1 View on Semantic Scholar

We have 1 of 5 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Conference Jul 2026

Managing KV Cache for Coordinated Waiting and Execution Time in LLM Serving

Large Language Model (LLM) serving systems face a KV-cache (KVC) bottleneck. In this paper, our experimental study shows that block-based allocation increases Time-Between-Tokens (TBT) due to preemptions, while prediction-based allocation increases Time-to-First-Token (TTFT) and TBT due to allocated but unused KVC and...

Haiying Shen, Tanmoy Sen, Masahiro Tanaka · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.