LLM serving reuses cached key-value (KV) state to skip prefill, and growing contexts push that state past GPU HBM and CPU DRAM onto NVMe SSDs, placing prefix restore on the critical path of time-to-first-token (TTFT). We find that on a well-configured host-issued path the SSD is not the bottleneck: restoring the same 6...
Ding-Sen Shi, Jia-Hao Zhang, Li-Qiang Lv et al.· 0 citations
The Minimum Vertex Cover (MVC) problem is a fundamental NP-hard combinatorial optimization problem with applications in network analysis and resource allocation. Grover's algorithm provides a quadratic reduction in query complexity for unstructured search, but existing Grover-based MVC formulations can incur substantia...
Bei-Lei Jiang, Harry Fu, Pavan Krishna Yarlagadda et al.· 0 citations
Quantum computing is rapidly moving toward cloud-native, High-Performance Computing (HPC) models. However, current job submission systems rely on sequential, exclusive-use execution, causing severe resource under-utilization and excessive user wait times. This paper introduces QUDA (Quantum Unified Device Architecture)...
Alejandro Olvera, Harry Fu, Song Fu· 2026 International Conferenc...· 0 citations
KV-cache offload is widely used to stretch GPU memory for LLM serving, but its storage behavior has not been characterized at the block-device level. In this paper, we study LMCache through realworld multi-session workloads that span same/different context $\times$ same/different prompt, using over 100 stateless reques...
Ying He, Dingsen Shi, Yanbo Dai et al.· 2026 International Conferenc...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
