Author

Qian-Chao Zhu

2 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Nov 2026

CacheWeave: Learning to Recompute for Efficient Position-Independent KV Caching

Position-independent caching reuses chunk KV caches across positions and requests. Independent encoding, however, omits cross-chunk interactions and can degrade accuracy. In our study, neither PIC training nor rule-based recomputation, alone or combined, consistently recovers full-prefill accuracy. Oracle-guided recomp...

Yue-Yang Pan, Qian-Chao Zhu, Yu-Liang Liu et al. · 0 citations

Preprint Oct 2026

FlatCake: A Flat KVCache Storage Architecture for LLM Serving

KV cache reuse accelerates LLM serving, but existing systems manage host DRAM and NVMe SSD as a tiered hierarchy where DRAM acts as an intermediate cache. Production LLM workloads break both premises of this hierarchy. First, bimodal reuse defeats DRAM temporal filtering, since workloads are dominated either by one-sho...

Xin Huang, Teng Ma, Zhuo-Ran Li et al. · 0 citations