Author

Jin-Chun Gao

2 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#artificial intelligence Preprint Nov 2026

FlashOffloading: Low-Latency KV Cache Offloading for Long-Context LLM Serving

FlashOffloading is presented, a host-DRAM-centric inference architecture that fully offloads the KV cache in both the prefill and decode phases, optimizing KV offloading latency across the entire pipeline and delivering throughput gains under a time-per-output-token (TPOT) service-level objective (SLO).

Xuan Wang, Zhuan-Hao Wu, Ting-Zhu Fang et al. · 0 citations

Preprint Aug 2026

VPP: Virtual Pipeline Parallelism for Efficient Chunked Prefill in Long-Context LLM Inference

This study proposes Virtual Pipeline Parallelism (VPP), which keeps chunk sizes fixed and optimizes the pipeline layout through virtual stages, which improves throughput by up to 13.1% over DCPP on long sequences and 6.7% on mixed workloads, while preserving performance on short sequences.

Yan Shi, Xiao-Chao Wang, Jin-Chun Gao et al. · 1 citation