Skip to content

Author

Weihang Chen

We have 2 of 13 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Nov 2026

Nebula: Distributed Position-Independent Caching for LLM Serving

Modern LLM workflows, such as retrieval-augmented generation (RAG) and LLM agents, build long prompts from multiple independent text segments, making prefill a major source of computation. Reusing KV caches is therefore important for reducing serving costs and latency: distributed caching systems spread KV cache across...

Yi-Fei Liu, Jun-Bin Pan, Jun-Hao Hu et al. · 0 citations
Preprint Aug 2026

ExFold: Unified Expert Folding for Training-Free MoE Prefill-Decode Acceleration

ExFold is proposed, a unified training-free expert-folding framework for jointly accelerating MoE prefill and decode that calibrates a pairwise scalar-projector matrix on unlabeled data and uses it at inference time to fold excluded expert contributions into retained experts.

Jun-Tong Wu, Yi-Fei Liu, Jun-Yi Chen et al. · 2 citations · ⚡2

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.