Skip to content

Author

Wenyuan Yu

4 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Book Open access Sep 2026

Batched in Back: Characterizing and Optimizing Offline LLM Inference in Production with ACDC

This paper designs ACDC, a task-aware offline serving system that leverages inherent determinism and throughput orientation and designs a hybrid-serving mechanism that harvests these bubbles for offline tasks, improving end-to-end throughput by up to 35.7% over the state-of-the-art alternative.

Le-Ping Yang, Xue Li, Kun Qian et al. · 0 citations
#natural language process... Preprint Sep 2026

When Parallel Drafter Meets Parallel Speculative Decoding

DPara is a PSD framework that reuses effective parallel drafters yet guarantees backbone--verification overlap in every round, thereby eliminating this probabilistic fallback altogether and surpassing the strongest serial and parallel speculative decoding baselines alike.

Fu-Liang Liu, Xue Li, Kun Qian et al. · 1 citation
#machine learning Preprint Mar 2026

Efficient K-generalizable Learned Search

This paper shows that learned search can support arbitrary K with the preprocessing cost of a single top-1 model, and reduces total serving and preprocessing computation by up to 28%.

Yifan Peng, Jia-Fei Fan, Xing-Da Wei et al. · 0 citations
Jul 2026

SMetric: Rethink LLM Scheduling for Serving Agents with Balanced Session-centric Scheduling

SMetric addresses session-centric scheduling with differential scheduling based on two indicators derived from the request itself, the session turn and the local KV\$ hit: it schedules first-turn requests for load balance, and sticks follow-ups to the instance with the highest local hit for high KV\$ reuse.

Jiahao Wang, Kai-Zhan Lin, Kaixin Zhang et al. · 1 citation

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.