Author

Jun Zhang

1 paper indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Aug 2026

TailSieve: Partial-Rollout-Guided Tail Routing for LLM Rollouts

TailSieve, a partial-rollout-guided framework that jointly controls tail routing and replica allocation for LLM rollouts, and shows that makespan-optimal routing in the long-tail regime combines tail isolation with load balancing, and that a simple top-k policy closely approximates this offline optimum.

Tianqi Xu, Lu Lv, Hao-Yang Huang et al. · 3 citations · ⚡1