Skip to content

1 paper indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Open access Nov 2026

Chat-Fusion: An Efficient Batch Inference System for Cloud LLMs Serving

Chat-Fusion is built, an efficient redundancy-free batch inference system that improves the throughput of popular LLMs by 1.4 times compared to other state-of-the-art inference systems, such as ORCA and vLLM.

Jin-Xin Yu, Lei Wang, Meng-Di Wang et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.