Skip to content

Author

Dongsoo Lee

1 paper indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

PrefillShare: A Shared Prefill Module for KV Reuse in Multi-LLM Disaggregated Serving

This work proposes PrefillShare, a novel algorithm that enables sharing the prefill stage across multiple fine-tuned models in a disaggregated setting and introduces a routing mechanism that enables effective prefill sharing in a vLLM-based disaggregated system.

Sunghyeon Woo, Hoseung Kim, S. Shim et al. · 3 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.