EAServe: Encode-Aware Disaggregated Serving for Multimodal Large Language Models
EAServe repositions Encode as the control point of the EPD pipeline, exposing three tightly coupled dimensions: when work enters downstream, where prefill executes, and how the GPU is shared, and reaches near-optimal configurations faster than baseline search methods.
Kun-Xiong Zhu, Zhi-Hao Shu, Hang-Yu Zheng et al.
· 0 citations