Preprint
Jul 2026
DeltaServe: Host-Agnostic Co-Serving of Inference and Fine-Tuning for LLMs
DeltaServe is presented, a host-agnostic co-serving design that converts this idle inference capacity into LoRA fine-tuning throughput while preserving inference service-level objectives (SLOs).
Jiaxuan Chen, Jianshu She, Ye Yuan et al.
· 0 citations