Conference
Open access
Sep 2026
M-LoRA: Efficient Serving for Concurrent LoRA Adapters with Memory-Aware Speculative Scheduler on Single GPU
M-LoRA is proposed, a memory-aware multi-LoRA serving system that reduces queuing delay and improves throughput through efficient request scheduling guided by fine-grained memory modeling.
Shaolong Li, Xiang Yang, Qi Qi et al.
· Proceedings of the Thirty-Fi... · 0 citations