CoordSpec: Coordinating Edge Drafting and Cloud Verification for Efficient Speculative Decoding
This work presents CoordSpec, a framework that coordinates cloud verification scheduling with adaptive draft length selection, and presents the system design and an evaluation plan under varying task loads and network conditions.
Dongkyun Ryoo, Jihoon Lim, Daesik Kim et al.
· Proceedings of the ACM CoNEX... · 0 citations