Preprint
Jul 2026
Online Linear Programming for Multi-Objective Routing in LLM Serving
This work introduces a multi-objective optimization framework that formulates routing as an online linear programming with interpretable decision rewards and applies an efficient bid-price control policy based on the online linear programming that admits requests when their SLO-weighted benefit exceeds their shadow prices.
Zixi Chen, Yinyu Ye, Zijie Zhou
· 0 citations