FlexRouter: Learning Complementary Model Sets for Flexible LLM Routing
Existing Large Language Model (LLM) routing methods score LLMs independently to select top-$k$ models. However, this ignores model correlations and enforces a rigid computational budget. Consequently, routers often select redundant models that share failure modes, limiting the overall probability of success. To address...
Wang Wei, Harry Yang, Tiankai Yang et al.
· 1 citation