Breaking the Tie: A Cluster-Aware Routing Framework for Large Language Models
With the rapid development of artificial intelligence, the emergence of various Large Language Models (LLMs) has created a rich model ecosystem. However, this also brings a key challenge: how to select the optimal model for a specific user query. LLM routing addresses this need by dynamically assigning queries to the m...
Yao Lu, Zhai-Yuan Ji, Ya-Xin Gao et al.
· 0 citations