COMED: The Missing Middle Between Routing and Collaboration in Multi-LLM Inference
No single Large Language Model (LLM) is uniformly reliable across queries, motivating multi-model inference systems that either route among models or combine their outputs. However, routing stops after selecting an initial model, while dense collaboration invokes peers on every query. We show that collaboration is non-...
Norah Alballa, Wen-Xuan Zhang, Salma Kharrat et al.
· 0 citations