Preprint
Jul 2026
OmniPilot: An Uncertainty-Aware LLM Inference Advisor for Heterogeneous GPU Clusters
OmniPilot is a launch advisor that predicts serving costs for feasible configurations and abstains when requests fall outside its measured support envelope and ranks configurations using an economic utility metric calibrated to an operator's revealed preferences.
D. Balamurugan, Thomas W. Bush
· 0 citations