Preprint
Aug 2026
OoO-Spec: Out-of-Order Semantic Speculation for Fast Tool Calling
OO-Spec is fastest among all evaluated methods in all 21 target-benchmark cells, and outperforms every evaluated released learned drafter in each comparable cell, while the same sidecar improves on ToolSpec by 34.1% on average.
Zhiheng Zhang, Mujie Xu, Fei Sun et al.
· 0 citations