OrchBench: Evaluating Multi-Agent Orchestration Plans in Isolation via Deterministic Simulation
OrchBench is established as an efficient and interpretable benchmark for comparing and diagnosing multi-agent orchestration plans, finding that preserving task-critical information is more important than simply increasing the number of agents, and the benefits of parallelism diminish as coordination failures accumulate...