Benchmark-path fidelity in parallel robot-policy evaluation: a CALVIN case study
Evaluating long-horizon robot manipulation policies is a high-throughput computing workload: one CALVIN-style campaign sweeps checkpoints, seeds and task sequences across many concurrent simulator workers, consuming tens of thousands of rollouts before any score is inspected. Evaluation-path correctness is therefore a...