Compute-optimal data scaling for neural surrogates via multi-fidelity training
It is shown that multi-fidelity training enables Pareto-optimal error scaling against data generation compute, and training on the optimal fidelity mixture matches the accuracy of high-fidelity-only training, with up to $6.3\times less data generation compute across the authors' settings.