Sample, Mix, or Verify? Allocating Test-Time Compute under Imperfect Verifiers
A common way to make language models and agents more accurate is to spend more compute at inference time: generate many candidate solutions and submit the one a verifier prefers. Success then requires that some candidate is correct and that the verifier picks it. The first grows predictably with the number of samples;...