Vin Bhaskara

From token probabilities to calibrated confidence: An empirical study of mathematical question answering

This work compares single-pass estimators, which reuse token probabilities from the original generation, with multi-pass estimators, which obtain additional confidence signals through verification or stochastic forward passes, and finds that aggregating token probabilities over the full sequence captures small but cons...