Estimating Great Expectations Under Autoregressive Language Models with Potentials
This work shows how to improve estimation precision by exploiting next-token conditional probabilities available as a by-product of sampling by using potentials: real-valued functions of prefixes that induce an additive decomposition of the test functional.
F. Re, Shubhangi Ghosh, Tim Vieira et al.
· 0 citations