Juan Diego Rodriguez

Improving LLMs via Validator-to-Generator Alignment

This work introduces a new formulation of G-V consistency that involves a principled correction for utterance frequency, and shows that under a natural model of rational agents answering questions with multiple answers, consistency of the validator with a frequency-corrected generator score emerges naturally.