Multiple latent orderings better predict language model preferences
It is shown that observed inconsistencies cannot be explained by a single ordering under any monotone link function, and a noise-augmented mixture Bradley-Terry model is introduced that infers latent preference components from repeated pairwise comparisons, suggesting that LLMs reflect plural preferences.
Aviral Chawla, William H. W. Thompson, Jean-Gabriel Young
· 0 citations