William H. W. Thompson

Multiple latent orderings better predict language model preferences

It is shown that observed inconsistencies cannot be explained by a single ordering under any monotone link function, and a noise-augmented mixture Bradley-Terry model is introduced that infers latent preference components from repeated pairwise comparisons, suggesting that LLMs reflect plural preferences.