LLM Probability Concentration: How Alignment Shrinks the Generative Horizon
These findings establish BF as a diagnostic for understanding and controlling LLM outputs, clarifying how alignment reduces variability, CoT stabilizes generation, and base models can be steered away from diversity.
Chenghao Yang, Si-Da Li, Ari Holtzman
· 24 citations
· ⚡4