Preprint
Aug 2026
LangChoiceBench: Measuring and Explaining Programming-Language Choice in LLMs
LangChoiceBench is introduced, a project-level code-generation benchmark for measuring Python preference, recommendation-implementation consistency, and language diversity, and it is found that Python remains heavily over-selected, recommendation-implementation consistency is low, and smaller open-weight models generally show stronger Python preference and lower language diversity.
Lukas Twist, Twm Stone, Helen Yannakoudakis et al.
· 0 citations