#artificial intelligence
Jun 2026
UrduMMLU: A Massive Multitask Benchmark for Urdu Language Understanding
Results on UrduMMLU show that current LLMs have uneven Urdu knowledge, particularly for content grounded in the regional context, and many models lose 25 to 40 points on Urdu-centered Humanities subjects compared with STEM.
Ahmer Tabassum, Sarfraz Ahmad, Hasan Iqbal et al.
· arXiv.org · 0 citations