QuranicMMLU: A Cognitively-Aware Benchmark for Evaluating Generative AI Solutions on Quranic Linguistic Knowledge
The QuranicMMLU offers a rigorous, linguistically grounded framework for evaluating Arabic NLP in the Quranic domain and benchmark 12 systems on these items find that the Islamic-specialized model leads, yet every system scores higher on multiple-choice accuracy than open-ended answer quality.