Large Language Models (LLMs) increasingly operate across culturally diverse settings, yet existing evaluations largely measure cultural behavior at the output level. We introduce CultureLens, a reference-grounded benchmark and mechanistic study of how LLMs use cultural information. CultureLens contains 9,261 scenarios...
Samee Arif, F. Danışman, Angana Borah et al.· 0 citations
It is argued that BBQ-style multiple-choice abstention benchmarks measure a single structural cue, and a model that solves them does not thereby become fair, and is called for evaluation suites that cover a broader spectrum of fairness alignment.
Nai-Hao Deng, Samee Arif, Shuai-Chen Chang et al.· Proceedings of the 2026 Conf...· 0 citations
KIDBench, a benchmark for evaluating child-facing LLM safety for ages 7-11 using a LLM-as-a-Judge rubric grounded in developmental-psychology, is introduced and KIDGuardLlama, a child-safety evaluator, and KIDLlama, a child-safe response model are introduced.
Samee Arif, Angana Borah, Rada Mihalcea· arXiv.org· 2 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.