WorldVIEW, a multilingual benchmark of 8,960 prompts across 15 languages and 31 language-context pairings, is introduced, and the revision layer itself is identified as a previously undocumented, causal source of this stereotyping.
Aleksandra Urman, Elsa Lichtenegger, Salima Jaoua et al.· 1 citation
This work audits ChatGPT, Claude, and Gemini across seven systems and nine benchmarks spanning general capability, social bias, and sycophancy, finding systematic API--interface differences in both accuracy and consistency.
Jennifer Wang, Joachim Baumann, Daniel E. Ho et al.· 0 citations
This work introduces Pluralis v0.1, a novel multimodal, multi-regional, and multilingual dataset built from a culture-first perspective and calls upon the research community to utilize this foundation to advance the science of multilingual, multicultural evaluation to better support AI cultural alignment globally.
Alicia Parrish, Rajat C. Shinde, Sanket Badhe et al.· arXiv.org· 0 citations
This work introduces WildSEEK, a manually annotated dataset of 3k information-seeking queries from real user interactions, and an evaluation framework for LLM-generated responses, and finds that over a third of information-seeking queries are high-risk and more often analytical.
Tanise Ceron, Joachim Baumann, Elisa Bassignana et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.