The shared task is a shared task for evaluating hallucination detection and factual verification in Arabic question answering under challenging generalization settings, based on two Arabic datasets: HalluScore and HalluTruthQA.
Aisha Alansari, Abdessalam Bouchekif, A. Hasanaath et al.· 0 citations
Cardamom is presented, a micro-dialectal Arabic speech dataset designed to support fine-grained evaluation and adaptation of automatic speech recognition (ASR) systems, and the collection and annotation process is described, the micro-dialect inventory linguistically is motivated, and four multilingual ASR systems in z...
Bashar Talafha, Samar M. Magdy, Aisha Alansari et al.· 0 citations
Results show that out-of-domain generalization remains a major bottleneck and highlight the effectiveness of recent Arabic-specialized speech models, multimodal dialect identification approaches, and ensemble methods.
Peter Sullivan, Bashar Talafha, Ahmed Ashraf et al.· 2 citations
This paper presents the Mawqif-XT, consisting of 996 manually annotated Arabic tweets collected from three public targets: Women Driving, E-Cars, and Trimester System, which provides a benchmark for evaluating cross-target generalization in Arabic stance detection.
BUL, a multi-dialect Arabic ASR dataset collected from 275 speakers in 11 Arab countries, includes structured dialect and sub-dialect coverage, as well as recordings of classical Arabic and modern standard Arabic spoken by participants in their native dialectal accents to support accent-aware modeling.
Ahmed Ashraf, Aisha Alansari, Fadel Al Abbas et al.· 1 citation
CrossHallu is presented, the first study to evaluate the cross-lingual and cross-domain generalization of hallucination detection using internal representations from six LLMs on the generative question-answering task.
Aisha Alansari, Malak Alkhorasani, H. Luqman· arXiv.org· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.