2026· International Conference on Language Resources and Evaluation· pp. 10485-10496· 0 citations· 44 references
Computer Science
TL;DR
A resource-efficient adaptation of the English-pretrained ModernBERT for Arabic, employing continued pretraining on large Arabic corpora followed by lightweight head-only fine-tuning with a frozen encoder, demonstrating that modern English encoder architectures can be efficiently transferred to Arabic through language-adaptive pretraining.
This paper proposes a general optimization framework that combines a vocabulary pruning method with a targeted fine-tuning protocol for MNMT models, and reduces the vocabulary size from over 128,000 to approximately 10,000 tokens, enabling a 60% memory saving without any loss in performance.
A baseline morphological analyzer is built by evaluating a wider range of supervised systems, including lexicon-lookup, Conditional Random Fields (CRFs), full fine-tuning of Arabic PLMs, and AraT5 configurations, to demonstrate severe limitations in current capabilities.
The findings provide evidence that low-resource translation improves when neural learning is combined with linguistically informed and culturally aware processing, and offer a transferable foundation for future research on Indigenous language technology, language preservation and community-centred NLP.
Gabriela Salas-Cabrera, Aníbal Alejandro, Gallegos-Macías et al.· 0 citations
A bidirectional Mamba encoder pretrained via masked language modeling on a corpus combining Arabic Wikipedia and CulturaX text is introduced, trained end-to-end on four consumer-grade NVIDIA RTX 2080Ti GPUs (11GB) over approximately ten days.
An in-depth evaluation of instruction tuning for Arabic NLP tasks using three prominent LLMs: LLaMA 3.1-8B, AceGPT-v2-8B, and Qwen3-8B shows that instruction tuning consistently improves performance across most tasks, with notable variations in effectiveness across different tasks and prompts.
Maged Saeed Al-shaibani, Zaid Alyafeai, Irfan Ahmad· Language Resources and Evalu...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.