Skip to content
Conference

A Comparative Benchmark of Specialized Deep Learning Architectures and Fine-Tuned LLMs for Arabic Text Readability

Jul 2026 · IEEE International Conference on Circuits and Systems for Communications · pp. 1-6 · 0 citations · 20 references

Abstract

Readability assessment for Arabic remains challenging due to the language's complex morphology. This paper presents a comparative study benchmarking traditional Machine Learning (ML), advanced Deep Learning (DL), and finetuned Large Language Models (LLMs). Utilizing a dataset of 4,519 Arabic sentences categorized into three proficiency levels, we evaluate models across accuracy and computational efficiency. Our results demonstrate that a hybrid CNN-BiLSTM architecture utilizing AraVec (Word2Vec) embeddings achieves a peak accuracy of 96.68%, outperforming fine-tuned LLMs like Llama3.2-1B (94.69%). We provide empirical evidence of the prohibitive resource demands in LLMs, which required significantly higher training times (14,697s) compared to specialized DL models (162.98). These findings suggest that for discrete Arabic text classification, tailored DL architectures provide a superior balance of precision and resource efficiency.

View source

Similar papers

Open access 2026

Arabic News Text Classification Using Deep Learning Models with Dynamic N-grams

This study integrates parallel multi-kernel word-level convolutional features into conventional and hybrid deep learning models for Arabic text analysis tasks, providing a systematic within-study assessment of model sensitivity to architecture, preprocessing, and learning-rate selection.

Ahmed I.Taloba, George Samy Rady, Khaled F. Hussain · 0 citations
Open access Aug 2026

An intelligent deep learning for Arabic stemming and morphological classification

A two-stage deep learning pipeline that combines Arabic text stemming and morphological classification within a single deep learning architecture is proposed that demonstrates a 38% improvement over the best traditional stemmer, P-Stemmer.

Azal Alaswaad, B. Minaei-Bidgoli · 0 citations
Aug 2026

STAR: instruction tuning for Arabic across tasks, datasets, and models

An in-depth evaluation of instruction tuning for Arabic NLP tasks using three prominent LLMs: LLaMA 3.1-8B, AceGPT-v2-8B, and Qwen3-8B shows that instruction tuning consistently improves performance across most tasks, with notable variations in effectiveness across different tasks and prompts.

Maged Saeed Al-shaibani, Zaid Alyafeai, Irfan Ahmad · 0 citations
Preprint Aug 2026

Efficient Multilingual Neural Machine Translation via Corpus-Driven Vocabulary Pruning: An English-Arabic Case Study

This paper proposes a general optimization framework that combines a vocabulary pruning method with a targeted fine-tuning protocol for MNMT models, and reduces the vocabulary size from over 128,000 to approximately 10,000 tokens, enabling a 60% memory saving without any loss in performance.

Ahmed Amine Aliane, N. Semmar, H. Aliane · 0 citations
Review Open access Aug 2026

Performance and Computational Cost of Full and Parameter-Efficient Fine Tuning for Arabic Sentiment Classification Across Training Set Sizes

Pre-trained language models are typically adapted to downstream tasks via full fine tuning. However, this entails substantial computational and memory overhead. Parameter-efficient alternatives such as Low-Rank Adaptation (LoRA), Quantized Low-Rank Adaptation (QLoRA), and frozen backbone mitigate these costs, but empirical evidence on how their performance–cost trade-offs change under low labeled data in Arabic remains limited. This paper compares four adaptation strategies: full fine tuning, frozen backbone, LoRA, and QLoRA for Arabic binary sentiment classification on the Hotel Arabic Reviews Dataset, using CAMeLBERT-Mix as the pre-trained encoder. The methods are evaluated under a unified experimental setting at three labeled-data levels: the full training set, 100 samples per class, and 25 samples per class. The evaluation metrics are reported as means and standard deviations across five random seeds. At the full-data level, full fine tuning, LoRA, and QLoRA achieve macro-F1 scores between 0.9569 and 0.9579 and are comparable within seed variability, while the frozen backbone exhibits performance that is approximately ten points lower. LoRA and QLoRA use approximately 35.0% less peak GPU memory than full fine tuning but require longer training times. Under reduced-data conditions, full fine tuning outperforms all other adaptation strategies with the differences being statically significant.

Teif Aldaajani, Morooj Alqurashi, Sarah Aljuaid et al. · 0 citations