Using the modular spaCy Natural Language Processing framework to build part-of-speech taggers for Gaidhlig using the Annotated Reference Corpus of Scottish Gaelic, indicating that simple, off-the-shelf language processing pipelines can demonstrate good performance in low-resource and morphologically complex linguistic settings.
Abstract
Part-of-speech tagging for low-resource languages remains challenging due to limited annotated data, especially for linguistically complex languages. Gaidhlig (Scottish Gaelic) is a morphologically rich and endangered language with limited digital resources, making it suitable for examining a lightweight language processing approach. This paper describes using the modular spaCy Natural Language Processing framework to build part-of-speech taggers for Gaidhlig using the Annotated Reference Corpus of Scottish Gaelic. We train two models with minimal pre-processing and configuration: one using a fine-grained tagset and another using a reduced coarse-grained tagset. Both models are trained without external embeddings or pre-trained language models, using only supervised learning from the available corpus. The fine-grained model achieves 88.6% tagging accuracy, while the coarse-grained model achieves 93.7%. The results are comparable to those of the two previously published Gaidhlig taggers, indicating that simple, off-the-shelf language processing pipelines can demonstrate good performance in low-resource and morphologically complex linguistic settings.
The results of the experiments reveal that the proposed DistilBERT-based model outperforms the baseline Conditional Random Field and Bidirectional Long Short-Term Memory models with an accuracy 79.05%, precision 80.63%, recall 79.05% and F1-score 79.24%.
Maureen Otieno, L. Wanzare, Calvins Otieno· International Journal of Com...· 0 citations
Part-of-speech (POS) tagging in Arabic is hard because its rich root-and-pattern morphology and the absence of short vowels make one unvoweled string compatible with many categories. This paper presents Jawhar, a hybrid framework that couples a high-performance morphological analyser with contextual reranking using a p...
Mohamed Bouzahir, A. A. Abdelouahad, M. Nabil· Information· 0 citations
This study examines existing studies on PoS tagging of several Sino-Tibetan languages, explains the datasets and models used, and compares their stated performance, and discusses the limits of the prior approaches.
Bedawati Basumatary, Shikhar Kumar Sarma, Kuwali Talukdar et al.· Frontiers in Artificial Inte...· 0 citations
Comparing empirical cross-lingual transfer with typology-based similarity, it is found that transfer BLEU identifies closely interacting language pairs better than URIEL similarity, though neither predicts which varieties benefit from joint training.
Frank Lawrence Nii Adoquaye Acquaye, Eric George Parakal, Jesse Johnson et al.· 0 citations
This work introduces PERCEPT, the first publicly available large-scale Persian-English code-mixed corpus annotated with Universal Dependencies POS tags for code-mixed words, and conducts the first comprehensive linguistic analysis of Persian-English code-mixing across multiple social media platforms.
Ghazal Kalhor, Zahra Jafari, Amirarsalan Shahbazi et al.· 0 citations
The first machine translation study for the English and Pnar language pair is presented, establishing the first quantitative benchmark for this language pair and discussing future directions toward neural and multilingual machine translation for Pnar.