Data-Efficient Adaptation of Multilingual LLMs to Ukrainian

Yurii Paniv Bohdan Didenko Mykola Haltiuk Vladyslav Humennyy Andrian Kravchenko R. Kyslyi V. Makovska A. Orlovskyi Bohdan Ruban M. Rudko Anastasiia Senyk Nazarii Drushchak Dmytro Chaplynskyi Mariana Romanyshyn

· 3 citations · 42 references

TL;DR

This work combines vocabulary surgery for tokenizer adaptation without full retraining, cross-lingual transfer of quality classifiers via translation, enabling filtering without target-language annotations, and generation of instruction data through translation, task conversion, and targeted synthesis.

Semantic Scholar

View source

Similar papers

#natural language process... Preprint Sep 2026

Sequential Adapter Stacking for Cross-Lingual Low-Resource ASR

This work investigates parameter-efficient approaches for transferring knowledge from resource-rich source languages to low-resource target languages on Whisper, and proposes Sequential Adapter Stacking, which places a trainable target-language adapter on top of a frozen source-language adapter.

Thai Thi Thanh Thao Dang, Meng-Jie Qian, Kate Knill · 1 citation

#natural language process... Preprint Sep 2026

To Each Language Its Tokenizer: Modular Tokenizers for Efficient Multilingual LLMs

Multilingual Large Language Models (LLMs) traditionally rely on a single vocabulary shared by all supported languages, which can lead to uneven compression across them. Moreover, their large embedding and output matrices increase memory usage and slow inference, notably for small-scale models. It is also wasteful as mo...

Franck Signe, Hippolyte Pilchen, François Yvon et al. · 0 citations

#natural language process... Preprint Sep 2026

RunyaNER: Auxiliary Language Selection for Runyankore NER

Cross-lingual zero-shot transfer and multilingual fine-tuning are promising approaches for NLP tasks such as Named Entity Recognition (NER) in low-resource languages, but in the absence of target language benchmarks, it is unclear which auxiliary language selection strategy leads to the best transfer. We introduce Runy...

Prosper Arineitwe Asiimwe, Francois Meyer, Jan Buys · 0 citations

#natural language process... Preprint Sep 2026

EuroAlpaca: Task-Preserving Localisation of Instruction Data for European Languages

Machine translation (MT) offers a scalable way to extend English instruction-tuning data to multiple languages, but it can distort task-critical constraints and required outputs, creating corrupted training examples and degrading models trained on such data. We introduce EuroAlpaca, a task-preserving localisation pipel...

Aleix Sant, Jordi Luque, Carlos Escolano · 0 citations

Preprint Aug 2026

LLMs Get Smarter from Targeted Synthetic Multilingual Data

HOTFIXR: Hardness Optimized Training data For Improving X-Lingual Reasoning is a data generation framework that uses models to probe and learn a student model's multilingual weaknesses, and generates data to mitigate them that can improve multilingual performance.

Ishika Agarwal, Arkajyoti Charaborty, Tanner Sorensen et al. · 0 citations

Open access Aug 2026

A Data-Efficient Multilingual Neural Machine Translation Model for Low-Resource Indic Languages

The effectiveness of multilingual transfer learning in low-resource settings is demonstrated by the fine-tuned Multilingual Bidirectional and Auto-Regressive Transformer-50 model, significantly outperforming the pretrained baseline.

G. Harshitha, Vasudeva, Nisha P. Poojary et al. · Engineering, Technology &amp... · 0 citations