Skip to content
Preprint

BM25-Augmented Many-Shot Translation for Low-Resource North-Eastern Indian Languages

Aug 2026 · 0 citations · 38 references
Computer Science

TL;DR

The retrieval-augmented many-shot translation pipeline from the AmericasNLP 2026 system is adapted to translate between English and eleven North-Eastern Indian languages in both directions to solve the WMT26 Low-Resource Indic Language Translation shared task.

Abstract

This paper describes the University of Florida Gators submission to the WMT26 Low-Resource Indic Language Translation shared task. We adapt the retrieval-augmented many-shot translation pipeline from our AmericasNLP 2026 system to translate between English and eleven North-Eastern Indian languages in both directions. At inference time, BM25 retrieves the most similar parallel examples from a language-specific training bank, and Gemini 2.5 Flash translates the input conditioned on these examples. No model fine-tuning is involved. Training banks combine official WMT26 data with publicly available corpora such as Samanantar and prior WMT shared task releases. A grid search over retrieval count r and development exemplar count d across all 22 language-direction pairs selects the best configuration for each submission.

View source

Similar papers

Preprint Aug 2026

Embedding Initialization for Unseen Low-resource Languages in Multilingual NMT: A Case Study on Limbum-English Translation

The results show that multilingual transfer is the dominant factor in extremely low-resource Bantu translation while eliminating the need for heuristic proxy selection, and all systems fail to preserve tonal diacritics, highlighting an open challenge.

Samiratu Ntohsi, Neza David Tuyishimire, Anesu Kafesu et al. · 0 citations
Book Open access Jul 2026

Graph-Enhanced Sentence Retrieval for Multi-Document Summarization in Low-Resource Languages

Multi-document summarization for low-resource languages faces a critical trade-off: large language models are computationally prohibitive for most institutions, while smaller models suffer from severe hallucination in abstractive generation. We address this through extractive sentence retrieval, which guarantees faithfulness while operating within constrained computational budgets. Our approach combines language-adaptive mixture-of-experts embeddings with graph neural networks that model discourse structure, addressing linguistic challenges across typologically diverse low-resource languages. With only 3.2M trainable parameters, our model requires 28 times less training time than comparable transformer-based approaches, making it practical for single-GPU environments typical in resource-limited settings. We demonstrate applicability to some main Southeast Asia (SEA) countries including Vietnam, Thailand, Laos, Indonesia, and Malaysia, representing three distinct language families: Austroasiatic, Kra-Dai, and Austronesian.

Xuan-Hung Le, Thi Toan Do, Hoang-Quynh Le · 0 citations
Book Open access Jul 2026

Retrieval for User-Centered Translation: Lessons from RAG-based Tools for Low-Resource Domains

Machine translation for low-resource languages suffers from domain-imbalanced corpora, causing quality degradation on technical text. However, in-context learning opens the possibility to rely on limited in-domain corpora to inform translation. We present lessons learned from Tulun, a retrieval-augmented system combining neural MT with LLM post-editing, guided by user-configurable translation memories and glossaries. Deployed for medical translation in Timor-Leste (Tetun) and disaster relief translation in Vanuatu (Bislama), the system achieves accuracy improvements over baseline MT by 16.90-22.41 ChrF++ points, while offering rapid adaptability and transparency to end-users. Key recommendations include: domain granularity matters more than broad categories; translation target audience should inform retrieval; and RAG-augmented MT is most effective for languages that lack domain corpora but remain within LLM pretraining distributions.

Raphael Merx, Ekaterina Vylomova · 0 citations
Preprint Jul 2026

Translation as a Computationally Efficient Bridge: Feasibility of English BERT for Low-Resource Languages

Evaluating the feasibility of translation-based fine-tuning across six NLP tasks demonstrates that translation-based fine-tuning offers a scalable, resource-efficient, and empirically validated path for extending NLP to low-resource languages while advancing linguistic inclusivity and sustainability in artificial intelligence.

H. Muizelaar, Giulia Rivetti, Marco Spruit et al. · 0 citations
Open access Jul 2026

Transliteration for Low-Resource Translation in the Age of Large Language Models

Neural machine translation (NMT) systems are widely used, but their performance remains strongly dependent on the availability of large-scale digital corpora, making translation for low-resource languages a persistent challenge. In parallel, large language models (LLMs) have recently emerged as a promising paradigm for multilingual text generation and translation; however, their behavior in low-resource settings remains largely underexplored. The challenge becomes even more acute for historical languages. Chagatai, a historical Turkic literary language of Central Asia with no native speakers, unstable orthography, and parallel data, represents an extreme case of such a condition. This study investigates whether transliteration significantly affects translation performance and how LLM-based and NMT-based systems compare under an extremely low-resource setting. To address these questions, we evaluated four source-text configurations (original Arabic script, expert manual transliteration, LLM-based transliteration, and rule-based Uroman transliteration) for translation into six target languages: Kazakh, English, Uzbek, Uyghur, Turkish, Russian, and Arabic. The results show that manual transliteration consistently yields the best translation performance, while noisy automatic romanization reduces these gains. For model comparison, GPT-4o was assessed alongside two fine-tuned NMT baselines, NLLB and TranslateGemma. The findings further show that LLM-based translation can be competitive with, and in some settings outperform, fine-tuned NMT systems, although this advantage comes with lower interpretability. Overall, these findings show that, for extremely low-resource historical languages written in non-Latin scripts, source-side representation is a decisive factor and may be as important as the choice of translation model itself.

A. Mansurova, Meruert Bekmukhamedova, Bekarys Baibolat et al. · 0 citations
Preprint Aug 2026

Native Multilingual Chain-of-Thought Reasoning in Low-Resource Southeast Asian Languages

The Onramp-Sequence Cross-Distillation (OSCD) is introduced, a post-training algorithm that projects high-resource reasoning trajectories into low-resource vocabulary subspaces during generative training rollouts via an integrated translator agentic loop, ensuring the stable and efficient translation of dynamically generated reference samples for fine-tuning.

Sean Gip Lim, William-Chandra Tjhi, Hai Leong Chieu · 0 citations