Skip to content

When Does Reasoning Help in Machine Translation? A Hierarchical Analysis of LRM Reasoning Traces

Sep 2026 · 0 citations · 30 references
Computer Science

TL;DR

HMS is introduced, a scalable framework that induces coarse- and fine-grained reasoning structures without predefined taxonomies and reveals a shared organization--understanding/planning, translating/drafting, and refining/verifying--alongside domain-specific variation.

Abstract

Large Reasoning Models increasingly use intermediate traces for machine translation, but it remains unclear when such reasoning helps or hurts. We analyze reasoning traces across models, languages, domains, and datasets, focusing on reasoning language, length, and structure. We find that the best reasoning language is model-specific, reasoning length has a non-monotonic relationship with quality, and traces exhibit recurring functional patterns. To uncover these patterns, we introduce Hierarchical Meta-Summarization (HMS), a scalable framework that induces coarse- and fine-grained reasoning structures without predefined taxonomies. HMS reveals a shared organization--understanding/planning, translating/drafting, and refining/verifying--alongside domain-specific variation. Our results suggest that MT reasoning should be controlled in a model-aware, length-aware, and pattern-aware manner rather than uniformly encouraged.

View source

Similar papers

Preprint Aug 2026

Reasoning about In-Context Samples for Machine-Translation

A novel fragment-based reasoning framework is introduced in which the model first extracts parallel source-target fragments from retrieved similar exemplars, and uses these fragments as intermediate reasoning traces to produce the final translation.

Maxime Bouthors, J. Crego, François Yvon · 0 citations
Conference Aug 2026

Introspective Dynamic Strategy for Knowledge Graph Enhanced Reasoning in Large Language Models

Large Language Models (LLMs) achieve strong performance on many tasks, yet their reasoning can remain brittle and their decision process is often insufficiently transparent. Knowledge graphs (KGs) provide explicit entities and relations that can ground reasoning and improve traceability. However, most KG-augmented appr...

Jia-Jun Duan, Qiu-Ling Chen, Ze-Xu Wang et al. · 0 citations
#natural language process... Preprint Oct 2026

Investigating the Role of Reasoning-Language Alignment in Monolingual Retrieval-Augmented Generation

Reasoning traces improve large language models (LLMs), but current models are trained to reason mostly in English. It has been shown that forcing a model to reason in another language degrades accuracy, even when the reasoning language matches the language of the prompt -- but only for a setting where the model reasons...

Oliver Hauck, Mario Sanz-Guerrero, Katharina von der Wense · 0 citations
2026

Reasoning Graph-Structured Question Answering: Datasets and Insights from LLM Benchmarking

GRS-QA is introduced, a reasoning graph-structured question answering dataset that augments multi-hop QA instances from exisiting datasets, with directed reasoning graphs representing intermediate inference steps, and highlights the importance of unified structural annotations for understanding and improving multi-hop...

Khin S. Yone, Devasha Trivedi, Anish Pahilajani et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Which Language Should a Skeleton Speak? Language Choices in Multilingual Reasoning

Skeleton-based reasoning prompting is a promising training-free approach for structuring LLM reasoning, but prior work largely assumes an English-centric setting. We propose the Language-Aware Skeleton Exploration Framework (LASEF) to study skeleton-language choice in multilingual mathematical reasoning. Across math be...

HyeonSeok Lim, Seung-Woo Song, Inho Won et al. · 0 citations
#artificial intelligence Preprint Aug 2026

Beyond Surface Forms: Symbolic Edits as a Test for Logical Reasoning with LLMs

Logical reasoning with large language models (LLMs) is a critical capability, as it reflects a system's ability to correctly deduce hypotheses from a given context using faithful deductive processes. However, LLM reasoning has often been shown to be sensitive to small surface-level variations in problem formulation, ra...

Ramya Keerthy Thatikonda, W. Buntine, Ehsan Shareghi · 0 citations

Related blog posts

Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.