Skip to content

Category

natural language processing

9,568 papers

#artificial intelligence Preprint Open access Oct 2026

Integrating Heterogeneous Echocardiography AI Outputs in Language Space: Learnable Late Fusion with a Supervised LLM

View- and target-specific echocardiography AI models capture useful but complementary information and may not achieve sufficient predictive performance in isolation. A learned ensemble is a natural way to combine these outputs, but heterogeneous models typically require each output to be converted into a binary decisio...

Ryo Takizawa, Tempei Kabayama, Chiemi Yamazaki et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Well-Specified and Well-Tested? Assessing SWE-bench-Style Datasets with a Self-Evolving Agent

ExLabel is proposed, an LLM-based, self-evolving, experience-guided assistant for task clarity and test coverage assessment in SWE datasets that maintains an evolving experience bank that distills cross-instance knowledge into stable yet adaptive judgment criteria and reuses relevant experience to guide the assessment...

Zhong-Hao Jiang, Xu-Yang Zheng, Yan-Fu Yan et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

What Makes Medical Examination Items Difficult? Using Large Language Models to Explore Patterns Associated With Empirical Item Difficulty

Research on medical item difficulty has largely focused on prediction rather than on identifying interpretable patterns associated with empirical difficulty. This study used empirical difficulty labels to guide large language models (LLMs) in inducing difficulty rubrics and examined how rubric guidance affected LLM dif...

Xiaomeng Xiong, Marcus Walker, Yanlin Jiang · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Cord: Confidence-Anchored Order Residual Decoding for Masked Diffusion Language Models

The decoding order of masked diffusion language models (dLLMs) can substantially affect generation quality, yet common decoders typically apply the same reveal rule throughout generation. Confidence provides a strong default, but it measures how decisively a position can be predicted now, not how useful revealing that...

Chengwei Zhou, Zhaoyan Jia, Massoud Pedram et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Distilling the Shape of Uncertainty: What On-Policy Distillation Learns and How to Predict It

On-policy distillation (OPD) is increasingly adopted in the post-training of large language models. However, a stronger teacher may fail to improve the student. Prior work attributes this to a lack of new knowledge, but what that knowledge is remains unclear. We show that OPD learns not only \textit{how to branch}, i.e...

Shiping Yang, Chuanqi Tang, Hossein Hajimirsadeghi et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Implicit Reasoning in Transformers: Bridging the Compositionality Gap in GPT-2-like Models

Compositional generalization remains a persistent limitation of transformer language models: even when a model learns to combine known facts correctly in-distribution (ID), the same compositional mechanism may fail when applied to out-of-distribution (OOD) knowledge. We investigate this compositionality gap in a contro...

Davide Venuto, Leonardo Venuto · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Interventional Training Reduces Causal Bypass in In-Context Introspection

Introspection, the ability of a system to access and reason about its internal signals, is crucial for language model (LM) self-consistency and scalable interpretability. Prior work argues that LMs possess introspective capabilities, and that training (SFT) could enhance such behavior. However, most setups leave open t...

Zilu Tang, Jongin Kim, Kerem Sahin et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

CopyLoop: Fast Looped Transformer Decoding via Context Copying and Shallow Screening

Looped Transformers increase computational capacity through the repeated application of shared blocks, but their recurrent depth makes conventional full-depth decoding expensive. While existing speculative pipelines accelerate generation by processing consecutive token positions at varying depths, they are typically li...

Wenyu Du, Stephen Chung · 0 citations
#artificial intelligence Preprint Oct 2026

AtomTree: A Hierarchical Framework for State-Aware Embodied Instruction Following with LLMs

AtomTree is presented, a hierarchical framework for state-aware task planning with LLMs that incrementally builds a tree of subgoals and actions, where the LLM decides at each step, from the current symbolic state, whether to further decompose or to output a grounded low-level action.

Hao-Tian Zhai, Tian-Ming Sha, Jun-Nan Li · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Learning Scientific Trajectories to Predict Future Biomedical Discoveries

AI co-scientists have expanded the use of large language models for generating scientific hypotheses and guiding experimental investigation. Here we investigate whether temporal patterns in the semantic representations of complete biomedical conclusions can guide hypothesis generation. We introduce ForeSCITE, a framewo...

Chia-Hsuan Chang, Brian Ondov, Jiang Lv et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Do Audio LLMs HEAR Pain? Tracing Acoustic Evidence from Speech to Language Reasoning

Large audio language models (LALMs) can process speech directly, but it remains unclear how well they use the non-lexical acoustic information that speech carries. We study this question through pain, using TAME-Pain, which contains pain-neutral Harvard sentences and spoken pain ratings recorded at different self-repor...

Wen-Qi Li, Xiang-Jue Dong, Sulaiman Vesal · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Persona Learning from Feedback for Personalized AI Assistants

Personalizing AI assistants requires adapting their behavior to users' preferences and task contexts. Existing work elicits assistant personas through persona prompting or finetuning on persona-conditioned generations. However, persona descriptions alone do not identify what to change or preserve in a particular respon...

Yiran Shen, Yu Xia, Liuyi Yao et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.