OrderProbe is introduced, a deterministic benchmark for structural reconstruction using fixed four-character expressions in Chinese, Japanese, and Korean, which have a unique canonical order and thus support exact-match scoring.
It is suggested that CoT prompting activates specific latent features to trigger reasoning, and that targeted intervention on these features offers an alternative pathway to elicit efficient reasoning behavior without explicit CoT prompting.
Zhenghao He, Guangzhi Xiong, Bohan Liu et al.· 6 citations· ⚡1
This work introduces KinshipQA, a benchmark designed to probe large language models' ability to perform multi-hop reasoning through reasoning over kinship relations, and demonstrates that KinshipQA yields a wide spread of outcomes and exposes systematic differences in multi-hop reasoning across models and cultural settings.
A novel architecture incorporating an explicit private working memory is proposed and it is demonstrated that this mechanism restores consistency with a fixed hidden state, establishing private state as a necessary component for PSIT-capable language agents.
Davide Baldelli, Alipanah Parviz, A. Zouaq et al.· arXiv.org· 2 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
This paper introduces a simple two-hop question answering setting, where answering a question requires making inferences over two multilingual documents, and finds that language models are more sensitive to language variation in answer-span documents than in those providing bridging information, despite the equal importance of both documents for answering a question.
Yan Meng, Wafaa Mohammed, C. Monz· arXiv.org· 1 citation
MultiCalibrated Subjective Task Learning (MC-STL), a framework that identifies latent value groups from annotations and enforces value-conditional calibration through value group-specific representations, is proposed and evaluated.
Mohammed Fayiz Parappan, Ricardo Henao· arXiv.org· 1 citation
Otter is presented, a small encoder model that achieves consistent improvements over strong multilingual NER baselines, outperforming similarly sized models by 5.7 percentage points in F1.
Jonas Golde, Patrick Haller, Alan Akbik· arXiv.org· 1 citation
AdaFuse is an adaptive ensemble decoding framework that dynamically selects semantically appropriate fusion units during generation that establishes a synergistic interaction between adaptive ensembling and test-time scaling, where ensemble decisions guide targeted exploration, and the resulting diversity in turn strengthens ensemble quality.
Field-Aware Contrastive Decoding (FACD) is proposed, a training-free strategy that amplifies suppressed disposition-sensitive signals, significantly closing the performance gap without sacrificing moral-character performance.
Yonghyun Jun, Junhyuk Choi, Jihyeon Park et al.· 1 citation
EpiQAL provides fine-grained diagnostic signals for evidence-grounding, inferential reasoning, and conclusion reconstruction for epidemiological question answering over research literature, comprising three subsets built from open-access articles across diverse diseases.
Mingyang Wei, De-Hai Min, Zewen Liu et al.· 0 citations
DIP is proposed, a context-optimization algorithm based on average verified confidence that dynamically ranks and inserts in-context examples during generation, rather than providing all examples up front.
Yang Li, Han Meng, Chenan Wang et al.· arXiv.org· 1 citation
Pearmut is introduced, a lightweight yet feature-rich platform that makes end-to-end human evaluation as easy to run as automatic evaluation and enables reliable human evaluation to become a practical, routine component of model development and diagnosis rather than an occasional effort.
Vilém Zouhar, Tom Kocmi· arXiv.org· 11 citations· ⚡2
A new method, called CW-Net, translates the reasoning process of an autonomous vehicle’s AI system into understandable concepts that explain its behavior.
MIT News · Artificial Intelligence· news.mit.eduAug 31, 2026
With millions of users across the world, Julia has been used to conduct cutting-edge research and to design new drugs, jet engines, heat pumps, and more.
A new machine-learning framework aims to improve the success rate of computational protein design while moving away from results that reproduce sequences found in nature.
New MIT research could lead to better materials for a fossil-fuel-free process for making the chemical that's essential to fertilizer and other products.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.