This work consolidates, normalize, and partition existing Ewe speech resources into a standardized 174-hour Ewe ASR benchmark, the largest to date to the authors' knowledge, and releases the benchmark under the name Nufo, derived from the Ewe word for"talk", accompanied by models and evaluation resources, to facilitate...
Christ Kekeli Keli, Steve Sanogo, Patrice Sebastiano et al.· 0 citations
People increasingly delegate option-ranking tasks (e.g., shopping, job search, travel) to AI agents, which creates incentives to steer agentic decisions via "agent ads." To defend against such steering attacks, people count on models' alignment training and platforms' terms of service, and consequently the most effecti...
Tim R. Davidson, Marija \v{S}akota, Joshua Joseph et al.· 0 citations
DuoDiscover enables autonomous optimization from software to chip architecture, and surpasses both AlphaEvolve-based ArchAgent v2 and the best human design, with 1.65 times the gain on a CPU microarchitecture optimization task with evaluations of up to 28 hours.
Shubham Agarwal, Akshat Gupta, M. Heddes et al.· 0 citations
Tool-augmented language models ground their responses in external tool outputs, improving reliability beyond parametric knowledge alone. However, even when the correct tool is called and returns accurate information, models may still contradict such outputs, omit critical details, or generate unsupported claims. Existi...
Nikolay Ivanov, Sergey Pletenev, Elisei Rykov et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Online discussions on platforms like Reddit are a productive testbed for fallacy detection: short texts, broad topical range, and the full inventory of informal fallacies. The Touche 2026 lab at CLEF formalises this as a shared task on a Reddit-derived corpus that combines fallacy detection with argument-scheme classif...
Audio description (AD) aims to enhance the accessibility of visual media for blind and low-vision (BLV) persons. However, in higher education, where slide-based lectures are a default mode of teaching, lecture AD remains largely underexplored. The main reason is that existing production guidelines, evaluation metrics,...
While language models provide powerful mechanisms for evaluating textual predictability, it remains unclear whether the relative extents of LM surprisal remain stable across models. This study presents empirical evidence of the invariance of ranking based on cross-entropy related measures (e.g. mean, variance of each d...
Ankit Bhattacharjee, Indrasabarna Hari, Krityapriya Bhaumik et al.· 0 citations
This study introduces a large language model framework for constructing event representations from narratives and modeling their structure and dynamics with excerpt-level traceability, providing an analytical basis for testing neural accounts of event segmentation and predictive organization during naturalistic recall.
How do language models reconcile conflicting contextual evidence within a prompt? We study this question using lexical redefinition, where an explicit instruction specifies how a word should be interpreted and a subsequent sentence provides additional evidence through its usage. Across 870 word pairs, we find that lexi...
Recent work has investigated Omni-modal Large Language Models (OLLMs), models which can take multiple modalities and their combinations as input, as a way forward to have systems really capable of interacting with their environment. Uncertainty quantification (UQ) for OLLMs, however, remains an open problem: existing m...
As coding agents become more capable, tests remain the primary evidence for judging whether their code is correct. Yet passing available tests does not establish that an implementation satisfies its natural language specification. Reliable validation requires checks that faithfully capture the specification and scenari...
Zhiqing Zhong, Ming-Yu Chen, Ao-Yang Fang et al.· 0 citations
Results distinguish functional success from constraint compliance, with failures concentrated in workflow ordering, tool-use discipline, and reporting, and substantial interactions between models and scaffolds.
Wen-Ya Zhu, Xin-Ping Lei, Zhi-Yi Lai et al.· 0 citations
Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.