Multi-hop QA benchmarks often reward Large Language Models (LLMs) for spurious correctness, where models reach correct answers through invalid intermediate reasoning. We propose SAFE, an LLM-as-verifier framework for evidence-grounded multi-hop QA. Rather than judging only the final answer after generation, SAFE verifi...
It is shown that the transition from productive to redundant reasoning is decodable from late-layer hidden states and representations separate the two phases around first-correct-solution boundaries beyond what position and lexical controls explain, and distinguish correct from incorrect solution endings.
While Multimodal Large Language Models (MLLMs) show promising performance in automated electrocardiogram interpretation, it remains unclear whether they perform actual step-by-step reasoning or just rely on superficial visual cues. To investigate this, we introduce ECG-Reasoning-Benchmark, a novel multi-turn evaluation...
Jungwoo Oh, Hyunseung Chung, Junhee Lee et al.· 0 citations
Large language models routinely produce factually incorrect or misleading outputs, yet conventional automated benchmarks overlook how users perceive reliability during interaction. We introduce the System Hallucination Scale (SHS), a lightweight instrument modeling the famous System Usability Scale (SUS) and System Cau...
Heimo M\"uller, Dominik Steiger, Markus Plass et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Anagent, a multi-agent framework for enhanced scientific table \&figure analysis through four specialized agents that leverage supervised finetuning and specialized reinforcement learning to optimize individual capabilities while maintaining effective collaboration, is proposed.
Xue-Hang Guo, Zhiyong Lu, Tom Hope et al.· arXiv.org· 0 citations
Generative AI and misinformation research have evolved since our 2024 survey. This paper presents an updated perspective, transitioning from literature review to practical countermeasures. We report on changes in the threat landscape, including improved AI-generated content through Large Language Models (LLMs) and mult...
Alexander Loth, Martin Kappes, Marc-Oliver Pahl· 0 citations
This work proposes Jacobian Scopes, a suite of gradient-based, token level causal attribution methods for interpreting LLM predictions that reveal implicit political biases, uncover word- and phrase-level translation strategies, and shed light on recently debated mechanisms underlying in-context time-series forecasting...
To-Ni J. B. Liu, Baran Zadeoglu, Gurbir Arora et al.· 0 citations
This work proposes a two stage detection framework that first identifies suspicious conversations using a tailored ensemble classification model and compares its modular approach against a Dual LLM baseline that performs detection and judgment using different language models.
Ali Şenol, Garima Agrawal, Huanmin Liu· arXiv.org· 4 citations
SSM-Informed Softmax Attention is proposed, which builds Mamba-3-style state transitions, rotation included, directly into the scores alongside FoX's gate and outperforms parameter-matched Transformer and FoX in language modeling and length extrapolation.
Children expertly construct mental models under uncertainty despite limited world knowledge. Which computational principles make this possible? We study this question in an interactive physical Box Task in which participants infer a latent cause through interaction with a stochastic and partially observed environment....
Jeffrey Qin, Zhuangfei Gao, Wasu Top Piriyakulkij et al.· 0 citations
Automating optimization modeling with LLMs is a promising path toward scalable decision intelligence, but existing approaches either rely on agentic pipelines built on closed-source LLMs with high inference latency or fine-tune smaller LLMs using costly process supervision that often overfits to a single solver API. We...
Runda Guan, Xiangqing Shen, Jiajun Zhang et al.· 0 citations
Query correction is a critical entry point in modern search pipelines, demanding high accuracy strictly within real-time latency constraints. Chain-of-Thought (CoT) reasoning improves accuracy but incurs prohibitive latency for real-time query correction. A potential solution is to output an answer before reasoning to...
Chen Zhang, Kepu Zhang, Jiatong Zhang et al.· ACM International Conference...· 0 citations
Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.