Skip to content

T-SMART: Mechanism-Level Attribution for Tool-Augmented Time-Series Question Answering

Sep 2026 · 0 citations · 33 references
Computer Science

TL;DR

T-SMART is presented, a neurosymbolic framework that separates these roles: a frozen LLM interprets questions and selects operations, deterministic tools perform numerical computation, and structured perception is invoked only when needed to provide a controlled framework for analyzing component contributions in neurosymbolic time-series systems.

Abstract

Large language models (LLMs) can struggle with time-series question answering (TS-QA), especially when numerical signals are serialized as text and require explicit computation. Tool-augmented approaches improve performance, but existing systems often intertwine language reasoning, computation, and perception, making it difficult to determine which components drive the gains. We present T-SMART, a neurosymbolic framework that separates these roles: a frozen LLM interprets questions and selects operations, deterministic tools perform numerical computation, and structured perception is invoked only when needed. Controlled paired ablations show that deterministic computation provides the dominant benefit, improving accuracy by 31.7 percentage points over direct LLM reasoning on serialized time series, while language understanding and perception offer smaller complementary gains. These results indicate that tool-augmented TS-QA benefits primarily from reliable numerical execution rather than additional language-model reasoning and provide a controlled framework for analyzing component contributions in neurosymbolic time-series systems.

View source

Similar papers

#natural language process... Preprint Aug 2026

MechaTerp-TRACE: A Novel Approach for Component Ablation Analysis in Language Models

It is found that the components carrying the most effect are the same few, positionally fixed components in every model, regardless of which entity a prompt asks about, and that once these are removed, the remaining support is close to evenly spread in eleven of the thirteen models.

B. Colelough, Davis Bartels, Madeline Bittner et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Zero-Shot Time-Series Question Answering via Decoupled Perception and Reasoning

Time-series question answering (TSQA) requires grounding linguistic queries and diverse answer formats in complex numerical observations. However, existing methods heavily overfit to specific datasets and struggle to generalize when input series, question contexts, and answer requirements shift simultaneously. To addre...

Jin-Ze Xie, Hao-Chen Yuan, Yun-Bo Wang · 0 citations
#natural language process... Preprint Sep 2026

Revisiting Complete Reasoning Traces for Post-Training

It is found that full trajectories provide only limited benefit, while partial trajectories are effective even under heavy truncation, and training LLMs using endpoints leads to consistent changes in reasoning behavior, and that it also benefits post-training methods based on reinforcement learning or on-policy distill...

Jaehui Hwang, Sangdoo Yun, Byeongho Heo et al. · 0 citations
#artificial intelligence Preprint Sep 2026

TimeThink: Eliciting Compositional Reasoning in Timeseries Large Language Models

TimeThink, a synthetic framework for eliciting compositional timeseries reasoning that employs a reinforcement learning with verifiable rewards (RLVR) training strategy that encourages explicit reasoning, significantly outperforms strong baselines on both synthetic and real-world benchmarks.

Sudarshan Regmi, Arvind Pillai, Y. Wu et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Do Time-Series QA Systems Read the Time Series? Evidence Use and Reasoning Reliability

In recent years, time-series question answering (QA) systems have made significant progress. However, generating a correct answer does not show whether retaining the supplied numerical series improves task performance, nor whether the prediction is sensitive to changes in that input. While some systems provide rational...

Zhuo-Min Chen, Jing-Chao Ni, Xu Zheng et al. · 0 citations
#machine learning Preprint Oct 2026

A Systematic Study of Small Language Models on Abstract Reasoning Tasks

Endpoint accuracy on abstract-reasoning benchmarks does not reveal whether a language model has acquired a transferable rule or fit distribution-specific regularities. We study this distinction in small language models on the ARC-TGI benchmark, which organizes abstract grid transformations into controllable task famili...

Nur A. Zarin Nishat, Jens Lehmann, Andrei C. Aioanei et al. · 0 citations

Related blog posts

Microsoft Research Blog Oct 12, 2026

Simulating student learning for better AI tutoring

StudentSim is a research system for evaluating and improving AI tutoring tools before they are tested with learners. It models how individuals may engage with tutors, giving feedback to improve tutor performance across subjects like chess, writing, and mathematics. The post Simulating student learning for better AI tutoring appeared first on Microsoft Research.

GPT-Lab Sep 3, 2026

Adaptive AI Agents in Construction Workflows

Adaptive AI agents can help make BIM data more machine-readable by navigating IFC models, interpreting inconsistent information, and mapping it to defined standards. In this blog, Alok Rawat shares findings from a real-world pilot in construction workflows. The post Adaptive AI Agents in Construction Workflows appeared first on GPT-Lab.

GPT-Lab Aug 28, 2026

We built an AI factory for HVAC control

What does it take to trust AI-driven HVAC optimization? Our AI Model Factory combines agents, machine learning, reinforcement learning and deterministic checks in a governed workflow designed for messy, real-world building data. The post We built an AI factory for HVAC control appeared first on GPT-Lab.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.