Experiments on WikiTQ and SLQA show that localization is particularly effective for lookup and local reasoning questions, while adaptive selection between localized and full-table reasoning achieves the best overall performance, highlighting that long-table QA requires deciding not only how to localize, but also when to localize.
Abstract
Large Language Models (LLMs) have shown strong performance on table question answering, yet their accuracy often degrades as table size increases. We find that this degradation is not uniform across question types. Localization-sensitive questions are particularly affected by irrelevant table content, while questions requiring broader evidence may still benefit from full-table reasoning. Based on this observation, we propose a question-adaptive framework that dynamically selects between localized and full-table reasoning. The framework constructs question-specific sub-tables through operation-aware table decomposition and uses the predicted question type to determine the appropriate reasoning mode. We further introduce silver reference sub-tables for evaluating evidence selection and construct SLQA, a benchmark based on real-world long tables. Experiments on WikiTQ and SLQA show that localization is particularly effective for lookup and local reasoning questions, while adaptive selection between localized and full-table reasoning achieves the best overall performance. These results highlight that long-table QA requires deciding not only how to localize, but also when to localize. Our code and datasets will be made available upon publication of the paper.
EVA first extracts evidence-aware relational structures that associate question semantics with supporting table attributes that constraining sub-question generation within a grounded evidence space, and introduces relation-guided validation and integrates both DP and PyAgent reasoning to improve robustness across diffe...
Zhen Yang, Zi-Wei Du, Ming-Han Zhang et al.· ACM Transactions on Informat...· 0 citations
PARTAB (Partition-Aware Reasoning overTables), a framework that constructs a structured evidence interface between the LLM and the table, demonstrates the value of structured, partition aware evidence construction for scalable table reasoning.
Results align with a diagnostic perspective on chunking: using evidence at a task-appropriate level of granularity can improve grounding, auditability, and answer quality, but the observed patterns should be interpreted within the HotpotQA distractor setting, fixed generator, and tested context budgets.
By evaluating paper retrieval, evidence grounding, and answer accuracy separately, LitTraceQA provides a testbed for scientific QA systems that produce verifiable answers rather than unsupported summaries.
This work compares country-continent questions with noun, adjective, and code answers while keeping several fitted measurements distinct across Qwen, Llama, and Gemma to separate early readability, natural strength, causal steering, and later content dependence.
Wen-Lin Wei, Yuan Fang, Ren-He Jiang et al.· 0 citations