Skip to content

Technical Report - A Comparative Evaluation of Schema Subsetting for LLM-based NL-to-SQL over Large-Schema Databases

· 0 citations · 27 references

TL;DR

This paper systematically evaluates 7 real-world schema subsetting modules across 3 contemporary NL-to-SQL benchmarks, and introduces BigBird–an expansion of the Bird benchmark datasets that provides additional data for evaluating subsetting of large schemas, and introduces new subsetting-specific performance and efficiency metrics that enable in-depth evaluation of subsetting methods.

View source

Similar papers

Preprint Aug 2026

MDB-Link: Hierarchical Schema Linking for Multi-Database Text-to-SQL

This work proposes MDB-Link, a hierarchical schema-linking framework that retrieves question-relevant columns from a global index, aggregates retrieval evidence to shortlist databases, and uses a budget-aware large language model (LLM) for database reranking, table selection, and column grounding.

Beiyu Xu, Zhenyu Wu, Jiao-Yan Chen et al. · 0 citations
#artificial intelligence Preprint Sep 2026

A Cost-Aware Agentic Architecture for NL-to-SQL over Nested Enterprise Schemas, with a New Benchmark

A cost-aware single- generation agentic architecture whose schema- selection, metadata-retrieval, and error-repair components are designed for the requirements this regime imposes, and is competitive with leading systems at a single-generation operating point.

Yoga Sri Varshan Varadharajan, Ajay Yadav, Ritesh Goru et al. · 0 citations

TQTS-Bench: A Multi-Syntax Benchmark for Text-to-Query over Time-Series Databases

TQTS-BENCH is introduced, a multi-syntax benchmark for evaluating text-to-query capabilities over TSDBs, and error analysis reveals that this performance gap mainly stems from the heterogeneous query syntaxes across different TSDBs, misinterpretation of time-specific intents, and incorrect schema linking.

Fei Lyu, Zhi-Yi Peng, Jia-Ming Liu et al. · 0 citations
Open access Sep 2026

Large language models as digital libraries: a multi-benchmark and multi-model study

Querying LLMs as digital libraries is feasible, but its effectiveness depends on model strength, deployment conditions, dataset structure, and execution strategy, and Galois remains valuable when relational discipline and controlled query execution are required.

Mirco Cazzaro, G. Silvello · 0 citations
#artificial intelligence Preprint Aug 2026

BIRD-History: A Benchmark for History-Driven Text-to-SQL with Fine-Grained Knowledge Annotations

BIRD-History is introduced, a benchmark consisting of 1,393 tasks across 11 databases, designed to evaluate text-to-SQL systems'ability to ground underspecified natural language questions using historical SQL scripts, and a plug-in retriever that extracts five types of external knowledge from historical SQL scripts, th...

Yun-Fan Zhou, Qi-Ming Shi, Yi-Zhou Yang et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.