This paper systematically evaluates 7 real-world schema subsetting modules across 3 contemporary NL-to-SQL benchmarks, and introduces BigBird–an expansion of the Bird benchmark datasets that provides additional data for evaluating subsetting of large schemas, and introduces new subsetting-specific performance and efficiency metrics that enable in-depth evaluation of subsetting methods.
This work proposes MDB-Link, a hierarchical schema-linking framework that retrieves question-relevant columns from a global index, aggregates retrieval evidence to shortlist databases, and uses a budget-aware large language model (LLM) for database reranking, table selection, and column grounding.
Beiyu Xu, Zhenyu Wu, Jiao-Yan Chen et al.· 0 citations
A cost-aware single- generation agentic architecture whose schema- selection, metadata-retrieval, and error-repair components are designed for the requirements this regime imposes, and is competitive with leading systems at a single-generation operating point.
Yoga Sri Varshan Varadharajan, Ajay Yadav, Ritesh Goru et al.· 0 citations
TQTS-BENCH is introduced, a multi-syntax benchmark for evaluating text-to-query capabilities over TSDBs, and error analysis reveals that this performance gap mainly stems from the heterogeneous query syntaxes across different TSDBs, misinterpretation of time-specific intents, and incorrect schema linking.
Fei Lyu, Zhi-Yi Peng, Jia-Ming Liu et al.· 0 citations
Querying LLMs as digital libraries is feasible, but its effectiveness depends on model strength, deployment conditions, dataset structure, and execution strategy, and Galois remains valuable when relational discipline and controlled query execution are required.
Mirco Cazzaro, G. Silvello· International Journal on Dig...· 0 citations
BIRD-History is introduced, a benchmark consisting of 1,393 tasks across 11 databases, designed to evaluate text-to-SQL systems'ability to ground underspecified natural language questions using historical SQL scripts, and a plug-in retriever that extracts five types of external knowledge from historical SQL scripts, th...
Yun-Fan Zhou, Qi-Ming Shi, Yi-Zhou Yang et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.