Text-to-SQL systems translate natural language questions into SQL queries over increasingly complex databases. However, widely used benchmarks evaluate questions independently, overlooking settings where earlier queries over the same database can supply joins or calculations for a new question. We introduce HARE (Histo...
Xiao-Qi Wang, Wen-Qi Pei, Shizheng Hou et al.· 0 citations
DocPilot is introduced, an agentic document framework that supports expressive orchestration and makes complex document solving learnable by small language models (SLMs) and integrates local visual inspection, code-based numerical reasoning, and cross-modal reasoning for multimodal understanding.
Zhuo-Wen Liang, Xiao-Tian Lin, Yu-Yu Luo et al.· 0 citations
Data videos communicate data insights through dynamic charts, voice narration, and synchronized animations, and have become a widely adopted form of data storytelling. However, producing them requires expertise in data analysis, narrative design, and video editing. Static visualization tools lack narrative and animatio...
Yu-Peng Xie, Zhen-Yang Wang, Liang-Wei Wang et al.· 2 citations
This work proposes EidosDoc, a novel system that achieves state-of-the-art accuracy with minimal computational expense, and establishes a new optimal trade-off among accuracy, cost, and speed.
TradeLens is introduced, a trace-grounded diagnostic toolkit for evaluating agentic trading systems from their trading records, runtime traces, and deployment configurations, which reframe the evaluation of LLM-based trading agents from capability-centric performance ranking to trace-grounded diagnosis of intelligence-...
Qiqi Duan, Changlun Li, Chen Wang et al.· arXiv.org· 0 citations
UI2App is the first benchmark targeting interaction inference, the ability to recover application behavior from screenshots alone, without any textual or behavioral guidance, and designs an end-to-end pipeline that evaluates each artifact along four dimensions: executability, navigation reachability, visual fidelity, a...
Grace Man Chen, Litao Guo, Yifan Wu et al.· arXiv.org· 0 citations
Experiments on three real-world datasets demonstrate that AnnoIndex consistently outperforms state-of-the-art baselines, achieving the highest average F1 score while maintaining robust performance on complex multi-hop join and progressive reasoning queries.
DataSpace, a benchmark in which data agents produce verifiable tabular results from task-local heterogeneous workspaces, is introduced and key challenges for improving data-agent reliability are identified.
Boyan Li, Zhuo-Wen Liang, Yu-Peng Xie et al.· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.