XL-DocBench is introduced, a fully human-verified benchmark for extra-long document understanding, with 1,519 retained questions from six professional domains and contexts up to 2,303 pages, and fills a gap left by prior single-page, short multi-page, or text-only long-context benchmarks.
Hongchen Wei, Yuanzhe Wang, Bei Liu et al.· 0 citations
DocAtlas is presented, a system that treats long-document understanding as a mutable-state information-seeking process and instantiate DocAtlas as a mutable document harness: an external environment that determines what document information is searched, read, stored, reviewed, and shown to the model at each step.
Hongchen Wei, Yuanzhe Wang, Bei Liu et al.· 0 citations
This work proposes StrategyBench, which selects strategy-inducible tasks from BIG-Bench, constructs reference strategies, and defines evaluation metrics along two dimensions: strategy quality and downstream utility, and experiments show that explicit strategy utility differs substantially across task categories and dep...
Jing-Han Tan, Yuanzhe Wang, Lu Chen et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.