DocAtlas is presented, a system that treats long-document understanding as a mutable-state information-seeking process and instantiate DocAtlas as a mutable document harness: an external environment that determines what document information is searched, read, stored, reviewed, and shown to the model at each step.
Abstract
Long-document understanding requires models to find and combine evidence across many pages, layouts, tables, figures, and charts. Existing retrieval-augmented systems usually select evidence from a static index before generation, while recent agentic systems add multi-turn tool use but often rely on frozen proprietary backbones whose behavior is set by prompts. We present DocAtlas, a system that treats long-document understanding as a mutable-state information-seeking process. We instantiate DocAtlas as a mutable document harness: an external environment that determines what document information is searched, read, stored, reviewed, and shown to the model at each step. Given a document and question, the harness exposes search, reading, note-taking, and review tools, maintains a hierarchical tree and note store, and updates both as the agent records evidence. DocAtlas combines self-improving retrieval, selective evidence access, and active working memory under a fixed context budget. The same harness supports inference-time use with large VLMs and end-to-end reinforcement learning for compact VLM agents. With GPT-5.4, DocAtlas reaches 71.4\% on MMLongBench-Doc, exceeding the human-expert reference of 65.8\%. A Qwen3.5-4B VLM trained with end-to-end RL in the DocAtlas environment reaches 63.7\%, compared with a 54.4\% direct-input baseline, showing that mutable document-harness design can improve compact document agents by a large margin.
This work introduces Machine-Interpretable Information (MII), the first agent-to-agent (A2A) document-to-state protocol, and demonstrates strong cross-model interoperability across heterogeneous LLMs -- despite the Writer using a legacy GPT-2 vocabulary, forcing genuine semantic translation rather than token-level memo...
Experiments on the LoCoMo and PersonaMem benchmarks, under both Qwen3-8B and Qwen3-14B backbones, show that AutoViewMem improves long-horizon question answering and personalization over strong memory baselines while preserving a simple inference pipeline.
Zi-Jie Cao, Xi-Jun Qu, Zhi-Cheng Gu et al.· 0 citations
StagedWorkspace is proposed, a versioned workspace for knowledge-work agents that binds parsed records and review diffs to content hashes of the native files as they change, and motivates benchmarks that score evidence, staged edits, and submitted artifacts as explicit state transitions.
Yining Hua, Hongbin Na, Yifan Zhou et al.· 0 citations
DataMosaic is presented, an interactive system for constraint-driven document-to-database construction that incrementally builds entity and relationship tables through a closed loop of extraction, verification, repair, and targeted re-extraction.
Zhengxuan Zhang, Zhuo-Wen Liang, Hai-Xun Wang et al.· Proceedings of the VLDB Endo...· 2 citations
Long-horizon interactions with LLM-based assistants require memory systems that preserve and update user states, preferences, and interaction histories. Existing evaluations report end-to-end QA accuracy and cannot determine whether errors arise from encoding, retrieval, or generation. We introduce EvalMem, an operatio...
Ze-Yu Liu, Jian-Yuan Zhong, Rong-Duo Han et al.· 0 citations
DocNavRAG is introduced, which organizes document hierarchies and cross-region relations into a navigable graph, exposes graph operations for locating, navigating, expanding, and fetching, and maintains an evolving evidence state to guide retrieval until sufficient evidence is collected.
Dong Xie, Yao Tian, Hao Zhang et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.