Skip to content

SearchWiki: Learning to Build and Navigate Knowledge Wikis for Active Information Seeking

Aug 2026 · 0 citations · 49 references
Computer Science

TL;DR

SearchWiki paired with WikiResearcher-9B demonstrates that learned navigation over structured corpora is a superior alternative to flat retrieval, and optimizing the agent's navigation policy with on-policy reinforcement learning with a multi-component reward function balancing answer correctness, retrieval quality and trajectory efficiency.

Abstract

Flat retrieval-augmented generation treats a corpus as a bag of chunks, discarding document hierarchy and cross document structure. We introduce SearchWiki, a harness framework that synthesizes a corpus into a hierarchical, typed, navigable wiki and trains an agent, WikiResearcher-9B, to retrieve information through multi-turn tool use. The wiki organizes knowledge into three layers - document overviews, cross- document topic pages, and page-level source records; enabling progressive refinement of retrieval when initial lookup misses. We optimize the agent's navigation policy with on-policy reinforcement learning with a multi-component reward function balancing answer correctness, retrieval quality and trajectory efficiency. Evaluation on ViDoRe-V3 (8 domains), FinanceBench, and memory benchmarks (LoCoMo, LongMemEval, PersonaMem-v2) shows that WikiResearcher- 9B which is our RL-tuned Qwen 9B model, significantly outperforms same-size untrained baselines and exceeds or matches larger external models. SearchWiki paired with WikiResearcher-9B demonstrates that learned navigation over structured corpora is a superior alternative to flat retrieval.

View source

Similar papers

Jul 2026

WikiLoop: Jointly Learning to Build and Navigate Agent-Native Wikis with Downstream Feedback

Knowledge-base construction and querying are typically optimized in isolation: retrieval-augmented agents operate over a fixed, externally maintained index, whereas construction receives no signal from downstream use. We present WikiLoop, a feedback-coupled framework that jointly learns to build and navigate an agent-n...

Haoliang Ming, Feifei Li, Wen-Hui Que · 0 citations
#reinforcement learning Book Open access Aug 2026

NaviRAG: Learning to Navigate Knowledge Graphs for Retrieval-Augmented Generation

Retrieval-Augmented Generation (RAG) has become a fundamental paradigm for enhancing Large Language Models (LLMs) with external knowledge. However, while recent structure-augmented approaches organize documents into graphs to improve information access, their retrieval strategies remain largely static, relying on simil...

Jinghong Lei, Wang Kun, Zhigang Chen et al. · 0 citations
Jul 2026

MeAI++: Improving answer quality with reinforcement learning for graph retrieval-augmented generation

MeAI++ is proposed, a novel framework that integrates knowledge graph based retrieval with a reinforcement learning (RL) optimization loop to jointly enhance retrieval and generation and confirms the effectiveness and generalizability of MeAI++ for complex, knowledge-intensive question answering.

Tram Nguyen, Truong H. V. Phan · 0 citations
Preprint Aug 2026

Deep Research Pretraining via Predictive Navigation

Deep Research Pretraining (DRP), an offline framework that derives predictive navigation supervision from naturally occurring evidence structures, is introduced, an offline framework that derives predictive navigation supervision from naturally occurring evidence structures.

Jiang-Nan Zhou, Zhi-Yuan Fan, Xing Wu et al. · 2 citations
Preprint Aug 2026

Training a Knowledge Base: Supervised Structure Learning for Agent-Curated Document Stores

This work evaluates the curated store with a test set, on two contamination-free benchmarks: KBGym, a fictional-universe generator the authors release, and PhantomWiki, a fictional-universe generator they release, and PhantomWiki, a fictional-universe generator they release.

Yu Pan, Hongfeng Yu · 0 citations
Jul 2026

Harness-G: A Graph-Structured Harness for Search Agents

Harness-G, a graph-structured retrieval framework that reformulates free-form query generation as finite action selection, and introduces Structured Non-myopic Credit (SNC), which uses a frozen answer scorer to compare the selected action with its alternatives and assigns downstream gains to the earlier actions that en...

Yan-Ning Hou, Hao-Yuan Chen, Si-Hang Zhou et al. · 0 citations

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.