Overall, AutoCoC contributes a reproducible and scalable alternative to expert-authored concept hierarchies by automatically deriving domain-specific prompt structures from documentation, making concept-based prompting more practical for structured knowledge generation.
Recent advances in Large Language Model (LLM) “agent” systems have moved language models beyond single-turn generation toward goal-directed workflows that can plan, ask clarifying questions, and iteratively refine outputs. In parallel, retrieval-augmented generation (RAG) has become a practical way to ground these agents in enterprise knowledge—enabling models to leverage internal documentation and policies without expensive and recurring retraining. However, RAG is only as strong as the underlying corpus: when key information is missing, outdated, or fragmented, retrieval cannot fill the gaps. In many organizations, assembling high-quality, up-to-date documents remains a persistent bottleneck, limiting both the reliability of downstream applications and the speed at which knowledge can be operationalized. To address this, we introduce the Assistant-Scribe-Knowledge Checker (ASK) framework for generating structured specification documents through guided interviews. ASK decomposes the end-to-end workflow into three specialized LLM agents: an Assistant that asks questions to the user and steers the interview through adaptive follow-ups; a Scribe that continuously summarizes what has been said and records it into a schema-constrained specification document with explicit content requirements; and a Knowledge Checker that evaluates the evolving document against those specifications, detects gaps or weakly supported entries, and advises the Assistant on the next best questions to ask to reach the desired completeness and quality. This separation supports seamless document creation while improving quality control over content, structure, and coverage. By distributing responsibilities across three lightweight, role-specific agents, ASK reduces reliance on a single large model and enables modular scaling across teams and domains. We evaluated the ASK framework in a consulting-firm setting where consultants are required to produce project “return-of-experience” documents (successes, failures, challenges, and solutions) to capture reusable knowledge. Compared to documents authored manually, ASK-guided interviews consistently produced more complete, better-structured, and higher-quality specifications with less variability across authors. Beyond measurable quality gains, consultants also reported a clear preference for the interview-based workflow, citing lower effort and a more natural way to articulate tacit project knowledge.
Sylvain Roudiere, Bianca Lento· European Conference on Knowl...· 0 citations
Constructing formal ontologies from domain documents requires simultaneously enforcing corpus grounding, vocabulary consistency, axiom-level expressivity, and end-to-end provenance, a combination no existing automatic system delivers. We present a seven-stage graph-grounded pipeline that converts domain documents into a complete, auditable Web Ontology Language (OWL) Terminological Box (TBox) without any unconstrained generation step. Documents are first encoded as Unified Discourse-Hypergraphs (UDH) capturing entity participation and discourse dependencies; subsequent stages transform this graph evidence into a class hierarchy, typed object and datatype properties, and restriction axioms, with Large Language Model (LLM) usage restricted to narrow, graph-grounded mediation tasks. A paired Assertional Box (ABox) population procedure grounds named individuals in the induced TBox, enabling SPARQL-based functional evaluation. Every emitted term carries a full decision chain from raw source passages through each pipeline stage, making the TBox directly auditable and suitable for targeted human refinement. Evaluated on the life insurance domain using two established benchmarks and a new 100-contract corpus spanning ten product types, our pipeline achieves strong results across all evaluation dimensions, outperforming direct and multi-agent LLM baselines on competency-question (CQ) coverage (0.85 vs. 0.63 and 0.62 on one term-life contract; 0.77 vs. 0.40 and 0.44 on another contract), while also attaining high keyphrase coverage comparable to a manually-constructed reference ontology and strong performance on structured gap-and-overlap reasoning, all without any manual TBox engineering. Ontology growth analysis provides evidence consistent with vocabulary saturation at scale, demonstrating that the pipeline produces stable, reusable domain representations from large document corpora.
Maruf Ahmed Mridul, A. Talukder, O. Seneviratne· 0 citations
We present the REAP system for the AKBC Shared Task 2026 on constructing knowledge bases from language models in a closed-book setting, subject to a budget of at most 32B parameters and no model fine-tuning. Our system combines structured chain-of-thought reasoning, relation-specific query strategies, and a reasoning-based empty-set gate to elicit parametric knowledge, followed by direct extraction into valid JSON arrays. On the test set, the system, built on the Mistral-Small-24B-Instruct-2501 model, achieves a macro-F1 score of 0.62, with particularly strong results on countryLandBordersCountry (F1 = 0.95), companyTradesAtStockExchange (F1 = 0.73), and hasArea (F1 = 0.77). Our code is publicly available at https://github.com/yammdd/AKBC-Shared-Task-2026.
KGCaRe is proposed, a hybrid approach that combines neural retrieval with symbolic reasoning over LLM-generated KGs that consistently outperforms existing baselines, including Vanilla LLM, Code Prompt, Text Prompt, Think-on-Graph, Vanilla RAG, and HybridContextQA.
Ghanshyam Verma, Sima Sarkar, Devishree Pillai et al.· 0 citations
This work targets a KG for Sophocles’ Antigone that supports two coupled uses: structured retrieval, through integrity and competency questions expressed in SPARQL over dramatic structure and interpretive annotations; and interactive exploration, through a lightweight read client that navigates lines across languages, shows scene context, and reports corpus statistics.
Knowledge base question answering (KBQA) aims to answer natural language questions using large-scale knowledge bases (KBs). Among various KBQA approaches, semantic parsing-based (SP-based) methods have demonstrated strong effectiveness by generating concise logical forms (LFs) that capture complex subgraph structures and semantic information. Recent research suggests that integrating large language models (LLMs) with SP can achieve significant improvements in the performance and efficiency of KBQA by facilitating the direct generation of LFs with minimal retrieval. However, generating complete LFs with LLMs continues to pose a challenge due to the complexity of the required graph structures and constraints, leading to the significant issue of non-executability. To address these challenges, we propose GCA-KBQA, a step-wise fine-tuned LLM-based framework that employs hop-wise generation, knowledge-assisted calibration, and path-level assembly to construct complete LFs for KBQA. Specifically, we decompose the complex SP process into manageable steps: first, we iteratively generate LFs for each topic entity one hop at a time using a fine-tuned LLM, leveraging KB knowledge to calibrate intermediate outputs and mitigate error propagation. Subsequently, we guide the LLM in assembling path-level LFs from different topic entities, resulting in optimized final LF. We evaluate the proposed method on four KBQA benchmarks spanning two distinct KBs, demonstrating its superior performance compared to state-of-the-art baselines. The code is available at https://github.com/pvfeldt/GCA-KBQA.
Ranran Bu, Jian Cao, Jianqi Gao et al.· Annual International ACM SIG...· 0 citations
