Skip to content

From Question-First to Analyst-First: Domain-Expert Skills and Verified Knowledge Compilation for Proactive Enterprise Analytics

Jun 2026 · 0 citations · 63 references
Computer Science

TL;DR

This work describes a production analytics system that inverts the interaction model from question-first to analyst-first through two coupled architectural ideas, and gives a formal model and report illustrative single-tenant evidence.

Abstract

Conversational analytics systems assume the user already has a well-formed question, leaving a non-expert facing a blank query box on an unfamiliar enterprise schema. Commercial'proactive'tools narrow this gap only by detecting statistical anomalies over analyst-curated metric layers, and academic next-question recommenders depend on query logs that a fresh dataset lacks. We describe a production analytics system that inverts the interaction model from question-first to analyst-first through two coupled architectural ideas. First, a pluggable domain-expert'skill'abstraction: a folder-based, database-free subject-matter pack (a manifest, per-stage prompt facets, keyword-routed references, report templates, and optional compute) auto-selected per (client, dataset) by deterministic schema matching and spliced as a cross-cutting concern into every stage of an agentic pipeline, the schema explorer, and the report engines, degrading to a strict no-op when absent. Because a skill is a self-contained folder resolved deterministically, the catalogue is open-ended: an extensible marketplace of domain experts. Second, an offline knowledge-compilation loop: an agent probes the dataset's parquet via DuckDB (zero load on production), runs critic-gated per-table convergence with self-healing retries, and data-validates joins by value overlap, producing durable schema knowledge that drives standing expert reports whose every published metric is re-verified by re-executing its evidence SQL, plus suggested questions that mirror the report agenda. These close a proactive loop: reports surface numbers, the numbers seed questions, and a click launches a verified deep dive, all before the query box is used. We give a formal model and report illustrative single-tenant evidence. We make no user-study or benchmark claims; the contribution is the architecture and its defensibility.

View source

Similar papers

Book Open access Oct 2026

Continuum: Automated Construction and Retrieval of Software Decision Knowledge Graphs from Developer-AI Conversations

Developer-AI conversations, through coding assistants and chat-based programming aids, produce rich architectural decision traces (trigger, context, alternatives considered, decision, rationale) that are lost when the chat session ends. Conversation logs are unstructured, not indexed for retrieval, and disconnected fro...

Mohammad Ali Shehral, Karthik Ravi, Nikhil Trivedi et al. · 0 citations
Preprint Sep 2026

Knowledge-as-Skill: A Structural Design for Autonomous Knowledge-Base Use by LLM Agents

Retrieval-augmented generation (RAG) gives large language models (LLMs) access to external knowledge, but its conventional retrieve-concatenate-generate pipeline makes retrieval decisions on behalf of the model. As tool use and agent loops become more reliable, an agent can decide whether to retrieve, what to inspect,...

Jiang-Xu Wu · 0 citations
#artificial intelligence Preprint Aug 2026

BIRD-History: A Benchmark for History-Driven Text-to-SQL with Fine-Grained Knowledge Annotations

BIRD-History is introduced, a benchmark consisting of 1,393 tasks across 11 databases, designed to evaluate text-to-SQL systems'ability to ground underspecified natural language questions using historical SQL scripts, and a plug-in retriever that extracts five types of external knowledge from historical SQL scripts, th...

Yun-Fan Zhou, Qi-Ming Shi, Yi-Zhou Yang et al. · 0 citations
#artificial intelligence Preprint Sep 2026

A Cost-Aware Agentic Architecture for NL-to-SQL over Nested Enterprise Schemas, with a New Benchmark

A cost-aware single- generation agentic architecture whose schema- selection, metadata-retrieval, and error-repair components are designed for the requirements this regime imposes, and is competitive with leading systems at a single-generation operating point.

Yoga Sri Varshan Varadharajan, Ajay Yadav, Ritesh Goru et al. · 0 citations
Conference Open access Aug 2026

From Tacit Knowledge to Structured Documents: A Framework for Knowledge Elicitation

The Assistant-Scribe-Knowledge Checker (ASK) framework for generating structured specification documents through guided interviews is evaluated in a consulting-firm setting where consultants are required to produce project “return-of-experience” documents to capture reusable knowledge.

Sylvain Roudiere, Bianca Lento · 0 citations
#artificial intelligence Preprint Sep 2026

WinSyn: An Automated Pipeline for Realistic Enterprise Question-Answering Evaluation

This work introduces an automated pipeline for generating synthetic datasets of emails reflecting realistic workplace scenarios, along with long- and short-form questions and gold answers grounded in the data, and underscores the importance of realistic, high-complexity evaluation data for developing stronger real-worl...

Amey Varhade, Ananya Sutradhar, Ravishankar Krishnaswamy et al. · 0 citations

Related blog posts

Hugging Face Blog Oct 20, 2026

MPS in PyTorch 2.15

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.