Skip to content
Preprint

Auditable by Construction: An Ontology-Driven Framework for Trustworthy LLM Analytics in Enterprise Finance

Aug 2026 · 0 citations · 3 references
Computer Science

TL;DR

It is argued that retrieval-augmented generation for enterprise finance should be evaluated on auditability alongside accuracy, and the Knowledge-Driven Analytics Framework is presented, which builds ontology-driven knowledge systems through six iterative stages and retrieves evidence via Context-Aware Relevance Propagation (CARP), so that every retrieved fact carries its relationship type, confidence, and source lineage.

Abstract

Enterprise adoption of large language models in finance is constrained less by fluency than by trust: in Financial Planning and Analysis (FP&A) and other regulated workflows, an answer is usable only if it is traceable to authoritative sources and auditable after the fact. This paper argues that retrieval-augmented generation for enterprise finance should be evaluated on auditability alongside accuracy, and presents the Knowledge-Driven Analytics Framework (KDAF), which builds ontology-driven knowledge systems through six iterative stages and retrieves evidence via Context-Aware Relevance Propagation (CARP), so that every retrieved fact carries its relationship type, confidence, and source lineage. An evaluation on FinanceBench (145 questions) compares KDAF against zero-context inference, BM25, concept-weighted lexical retrieval, and ungrounded graph traversal. First, retrieval is necessary: zero-context inference reaches 4.1% correctness against 10-12% for retrieval-augmented conditions. Second, on answer correctness the retrieval conditions are statistically indistinguishable (KDAF vs BM25: -0.007, 95% CI [-0.021, 0.000]), so accuracy alone does not justify structured retrieval here -- a negative result we report explicitly. Third, on auditability the ordering reverses: KDAF attains the highest citation traceability F1 (0.515), exceeding ungrounded traversal by +0.027 (CI [0.006, 0.050]) and BM25 by +0.052 (CI [0.024, 0.083]), intervals excluding zero. Graph-structured retrieval also admits no evidence from outside the question subject entity (0 of 426 items, against 16.8% and 20.2% for lexical baselines), and every selected item resolves to a complete provenance chain. We argue that auditability, not accuracy, is the axis on which ontology-grounded retrieval earns its cost.

View source

Similar papers

Review Open access 2026

A Semantic Ontology-Based Model for Solidity Smart Contracts With an LLM-Assisted Natural-Language Query Use Case

Smart contracts increasingly support high-value and governance-critical blockchain applications, making precise program understanding important for reliable analysis and tooling. Many existing analysis tools rely on task-specific pipelines in which extracted program knowledge is not readily available as reusable and in...

Udsanee Pakdeetrakulwong, Suksawat Saelim, Naruapon Suwanwijit · 0 citations
Open access 2026

CKG-P: A Prescriptive Process for Building Knowledge Graphs in a Compliance-Driven Corporate Environment

Knowledge Graphs (KGs) have become increasingly critical in enterprise environments; however, existing academic methodologies do not always explicitly address requirements such as governance, infrastructure scalability, modularity, and integration with legacy systems. This paper examines limitations in the explicit cov...

José Alberto Sousa Torres, D. A. da Silva, R. de Oliveira Albuquerque et al. · 0 citations
Review Open access Sep 2026

Provenance-Native Audit Infrastructure for LLM-Maintained Wiki Knowledge Systems

An automated gap analysis shows the architecture demonstrates alignment with five of eight requirements derived from the EU AI Act and FDA AI/ML guidance, and module-level evaluations of claim extraction, evidence binding, and silent-edit detection are reported together with a measured baseline comparison on retraction...

Bai-Ling Zhang · 0 citations
Review Sep 2026

An Evidence-First Multi-LLM Framework for Auditable Critical-Infrastructure Dependency Modeling

Critical-infrastructure knowledge is distributed across heterogeneous, incomplete, and weakly structured evidence, making dependency models difficult to construct automatically and difficult to trust. Large language models (LLMs) can extract structured knowledge from such evidence, but direct LLM-to-graph generation ri...

Nurjahan, Mst. Eshita Khatun, Lamine Noureddine et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.