Skip to content

Semantic Bayesian World Models

Sep 2026 · 0 citations · 26 references
Computer Science

TL;DR

Semantic Bayesian World Models are envisioned: a Web that describes the world not as a database of facts but as a shared, evolving fabric of beliefs over knowledge graphs, where ontological axioms constrain priors, observations update beliefs by Bayesian conditioning, and actions intervene upon the world.

Abstract

Knowledge graphs describe reality in crisp assertions, while the systems now consuming them, foundation models and autonomous agents, reason natively in probabilities. We argue that this mismatch is why the integration of language models and knowledge graphs remains a data-feeding pipeline rather than a unified reasoning architecture. We envision Semantic Bayesian World Models (SBWMs): a Web that describes the world not as a database of facts but as a shared, evolving fabric of beliefs over knowledge graphs, where ontological axioms constrain priors, observations update beliefs by Bayesian conditioning, and actions intervene upon the world. We work through what an agent gains from such a model: a home-security agent deciding whether the figure at the gate is a courier or a burglar, an actuarial estimate aggregated by entailment rather than by string frequency, a planning task that language models reliably fail, and the estimation of quantities that no document has ever stated. We then set out what the community must build to make them possible: belief annotation over RDF~1.2, probabilistic entailment regimes, semantic calibration layers, and protocols by which agents that have never met can exchange, and disagree over, calibrated beliefs.

View source

Similar papers

#artificial intelligence Preprint Sep 2026

Bayesian Intelligence from the Outside

A theory of Bayesian intelligence for agents such as language models is developed and the difficulty of aggregating coarse reports from intelligent agents is shown: unless the agent reports a belief about the complete state of the world, the optimal aggregation can assign arbitrary weights to states that have not been...

Alex Smolin, Bryan Wilder · 0 citations
Open access Aug 2026

Beyond Static Assumptions: The Predictive Justified Perspective Model for Epistemic Planning

The Predictive Justified Perspective (PJP) model is formally defined and proved that it retains the computational efficiency of state-based planning while ensuring logically sound belief reasoning (satisfying the KD45 axioms).

Guang Hu, Weijia Li, Yangmengfei Xu · 0 citations
#natural language process... Preprint Sep 2026

From Token Probabilities to Semantic Constraints: Towards Declarative Probabilistic Evaluation of Language Models

A declarative probabilistic framework for pre-training evaluation that makes the semantic structure of model behavior explicit and provides new formal tools for relating evaluation to learning, and links evaluation and learning through a shared semantics.

Kyle Richardson, C. Anderson, Pranav Balakrishnan et al. · 1 citation
#artificial intelligence Preprint Sep 2026

Large Knowledge Model: A Knowledge Foundation for Agentic Science at Scale

The Large Knowledge Model is proposed, a growing, agent-native knowledge foundation that provides a general representation of scientific knowledge across disciplines and an agent-native, reasoning-aware scientific retrieval system that retrieves claims together with their reasoning chains and sources, enabling agents t...

Yuan Huang, Si-Han Hu, Hong-Yu Gu et al. · 0 citations
#artificial intelligence Preprint Aug 2026

A hierarchy of faithfulness criteria for knowledge base completion

Evaluating knowledge graph and logic-geometric embedding models on $\mathcal{EL}$ ontologies, with entailed, contradictory, and undetermined test sets generated by a reasoner, it is found that ranking accuracy does not imply logical faithfulness and that none of the evaluated models is faithful across the hierarchy.

O. Mashkova, Robert Hoehndorf · 0 citations
#natural language process... Preprint Sep 2026

Bayesian Fine-tuning Yields Language Models that are as Bayesian as their Beliefs Allow

Language models (LMs) are increasingly used for tasks that require reasoning about hidden variables from a few observations, for which Bayesian inference is the normatively correct solution. While supervised fine-tuning of an LM on the outputs of an optimal $\textit{Bayesian}$ model leads to near-Bayesian behavior, sta...

Polina Tsvilodub, Andreas Waldis, Lin-Lu Qiu et al. · 0 citations

Related blog posts

MIT News · Artificial Intelligence Sep 29, 2026

Who we become when we talk to machines

Professor Sherry Turkle’s new book, “Artificial Intimacy,” offers a withering critique of chatbots and the antisocial dynamics she believes they encourage.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.