Skip to content

Belief-Guided Decision Making with Uncertainty Gating in the Game of Go

Jul 2026 · arXiv.org · Vol abs/2607.26946 · 0 citations · 39 references
Computer Science

TL;DR

A novel Belief-Guided architecture that disentangles the Policy head from a distinct Belief head is introduced, enabling professional-level play on limited hardware where massive MCTS is infeasible.

Abstract

Recent advancements in Computer Go, driven by AlphaZero and MuZero, rely heavily on Monte Carlo Tree Search (MCTS) to correct the errors of the neural network policy. While effective on massive computational clusters, this dependence creates a critical bottleneck on consumer-grade hardware, where the computational cost of tree management severely limits inference rates. Furthermore, without deep search, these models suffer from hallucination, proposing moves with high confidence that are strategically fatal. This paper introduces a novel Belief-Guided architecture that disentangles the Policy head from a distinct Belief head. Unlike traditional value functions, the Belief head acts as an internal simulator and independent critic, modeling epistemic uncertainty and strategic stability. By integrating memory mechanisms (Transformer/GRU) to handle long-term dependencies and the Ko rule, and utilizing a gating mechanism to filter overconfident policy errors, our model shifts the burden of intelligence from runtime search to parametric"intuition."Experimental results demonstrate that this approach significantly improves search-free win rates and reduces hallucination, enabling professional-level play on limited hardware where massive MCTS is infeasible.

View source

Similar papers

Preprint Aug 2026

BODHI: Do LLMs Branch Out and Discover Heterogeneous Inferences?

The nature of test-time exploration in RLVR-trained LLMs is investigated by employing controlled maze-solving experiments and extracting a tree structure from mathematical reasoning traces (BODHI-Trees) based on semantic equivalence to delineate between entropy arising from stylistic variations and genuine inferential...

Soumadeep Saha, Krish Sharma, Akshay Chaturvedi et al. · 1 citation
Book Open access Aug 2026

The Belief Update Gate: Separating Inertia from Learning in Human–AI Interaction

Observed non-movement does not distinguish genuine latent belief inertia from small unexpressed updates, rounding, or other reporting processes, and these findings show that calibration analyses of repeated human–AI interaction should distinguish visible non-movement in elicited belief reports from updating conditional...

Shreyan Biswas, Alexander Erlei, U. Gadiraju · 0 citations
Preprint Aug 2026

Towards Improving Sequential Decision-Making in LLM Agents via Experience Memory

An agentic framework enhanced with an experience memory designed for the sequential setting and addressing common challenges of sequential decision-making such as credit assignment is introduced, and it is shown that post-game reflection and rule extraction yield measurable improvements on tic-tac-toe without modifying...

Jakub Rada, Viliam Lisý AI Center, Department of Computer Science et al. · 0 citations
Open access Sep 2026

Dynamic Reduction of Neural Uncertainty Shapes Perceptual Decisions in a Bayes-Optimal Manner

The findings support and extend the idea that the brain implements iterative Bayesian inference to navigate the environment in an adaptive manner which offers a general and unifying mathematical framework for cognition.

Dragan Rangelov, Sebastian Bitzer, Jason B. Mattingley · 0 citations
#artificial intelligence Preprint Sep 2026

Jailbreaks for Black-Box Uncertainty Quantification in Large Reasoning Models

While Large Reasoning Models (LRMs) excel at complex reasoning, alignment through reinforcement learning often induces systemic overconfidence. In production environments, where logits may be unavailable, robust black-box uncertainty quantification (UQ) is essential for trustworthiness and safety. Focusing on question-...

Lucas Biechy, Cédric Eichler, Adrien Boiret et al. · 0 citations

Related blog posts

Hugging Face Blog Oct 20, 2026

MPS in PyTorch 2.15

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.