Uncertainty reduction as a candidate primary reinforcer: an evolutionary and neural account

Abstract

This integrative review proposes that the reduction in uncertainty may function as a candidate primary reinforcer in humans. The proposed mechanism is positive prediction error coding by the mesolimbic dopamine system within nucleus accumbens and lateral habenula (NAc-LHb) opponent-process circuitry, gated and refined by later cerebellar and cortical additions. Because the dopaminergic signal responds to prediction resolution rather than to what is predicted, certainty operates as a reinforcer across sensory, motor, social, and propositional domains. The case is developed through three converging arguments: functional, mechanistic, and phylogenetic. The review first documents the conservation of NAc-LHb prediction error circuitry from lampreys to mammals and the matching law as a quantitative description of behavioral allocation. It then traces cerebellar emergence, forward modeling, and an ultrafast disynaptic cerebellum-to-NAc pathway that modulates reward valuation before cortical evaluation completes. It further traces cortical evolution into executive and language-supporting structures, integrating recent causal and human electroencephalogram (EEG) evidence for hierarchical cortical predictive coding as a layer above subcortical and cerebellar contributions. Finally, it addresses system integration and articulates a synthesis between free energy minimization and behavior-analytic motivating operations, proposing that motivating operations are the behavioral implementation of free energy gradients across domains, such that the list of primary reinforcers is principled rather than arbitrary. A falsifiable empirical test is proposed: pairing an arbitrary neutral cue with the resolution of a probabilistic prediction should produce conditioning curves quantitatively similar to those produced by pairing with food or water. On balance, uncertainty reduction is not yet established as a primary reinforcer in the same sense as food or water, but it is a strong candidate for a trans-domain motivational process that can recruit reward, aversion, precision-weighting, and belief-updating systems. Implications are noted for healthy belief revision, neurodevelopmental and psychiatric conditions, and contemporary digital information environments.