Skip to content

An Energy-Based Mechanism for Compositional Behavior

Dec 2025 · 3 citations · ⚡ 1 influential · 106 references
Mathematics Computer Science Engineering Physics

TL;DR

This work shows that gating rules, dynamics that compute them, and the neural circuits that may implement them can all be derived from a single variational principle for behavioral composition, providing a unified account of how behavioral composition can emerge from a common principle.

Abstract

Flexible intelligence relies on the ability to reuse previously acquired behaviors and combine them differently as circumstances change. In biological and artificial systems, this ability is often attributed to gating mechanisms that determine how much each available behavior should contribute at a given time. Yet these gating rules, the dynamics that compute them, and the neural circuits that may implement them are usually introduced separately, leaving unclear whether they reflect a common underlying principle. Here, we show that they can all be derived from a single variational principle for behavioral composition. The resulting mechanism naturally gives rise to softmax gating, evolves as an energy-based dynamical system with guaranteed convergence, and admits a recurrent neural network instantiation featuring context-dependent and local interactions. Across collective behavior, human decision-making, and layered control, the same mechanism reproduces characteristic behavioral patterns, provides interpretable accounts of how different behaviors are combined, and matches or outperforms established approaches. These results provide a unified account of how behavioral composition can emerge from a common principle, with implications for understanding flexible behavior in natural systems and for designing artificial agents that can adapt by recombining existing capabilities.

View source

Similar papers

#machine learning Preprint Sep 2026

Neural Dynamics as the Composition of Quantized Units

Deep learning is commonly interpreted at two levels: the macroscopic, through aggregate trends in loss summarized by scaling laws, and the microscopic, through neurons, features, and circuits. A central challenge is understanding how these levels connect, so that we can explain how elementary computations compose and c...

J. Minniti, Aravinth Kulanthaivelu, Richard Sproat · 0 citations
Preprint Sep 2026

The Computational Primitives of Adaptation

Research on adaptive systems has traditionally focused on behavior (what organisms do) and mechanism (how their machinery works). This paper focuses on a third level, computation, which considers what adaptive systems must compute to survive and reproduce. It is proposed that adaptation has its own computational struct...

J. W. Page · 0 citations
Preprint Aug 2026

Emergent Models: Intelligence from Tiny Substrates

Emergent Models (EMs) are a machine learning paradigm based on simple yet open-ended substrates, such as cellular automata, in which modeling is treated not as the learning of a closed-form input-output map but as the emergence, within simple dynamical systems, of computational behaviors that solve external tasks. Such...

Giacomo Bocchese, Nicola Giacobbo, Etienne Guichard et al. · 0 citations
Aug 2026

Neural basis of compositional control

Behaviour of human participants in a prey-pursuit task reflects dynamic blending of goal-specific control policies, with hippocampus estimating latent states, anterior cingulate cortex orchestrating policy switches and orbitofrontal cortex supplying value-based contextualization rather than driving continuous policy up...

Assia Chericoni, Justin M. Fine, Taha S. Ismail et al. · 2 citations
Preprint Sep 2026

Cognitive behavior emerging in mechanical systems through reservoir encoding and active inference

Mechanical systems are traditionally designed as passive assets, where sensing, analysis, and control are treated as decoupled and externally prescribed processes. Reliance on predefined mechanistic models and supervised learning with offline optimization further limits their adaptability in changing environments. Draw...

Matteo Torzoni, Domenico Maisto, Andrea Manzoni et al. · 0 citations
Open access Aug 2026

Weight initialization shapes task organization in recurrent neural networks

It is found that networks with low initial weight variance converge to solutions in which different subtasks rely on largely overlapping weight subspaces, whereas high-variance networks implement subtasks in higher-dimensional, more segregated weight subspaces.

R. Krause, V. Mante · 0 citations

Related blog posts

Hugging Face Blog Oct 20, 2026

MPS in PyTorch 2.15

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.