Skip to content
#machine learning Open access

Expected flow networks in stochastic environments and two-player zero-sum games

Oct 2023 · International Conference on Learning Representations · Vol abs/2310.02779 · 11 citations · ⚡ 1 influential · 47 references
Computer Science

TL;DR

This work shows that EFlowNets outperform other GFlowNet formulations in stochastic tasks such as protein design and extends the concept of EflowNets to adversarial environments, proposing adversarial flow networks (A FlowNets) for two-player zero-sum games.

Abstract

Generative flow networks (GFlowNets) are sequential sampling models trained to match a given distribution. GFlowNets have been successfully applied to various structured object generation tasks, sampling a diverse set of high-reward objects quickly. We propose expected flow networks (EFlowNets), which extend GFlowNets to stochastic environments. We show that EFlowNets outperform other GFlowNet formulations in stochastic tasks such as protein design. We then extend the concept of EFlowNets to adversarial environments, proposing adversarial flow networks (AFlowNets) for two-player zero-sum games. We show that AFlowNets learn to find above 80% of optimal moves in Connect-4 via self-play and outperform AlphaZero in tournaments.

Read PDF

Similar papers

Open access Aug 2026

Physics-informed adversarial networks for stochastic second-order mean-field games of autonomous traffic

Inspired by the highly complex and nonlinear traffic flow phenomenon, we propose a second-order continuum model for autonomous vehicles (AVs) by considering them as rational and utility-optimizing agents. Further, by accounting for stochastic fluctuations in driving dynamics, a non-cooperative differential game probl...

N. K. Pande, Arun Kumar, A. K. Gupta · 0 citations
Preprint Aug 2026

Unifying Generative Models with Path Integrals

We formulate generative modeling as a path integral in which flow-based, diffusion-based, variational, and adversarial models arise as different evaluation principles for a single master action. Its Martin-Siggia-Rose-Janssen-de~Dominicis (MSRJD) form separates free from interacting probability flows and opens them to...

Ramon Winterhalder · 0 citations
#machine learning Preprint Sep 2026

RLVR landscapes for iterated multiplications can be benign: Insights from spin-glass theory

This work maps entropy-regularized RLVR over myopic tabular policies onto an energy-based (spin-glass) model over deterministic policies, and finds that a transformer trained from scratch, using only last-token rewards, successfully learns an algorithmic chain of thought for iterated non-Abelian group multiplications.

Noa Rubin, Z. Ringel · 0 citations
#machine learning Preprint Aug 2026

Reward-guided Fine-Tuning of One-Step Generative Models via Wasserstein Gradient Flow

This work considers one-step generators from an optimal transport view, investigating Wasserstein Gradient Flow (WGF) for modeling smooth and controlled distributional evolution in probability space, and proposes a novel reward-guided fine-tuning of a one-step generative model via WGF.

Hoseong Hwang, Woorim Han, Joungin Chun et al. · 1 citation
#machine learning Preprint Sep 2026

Constant Swap Regret in General-Sum Games via Two-Scale Higher-Order Optimism

We give deterministic and uncoupled learning dynamics for finite multiplayer general-sum games under full-information feedback that achieve constant individual swap regret in self-play, independent of the horizon $T$. With $n$ players and at most $m$ actions each, every player's individual swap regret is $O(\sqrt n\,m\...

Tung Mai · 0 citations

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.