Skip to content

Evolution of fairness in multi-objective reinforcement learning framework

Sep 2026 · 0 citations · 9 references
Computer Science Physics

TL;DR

This work proposes a multi-objective reinforcement learning framework that models the evolution of fairness as a dynamic trade-off between material payoff maximization and fairness-driven moral behavior, regulated by a fairness pressure coefficient.

Abstract

Fairness, as a fundamental social norm, continues to pose a longstanding puzzle regarding its emergence. Traditional game-theoretic models largely rely on the assumption of \emph{Homo economicus}, wherein individuals are purely rational and self-interested, acting solely to maximize material payoffs. Such accounts, however, overlook the multidimensional nature of human decision-making, which is often shaped also by other considerations beyond economic incentives. To address this gap, we propose a multi-objective reinforcement learning framework that models the evolution of fairness as a dynamic trade-off between material payoff maximization and fairness-driven moral behavior, regulated by a fairness pressure coefficient. Using simulations of a two-objective Q-learning ultimatum game, we find that increased fairness pressure promotes fair outcomes, as expected. Strikingly, however, under moderate pressure, responder behavior reverses: responders become ``forgiving"by accepting low offers -- a pattern in line with our daily experience. Microscopic analyses reveal that this strategy reversal stems from competition between payoff-maximizing and fairness-oriented preferences. We further extend our framework to an asymmetric setting, where proposers and responders assign different weights to the two objectives. Overall, our work expands the reinforcement learning paradigm from a single-objective to a multi-objective formulation, offering a versatile tool for elucidating a broader range of human social behaviors.

View source

Similar papers

Preprint Aug 2026

Emergence of cooperation: A reputation-modulated reinforcement learning

The results reveal that reputation-modulated learning significantly promotes the emergence of cooperative behavior, and the discontinuous phase transition from full cooperation to full defection as the temptation increases.

Chenyang Zhao, Ji-Qiang Zhang, Li Chen et al. · 0 citations
Open access Sep 2026

Research on the Game Dynamics of Optional Public Goods

The main findings demonstrate that individuals update strategies primarily through self-adjustment based on historical payoffs, with imitation playing merely an auxiliary role and the optimal self-adjustment proportion is approximately 0.9, and low sensitivity coefficients and mutation rates favor the emergence of coop...

Hao-Chen Wu, Meng-Cheng Sun, Lu-He Yang et al. · 0 citations
Sep 2026

The prospect of a fair outcome triggers prosocial behaviour in the Centipede Game

Human decision-making reflects not only material incentives, but also concern for others'gains and the ability to understand others. However, the extent to which sensitivity to fairness interacts with aspects of social cognition and affects sequential social interactions requires further understanding. Here, we address...

Marco Saponara, Antonio Fernandes, Elias Fernández Domingos et al. · 1 citation

Related blog posts

MIT News · Artificial Intelligence Nov 17, 2026

Learning the language of machine learning

By studying the computational foundations of language learning, Associate Professor Jacob Andreas builds intelligent systems that can communicate effectively with humans.

Microsoft Research Blog Nov 16, 2026

TokenEconomizer: Learning from Experience to Make AI Coding Agents More Efficient

AI coding agents are increasingly help developers fix bugs and build features largely on their own, but every interaction with their models consumes tokens. In each session, an agent sends instructions, tool descriptions, and session history to its model. Most efforts to reduce this cost focus on individual tasks. Yet developers return to the same […] The post TokenEconomizer: Learning from Experience to Make AI Coding Agents More Efficient appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.