Skip to content
Preprint

Reputation-driven Cooperation in Lattice-based Decentralized Federated Learning through Evolutionary Game Theory

Aug 2026 · 0 citations · 30 references
Computer Science Mathematics

TL;DR

This work model peer-to-peer (P2P) interactions on a lattice network structure under the assumption of bounded rationality and forms a comprehensive payoff matrix incorporating training costs, communication overhead, and cooperative rewards, while tailoring a strategy update rule that captures spatial propagation dynamics.

Abstract

Decentralized Federated Learning (DFL) has emerged as an optimal privacy-preserving solution; however, it remains vulnerable to opportunistic behaviors due to the absence of a central coordinator. While Evolutionary Game Theory (EGT) serves as a powerful framework for analyzing such behaviors, existing studies often assume that agents possess perfect rationality and maintain static strategies. To address these limitations, this paper proposes a novel EGT framework designed to analyze strategic evolution and enhance overall system performance. The primary contributions of this work are threefold: First, we model peer-to-peer (P2P) interactions on a lattice network structure under the assumption of bounded rationality. Second, we formulate a comprehensive payoff matrix incorporating training costs, communication overhead, and cooperative rewards, while tailoring a strategy update rule that captures spatial propagation dynamics. Third, we integrate a reputation-based reward-and-punishment mechanism to effectively deter free-riding behaviors. Simulation results demonstrate that the framework significantly outperforms the baseline. Specifically, it increases average accuracy from approximately 70% to 82%, elevates cooperation frequency to approach 100% (compared to below 5% in the baseline), and drops accuracy variance from around 0.40 to 0.002, thereby accelerating uniform convergence and ensuring system stability.

View source

Similar papers

#artificial intelligence Preprint Sep 2026

Evolutionary Stability Does Not Guarantee Learning Accessibility: A Multi-Agent Reinforcement Learning Perspective on Cooperation Emergence

The results indicate that evolutionary stability and learning accessibility are distinct properties of a coupled game--learning system in a transparent three-agent governance-motivated game involving a government, a platform firm, and users.

Yi-Jie Wang · 0 citations
Preprint Aug 2026

Emergence of cooperation: A reputation-modulated reinforcement learning

The results reveal that reputation-modulated learning significantly promotes the emergence of cooperative behavior, and the discontinuous phase transition from full cooperation to full defection as the temptation increases.

Chenyang Zhao, Ji-Qiang Zhang, Li Chen et al. · 0 citations
#machine learning Preprint Sep 2026

Pathwise Individual Rationality in Federated Learning: A Mechanism-Architecture Co-Design

Participation in federated learning (FL) comes at a cost. Clients trade off privacy, communication, and compute costs for potentially greater gains in model efficacy. This paper explores this tradeoff under the aegis of individual rationality (IR) versus autarky, the basic game-theoretic requirement that the federation...

Amin Meghrazi, Srinivasan Parthasarathy, A. Perrault · 0 citations
Oct 2026

Information Scenario-Aware Incentive Mechanisms for Federated Learning Using Game Theory and Reinforcement Learning

Federated learning (FL), which enables collaborative training of large-scale artificial intelligence (AI) models across scattered Internet of Things (IoT) devices without exposing private data, has received a lot of attention. In FL, the performance of AI models obtained from the training is highly dependent on effecti...

Jia-Mei Li, Hai-Zhou Wang, Ji-Ning Chen et al. · 0 citations
#machine learning Preprint Sep 2026

NashDreamer: Model-Based Reinforcement Learning for Zero-Sum Imperfect-Information Games

NashDreamer is proposed, a principled MBRL framework for two-player zero-sum IIGs that introduces a centralized Multi-Agent Recurrent State-Space Model (MARSSM) that decouples environment dynamics from the effect of players's strategies on their individual observations.

Tomáš Holeček, Viliam Lisý · 0 citations
#machine learning Preprint Oct 2026

Pay to Learn, Share to Earn: Incentivized Federated Multi-Player Bandits

Federated multi-player multi-armed bandit problems model collaborative sequential decision-making where multiple players interact with a common bandit environment and share information through a central server to accelerate learning. Existing federated bandit frameworks typically assume that all players willingly share...

J. PavamanaK, C. Singh · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.