Skip to content

Asynchronous Cooperative Online Learning for Multi-Robot Control under Computational Delays

Aug 2026 · 0 citations · 38 references
Computer Science Engineering

TL;DR

This work proposes an asynchronous cooperative learning strategy that explicitly accounts for prediction accuracy, query point variations and delay effects, and a distributed control law based on an adjoint MAS is developed to ensure the desired control performance.

Abstract

Ensuring the safe operation of multi-agent systems (MASs) under uncertain environments is crucial for cooperative robotic, where external disturbances and inaccurate dynamic models can significantly compromise performance and reliability. To address this challenge, calibrated machine learning models, particularly Gaussian process (GP) regression, are extensively employed due to their interpretable performance quantification. As the interconnected communication of MASs facilitates cooperative learning, agents are able to enhance learning performance by exchanging local GP inferences with their neighbors and aggregating the received information via distributed GP strategies. However, variations in computational power and prediction tasks among agents inevitably lead to heterogeneous computational delays and differences in query points, which are often overlooked in existing aggregation methods. To overcome these limitations, this work proposes an asynchronous cooperative learning strategy that explicitly accounts for prediction accuracy, query point variations and delay effects. Additionally, a distributed control law based on an adjoint MAS is developed to ensure the desired control performance. Simulations on unmanned surface vehicles validate the effectiveness of the proposed approach, demonstrating substantial improvements in both learning and control performance compared to the state-of-the-art approaches.

View source

Similar papers

Conference Aug 2026

Heterogeneous Multi-Agent Autonomous Learning and Safe Cooperative Decision-Making

Unmanned surface and underwater vehicles face challenges in autonomously learning cooperative encirclement for high-value targets under partial observability, intermittent communication, and collision risks. This paper proposes a heterogeneous multi-agent reinforcement learning framework with safe decisionmaking. The f...

Jiang-Li Cao, Chao Liu, Guo-Ping Zhang · 0 citations
Sep 2026

Efficient Communication With Skill Neurons in Decentralized Multi-Agent Reinforcement Learning.

CSN is proposed, which enables efficient Communication with Skill Neurons in decentralized MARL by exchanging the essential components of learned knowledge at neuron level by communicating only a sparse subset of model parameters and doing so intermittently.

Jiahua Lan, Li Shen, Ruijun Liu et al. · 0 citations
2026

Neural state estimation and optimization synthesis of flocking control for mobile robots swarm under uncertainty

The authors propose a method that integrates a learned state estimator based on a fully connected neural network, approximating the particle filter with simultaneous uncertainty evaluation, and an optimization regulator with a control barrier function and a control-Lyapunov function that ensures accuracy comparable to...

S. Kondratev, N. Kazyura, V. Meshcheryakov · 0 citations
Conference Aug 2026

Distributed Reinforcement Learning for Cooperative UAV-UGV Formation Control with Multirate Dynamics

Coordinating heterogeneous aerial and ground vehicles with fundamentally different dynamic time-scales is a longstanding challenge in multi-agent robotics. This paper proposes a distributed reinforcement learning (DRL) framework for cooperative Unmanned Aerial Vehicle (UAV) and Unmanned Ground Vehicle (UGV) formation c...

Sankara Rao Allada, P. Palpandi, J. G. B. Patturose et al. · 0 citations
Preprint Sep 2026

Graph-Based Safe Reinforcement Learning for Multi-Agent Systems with Time-Varying Topology

A graph-based safe multi-agent reinforcement learning (MARL) framework for cooperative navigation with time-varying topology is presented, integrating a attention-based actor and a Graph Attention Network (GAT) centralized critic, enabling scale-insensitive policy learning under time-varying communication topologies.

Sizhe Xiao, Li-Jing Dong, Rui-Ting Bai et al. · 0 citations
Review Open access 2020

Collaborative Robot Coordination Using Multi-Agent Reinforcement Learning

It is concluded that MARL is a promising solution for future intelligent collaborative robotics and highlights future research directions including federated reinforcement learning, explainable AI, edge-based robotic intelligence, and adaptive swarm robotics for Industry 4.0 applications.

Suresh Babu Reddy, Anita Verma · 0 citations

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.