This work proposes an asynchronous cooperative learning strategy that explicitly accounts for prediction accuracy, query point variations and delay effects, and a distributed control law based on an adjoint MAS is developed to ensure the desired control performance.
Abstract
Ensuring the safe operation of multi-agent systems (MASs) under uncertain environments is crucial for cooperative robotic, where external disturbances and inaccurate dynamic models can significantly compromise performance and reliability. To address this challenge, calibrated machine learning models, particularly Gaussian process (GP) regression, are extensively employed due to their interpretable performance quantification. As the interconnected communication of MASs facilitates cooperative learning, agents are able to enhance learning performance by exchanging local GP inferences with their neighbors and aggregating the received information via distributed GP strategies. However, variations in computational power and prediction tasks among agents inevitably lead to heterogeneous computational delays and differences in query points, which are often overlooked in existing aggregation methods. To overcome these limitations, this work proposes an asynchronous cooperative learning strategy that explicitly accounts for prediction accuracy, query point variations and delay effects. Additionally, a distributed control law based on an adjoint MAS is developed to ensure the desired control performance. Simulations on unmanned surface vehicles validate the effectiveness of the proposed approach, demonstrating substantial improvements in both learning and control performance compared to the state-of-the-art approaches.
Unmanned surface and underwater vehicles face challenges in autonomously learning cooperative encirclement for high-value targets under partial observability, intermittent communication, and collision risks. This paper proposes a heterogeneous multi-agent reinforcement learning framework with safe decisionmaking. The f...
CSN is proposed, which enables efficient Communication with Skill Neurons in decentralized MARL by exchanging the essential components of learned knowledge at neuron level by communicating only a sparse subset of model parameters and doing so intermittently.
Jiahua Lan, Li Shen, Ruijun Liu et al.· IEEE Transactions on Pattern...· 0 citations
The authors propose a method that integrates a learned state estimator based on a fully connected neural network, approximating the particle filter with simultaneous uncertainty evaluation, and an optimization regulator with a control barrier function and a control-Lyapunov function that ensures accuracy comparable to...
S. Kondratev, N. Kazyura, V. Meshcheryakov· Proceedings in Cybernetics· 0 citations
Coordinating heterogeneous aerial and ground vehicles with fundamentally different dynamic time-scales is a longstanding challenge in multi-agent robotics. This paper proposes a distributed reinforcement learning (DRL) framework for cooperative Unmanned Aerial Vehicle (UAV) and Unmanned Ground Vehicle (UGV) formation c...
Sankara Rao Allada, P. Palpandi, J. G. B. Patturose et al.· International Conference on...· 0 citations
A graph-based safe multi-agent reinforcement learning (MARL) framework for cooperative navigation with time-varying topology is presented, integrating a attention-based actor and a Graph Attention Network (GAT) centralized critic, enabling scale-insensitive policy learning under time-varying communication topologies.
Sizhe Xiao, Li-Jing Dong, Rui-Ting Bai et al.· 0 citations
It is concluded that MARL is a promising solution for future intelligent collaborative robotics and highlights future research directions including federated reinforcement learning, explainable AI, edge-based robotic intelligence, and adaptive swarm robotics for Industry 4.0 applications.
Suresh Babu Reddy, Anita Verma· International Journal of Int...· 0 citations