This paper studies the fast and high-performance FA reconfiguration for low-altitude FA networks with multi-agent reinforcement learning (MARL) and presents an electromagnetic digital twin (EM-DT)-assisted MARL framework to fill the sim-to-real gap.
Abstract
Low-altitude wireless networks (LAWNs) integrate terrestrial and aerial platforms to provide ubiquitous communication, sensing, and localization services for unmanned aerial vehicles (UAVs) and electric vertical takeoff and landing (eVTOL) aircraft. However, dynamic air-ground and air-air channels, abrupt blockages, and heterogeneous interference hinder the realization of this goal. Nevertheless, fluid antenna (FA), a cutting-edge multiple-input multiple-output (MIMO) technique, overcomes these challenges by reconfiguring antenna positions to unlock additional spatial degrees-of-freedom. In this paper, towards bringing low-altitude FA networks into reality, we study the fast and high-performance FA reconfiguration for low-altitude FA networks with multi-agent reinforcement learning (MARL). Specifically, we present an electromagnetic digital twin (EM-DT)-assisted MARL framework. To fill the sim-to-real gap, we introduce a two-stage transfer learning framework. Our case study shows that joint FA positions and beamforming optimization can enhance the system sum-rate by 118.5%, compared to the fixed position baseline. This gain comes from the dynamic millisecond timescale reconfiguration of FA arrays and the adaptive steering of beams toward aerial users with mobility.
This work proposes a hierarchical hybrid large language model- multi-agent reinforcement learning (MARL) architecture organized as a dual-loop structure that facilitates coordinated coexistence among heterogeneous services, adapting to evolving operating conditions without retraining the underlying MARL policies.
Q. D. M. Nguyen, Chang Liu, Shuang-Yang Li et al.· 0 citations
Low Earth orbit (LEO) satellite-terrestrial communication systems grapple with significant challenges posed by their inherent dynamism and substantial transmission delays. To address these critical issues, this paper proposes a novel hybrid-medium transmission optimization framework that leverages high-altitude platfor...
Yi Huang, Jin Li, Yan-Wen Zhu et al.· IEEE Transactions on Communi...· 0 citations
Ensuring QoS provisioning in low-altitude wireless networks requires UAV positioning and navigation strategies that adapt to dynamic environments and generalizes across heterogeneous network scenarios. This paper proposes a digital twin (DT)-assisted meta reinforcement learning framework for multi-agent UAV trajectory...
Jiayuan Huang, E. Tucker, Ruozhou Yu et al.· International Conference on...· 0 citations
A multi-agent deep reinforcement learning (MADRL) methodology based on the Multi-Agent Proximal Policy Optimization (MAPPO) approach, which simultaneously achieves high field coverage completeness, robust communication energy efficiency, and a high depot-return rate under hard battery constraints without any inter-UAV...
Rapid advances in drone technology, combined with the growing congestion of terrestrial transport networks, are driving the emergence of the low-altitude economy. Uncrewed Aerial Vehicles (UAVs) are increasingly deployed for low-altitude economy applications such as urban logistics and transportation, yet their expansi...
Tianle Li, Peixi Peng, Qingyu Liu et al.· IEEE Transactions on Cogniti...· 0 citations
A lightweight hybrid optimization framework that combines transfer learning and a pre-trained deep neural network with a Monte Carlo Tree Search (MCTS)-based decision-making component to improve the efficiency of multi-agent UAV communication is suggested.
Anantha Babu Shanmugavel, Arjun Kidavunil Paduvilan, E. Mariappan et al.· IEEE Open Journal of the Com...· 0 citations
Machine-learning networks can learn without detailed instructions from a designer. Those that do may offer insight into how the brain reorganizes itself during learning.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.