A dedicated review of WPFMs from learning design to practical deployment, covering the theoretical background, the neural architectures used for wireless signals, the self-supervised pretraining paradigms of masked modeling, contrastive learning, and generative pretraining, and the fine-tuning strategies that adapt pretrained models to downstream tasks.
Abstract
Foundation models, i.e., large neural networks pretrained on broad unlabeled data and adapted to many downstream tasks, have reshaped natural language processing and computer vision and are now being explored for the wireless physical layer. Wireless Physical-Layer Foundation Models (WPFMs) aim to learn transferable representations of signals such as channel state information (CSI), in-phase and quadrature (IQ) samples, and spectrograms so that a single pretrained backbone can support tasks ranging from channel estimation and prediction to localization and sensing while using limited task-specific data. This paper provides a dedicated review of WPFMs from learning design to practical deployment. We first establish the theoretical background, covering the neural architectures used for wireless signals, the self-supervised pretraining paradigms of masked modeling, contrastive learning, and generative pretraining, and the fine-tuning strategies that adapt pretrained models to downstream tasks. We then introduce a taxonomy that organizes existing models along five dimensions: architecture family, input modality and tokenization, pretraining objective, model scale and deployment target, and generalization capability. Building on this basis, we review applications across telecommunications, localization, and sensing, and, for each domain, analyze deployment feasibility by mapping model size to the memory, compute, and latency budgets of representative wireless hardware. Finally, we discuss model compression and efficient deployment, summarize the cross-cutting challenges, and outline open research directions. Our goal is to provide a reference that connects pretraining, architecture, and fine-tuning with the practical constraints of wireless systems.
In wireless systems, foundation models have been proposed as alternative artificial intelligence models to replace task-specific models with a shared pretrained model that can be reused across many downstream applications (source separation, interference detection, localization, etc.). These wireless foundation models...
Mohammad Cheraghinia, Sebbe Van Der Smissen, Jaron Fontaine et al.· 0 citations
Wireless foundation models learn representations from unlabeled radio signals for reuse across downstream tasks. Scaling model capacity is a common strategy for learning richer representations and improving downstream performance. However, its gains are less consistent in wireless self-supervised learning when pretrain...
Ahmed P. Mohamed, Ahmed Aboulfotouh, Hatem Abou-Zeid· 0 citations
Wireless foundation models learn transferable channel state information (CSI) representations across heterogeneous wireless systems. However, conventional grid-aligned representations couple feature sequence length to CSI dimensions, restricting the allocation of representation capacity to different propagation conditi...
AI-enabled receivers offer a promising approach to adaptive physical-layer processing, but conventional neural receivers often require extensive offline training and computationally expensive backpropagation, limiting their suitability for low-latency cellular systems. Moreover, classical MIMO-OFDM receivers rely on ac...
Ummay Sumaya Khan, Li-Zhong Zheng, Ling-Jia Liu· 1 citation
Wireless foundation models learn reusable representations across tasks, configurations, and deployment environments. Their pretraining requires environmental breadth, yet wireless datasets often sample few sites densely. We introduce Channels4World, a scene-centered dataset of 100,000 distinct outdoor RF scenes and a p...
J. Jang, Hyung-Joo Moon, Kwang Soon Kim et al.· 0 citations
Distributed acoustic sensing (DAS) transforms optical fibres into dense arrays of vibration sensors for continuous, long-range monitoring with high spatial resolution. Yet converting these large-scale measurements into actionable information with compact models that retain task performance remains challenging. Existing...
Yuan Gao, Yu Tao, Xuzhe Zhang et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.