A configurable AI-driven framework to achieve generalizable and computational efficient channel extrapolation from a modular perspective is proposed, which assumes that CSI correlations can be captured by a small number of specialized functional modules (experts) that are activated differently across scenarios.
Abstract
Acquiring channel state information (CSI) with manageable overhead has been essential to provide high-performance communication services, which is extremely challenging in the emerging sixth generation (6G) mobile network. Channel extrapolation has been proposed to infer complete CSI using a small portion of known CSI, its performance can be dramatically enhanced by artificial intelligence (AI). However, AI-driven channel extrapolation suffers from poor generalization across scenarios and high computational complexity, which is common in the broad research of AI and large language models. Inspired by the modular function of human brain, we propose a configurable AI-driven framework to achieve generalizable and computational efficient channel extrapolation from a modular perspective. We propose a three-stage framework, consisting of experts emergent, experts construction and experts selection. This framework assumes that CSI correlations can be captured by a small number of specialized functional modules (experts) that are activated differently across scenarios. Such modularity emerges in the experts emergent stage via pre-training using CSI data covering comprehensive scenarios. The neurons with similar weight-space patterns are grouped as experts in the experts construction stage. A lightweight gating function is added to control the routing of experts and is fine-tuned for each scenario in the experts selection stage. Simulation results demonstrate that the proposed three-stage framework reduce the channel extrapolation error and computational complexities dramatically by $1.1-19.1$ db and $38$ \%, respectively. In addition, attributed to the proposed experts emergent and section modules, the proposed framework outperforms its counterpart mix-of-expert model dramatically in terms of channel extrapolation performance.
Large language models (LLMs) have become increasingly capable of generating code. However, achieving stronger code-generation performance still often relies on costly model adaptation, i.e., fine-tuning pretrained model parameters. Prior studies have shown correspondence between human code processing and neural models'...
Yue-Ke Zhang, Zi-Han Fang, Kevin Leach et al.· 0 citations
This work proposes the ADaptive with Prescriptive Timescales Network (ADPTNet) as a potential solution to achieving all four properties simultaneously, and introduces a neuromorphic SpikingADPTNet, which achieves a new state-of-the-art accuracy on the Spiking Speech Commands dataset.
Across visual recognition, vision-language understanding, ego-exo video understanding, and embodied vision-language-action learning, this method consistently improves learning under online and uncertain data streams, with gains exceeding 50 percentage points over replay-free alternatives in embodied manipulation.
Hong-Wei Yan, Kang-Lei Zhou, Qi-Hao Cheng et al.· 0 citations
Brain–Computer Interfaces (BCIs) enable direct neural interaction with external systems, yet their development is hindered by rigid software architectures that struggle to integrate emerging computational paradigms. This paper proposes CogniQ, a scalable Machine Learning Operations (MLOps) framework designed to provide...
Parth Gopakumar, Reena Moncy, Savio Winson et al.· International Workshop on Ar...· 0 citations
Brain signal decoding is challenging because neural recordings are noisy and vary across individuals, while labeled data are often limited. Recent attention-based models on the symmetric positive definite (SPD) manifold have nevertheless achieved strong performance using covariance and connectivity representations, yet...
It is argued that functional parameter identifiability may provide an organizing principle for models that systematically reuse and recombine learned functions while adapting only the components that need to change.
G. Chindemi, Benjamin Grewe· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.