The heterogeneous nature has been regarded as a predominant challenge during the deployment of federated learning (FL) systems, wherein model heterogeneity—where clients train models of fundamentally different architectures—remains underexplored. Existing methods tolerate it poorly: they enforce interdependent model families, extract sub-models of one shared model, or rely on auxiliary public datasets and proxy models, which constrain model selection or demand storage that resource-limited clients cannot afford. We posit that an effective bridge across heterogeneous models should be both model-agnostic—decoupling knowledge transfer from incompatible parameter spaces—and storage-free, staying practical for clients with sharply different resources. On this basis we propose FedGPA, a hierarchical framework in which clients with comparable resources and identical architectures form a group and a server mediates knowledge transfer across groups of diverse models; at its core, the lightweight, model-agnostic Aligned Co-decision (Alco) Unit aligns class-level prototypical information across groups to bridge heterogeneous architectures, and a prototypical fusion step interpolates prototypes to regularize local training and refine cross-group knowledge. Experiments on CIFAR-10/100, EMNIST, and Tiny-ImageNet across heterogeneous architectures show that FedGPA consistently outperforms strong baselines from four method families, with the largest gains on resource-poor clients, at a cost of only ~100 KB of additional cross-group communication per round. A limitation of this study is that we provide no formal differential-privacy guarantee for the exchanged prototypes and do not address adversarial or data-quality attacks, leaving both to future work.
Liyinglan Liu, Zikai Xiao, Zihan Chen et al.· Journal of Machine Learning...· 0 citations
Embodied agent teams powered by heterogeneous large language models (LLMs) are being widely deployed in physical artificial intelligence such as smart factories, warehouses, and service robotics. To enable collaboration among such an agent team, efficient coordination mechanisms that operate reliably under limited network resources are required. However, existing heterogeneous LLM-agent coordination frameworks that rely on multi-round natural-language-based conversations introduce three coupled challenges. First, inter-agent dialogue incurs communication overhead that grows rapidly with team size. Second, the quality of coordination is constrained by the heterogeneous capabilities of the agent team's LLMs. Third, agents may suffer from action delays due to iterative negotiation. To address these challenges, we propose LDT-Coord, a networked coordination framework built upon a lightweight digital twin (DT). Specifically, each agent independently selects its intended action and reports both the action decision and a structured temporal constraint over shared resources to the DT server, thereby decoupling coordination performance from natural-language reasoning ability. Then, DT executes a training-free, rule-based orchestrator algorithm to resolve cross-agent conflicts and returns coordination instructions to prevent such conflicts. To further reduce communication overhead, we formulate agent reporting control as a constrained partially observable Markov decision process (C-POMDP) and solve it with the PPO-Lagrangian algorithm. Simulation results show that LDT-Coord achieves a task success rate comparable to conventional coordination methods while reducing communication overhead by more than 70x and maintaining robustness under LLM heterogeneity.
Nuocheng Yang, Sihua Wang, Zihan Chen et al.· 0 citations
The rapid advancement of sixth-generation (6G) networks is accelerating the convergence of media intelligence and communication intelligence, driving media communication beyond conventional bit-level delivery toward intelligent, semantic-aware, and generative paradigms. Emerging media services require not only high data rates and low latency, but also semantic awareness, perceptual quality assurance, adaptive resource orchestration, trustworthy content processing, and personalized media generation. Meanwhile, media technologies are evolving from handcrafted signal processing and conventional coding toward artificial intelligence (AI)-driven representation learning, content understanding, and generative reconstruction. Motivated by these trends, this paper presents a systematic survey of media communication technologies for 6G vision communication by revisiting the evolution of communication and media technologies and clarifying the intrinsic relationship between media content processing and wireless transmission. We introduce a unified framework consisting of four key dimensions: AI-driven media technologies, media-aware wireless transmission, large model-enabled media communication, and intelligent network infrastructures. Specifically, AI-driven media technologies encompass media coding, content understanding, quality assessment, security and compliance detection, and AIGC-enabled media generation, while media-aware wireless transmission is examined from three complementary perspectives: semantic joint source-channel optimization, which jointly encodes task-relevant semantic information; source-aware transmission optimization, which leverages media characteristics for channel adaptation, prediction, and compensation; and channel-aware source optimization, which adapts media coding and reconstruction based on real-time channel conditions.
Bingyan Xie, Longyu Zhou, Zihan Chen et al.· 0 citations
Federated learning (FL) applications normally employ large deep learning (DL) models, resulting in excessive communication overhead in the deployment of FL over resource-constraint mobile edge networks. To achieve better scalability for DL-based FL, we capitalize on both the asymmetric nature of mobile networks and the distinct effects of partial transmissions on FL training for the global and local models. We propose Fed-DynAmal, an FL framework that decreases the number of parameters transmitted in the uplink (clients-to-server) while concurrently achieving better model performance. The underlying idea is that each selected client sends a partial DL model to the server by omitting several sub-blocks from the trained local model. Crucially, we drop the assumption that transmitted local models can still be used for inference, thereby allowing for greater model variability. At the server, we introduce amalgamation, a process to merge different partial local models into an inference-viable full model. Essentially, amalgamation is a bridge for performing aggregation at the sub-block level. Interestingly, as the key takeaway, communication efficiency versus model performance is not necessarily a trade-off in FL: Our extensive experiments show that Fed-DynAmal can effectively improve communication efficiency while still concurrently achieving higher accuracy and enhanced robustness.
Zihan Chen, H. Yang, Tony Q. S. Quek et al.· IEEE Transactions on Cogniti...· 0 citations
