Skip to content

A Spatiotemporal Coupling-Based Clustered Federated Learning Scheme for Low Latency Digital Twin Within Heterogeneous IIoT

Sep 2026 · IEEE Internet of Things Journal · Vol 13, pp. 39610-39625 · 0 citations · 55 references

Abstract

Data-driven deep learning (DL) techniques have increasingly been employed to construct digital twin (DT) models for the intelligent industrial Internet of Things (IIoT) systems. Within DTs, federated learning (FL) offers a decentralized framework that enables distributed entities to collaboratively update global models without sharing raw data. Clustered FL (CFL) further enhances training efficiency by grouping clients, thereby reducing communication overhead and accelerating model convergence. However, data heterogeneity arising from spatial distribution differences and system heterogeneity, resulting in straggler clients, jointly hinder the convergence and efficiency of CFL. The interplay of these factors introduces spatiotemporal coupling, which further degrades model training. To address these challenges, we propose a spatiotemporal coupling-based CFL scheme that jointly optimizes client clustering and aggregation strategies to minimize overall training latency. A semisynchronous aggregation mechanism is introduced, allowing clients to update at different frequencies based on their delay tiers. Furthermore, client clustering is performed according to location similarity to improve convergence, while clients with higher delay tiers and greater data diversity are prioritized for cluster head selection. To mitigate the impact of imbalanced cluster sizes under data heterogeneity, a balanced matching optimization is formulated to evenly distribute remaining clients to the nearest cluster heads. Within each cluster, adaptive bandwidth allocation is employed to satisfy delay-tier constraints and shorten communication rounds. Extensive simulations on CIFAR-10 and Fashion-MNIST with nonindependent and identically distributed settings show that the proposed scheme can reduce the total training latency by up to 38.71% and 8.87%, respectively, to reach a fixed target accuracy, while achieving comparable model accuracy to existing baselines. These results confirm the effectiveness of the proposed scheme in heterogeneous IIoT environments.

View source

Similar papers

Preprint Aug 2026

Dual-Layer Over-the-Air Federated Learning in LEO Satellite Networks: Architecture, Key Technologies and Applications

This article outlines the fundamental principles of the dual-layer OTA model and introduces the adaptive BH mechanism designed for time-varying topologies, aiming to provide insights for the evolution of ubiquitous non-terrestrial intelligence.

Zhendong Li, Shaojie Wang, Zhou Su et al. · 0 citations
Preprint Jul 2026

GQ-FSL: Green Quantized Federated Split Learning Framework for Wireless Edge Networks

A green quantized FSL (GQ-FSL) framework that incorporates stochastic quantization for both local collaborative training and wireless transmissions and enables large-scale DNN deployment on resource-constrained devices, achieving superior energy efficiency compared to quantized federated learning and full-precision FSL.

Idan Roth, L. Lampe · 0 citations
Conference Jul 2026

Metadata Clustering-Driven Federated Learning for Multi-Domain Virtual Network Function Scaling

In multi-domain networking, virtual network function (VNF) scaling using machine learning requires an accurate prediction model while addressing privacy constraints and non-identical and independently distributed (non-IID) data across domains. Current models have used conventional federated learning (FL) methods, such as federated averaging (FedAvg), yet they suffer from degraded performance due to heterogeneous traffic patterns in multi-domain networks. However, existing studies have not addressed the impact of non-IID characteristics on FL-based VNF scaling or developed an effective solution to mitigate it. This paper proposes a metadata-clustering-driven FL method that clusters domains with different traffic patterns and trains cluster-specific models. We extract statistical, spectral, and temporal features to represent traffic disturbance. We apply principal component analysis (PCA) followed by K-means clustering to group time series. We apply FedAvg within clusters to train cluster-specific prediction models. To evaluate the performance of the proposed method, we set up a testbench to synchronize three non-IID patterns. The numerical results demonstrate that the proposed clustered FL method consistently achieves a lower mean squared error (MSE) than the FedAvg baseline across all four evaluated non-IID settings. The proposed method yields an MSE of 0.7056 (a 23.1% reduction from FedAvg’s 0.9176) under label skew, 0.3615 (a 4.6% reduction from 0.3790) under label and feature skew, 0.6958 (a 28.1% reduction from 0.9682) under label and quantity skew, and 0.3748 (a 0.7% reduction from 0.3774) under the combined skew setting. These consistent reductions in MSE demonstrate that the proposed method effectively mitigates the performance degradation typically caused by non-IID effects.

Run-Yu Wang, Eiji Oki · 0 citations
2026

When Split Federated Learning Meets Prototype Learning: A Communication-Efficient Approach in Wireless Networks

Nowadays, split federated learning (SFL) has emerged as an effective paradigm for enabling privacy-preserving collaborative intelligence across heterogeneous devices with limited computation. However, SFL incurs significant communication overhead in wireless networks due to the uplink transmission of high-dimensional smashed data, which degrades network efficiency. To mitigate the communication bottleneck, we propose a prototype-based SFL framework ProtoSFL. Specifically, each selected client computes local prototypes for observed classes and uploads them to the server. Based on the received prototypes, the server derives global prototypes and optimizes a weighted objective that combines classification loss with prototype alignment loss. The server then updates the model accordingly and returns personalized prototype gradients to the clients. Simulation results verify the effectiveness of ProtoSFL in reducing communication overhead, achieving a substantial reduction in uplink communication, while maintaining competitive testing accuracy under various heterogeneous data settings compared with SFL baselines.

Xinran Zhang, Xianke Qiang, Weilong Chen et al. · 0 citations
Preprint Aug 2026

Hierarchical Multi-Task Federated Learning in VANETs

Vehicular Ad hoc Networks (VANETs) increasingly rely on federated learning (FL) to enable collaborative intelligence without sharing raw sensory data. However, most existing vehicular FL frameworks assume that all vehicles train a single global model for a common task, which limits their applicability in practical vehicular environments where vehicles may perform heterogeneous learning tasks under non-independent and identically distributed (non-IID) data, intermittent connectivity, and high mobility. To address these challenges, this paper proposes an AutoEncoder-based Reliability-Optimized Hierarchical Multi-Task Federated Learning (AERO-HMTFL) framework for dynamic multi-hop clustered VANETs. The proposed framework introduces a tri-weighted clustering metric that jointly considers vehicular mobility, shared-model similarity, and task affinity to produce mobility-stable, semantically aligned clusters. Each vehicle employs a split-model architecture comprising a shared autoencoder-based representation module and multiple task-specific heads, with only the shared autoencoder parameters exchanged while the task heads remain local. To improve robustness, cluster heads perform reliability-aware aggregation based on historical validation performance and participation frequency, while the Evolved Packet Core (EPC) conducts global shared-autoencoder fusion across clusters. Extensive simulations demonstrate that, compared with the multi-task federated learning benchmarks, AERO-HMTFL achieves up to 13% higher sustained EPC-level accuracy, exhibits more stable learning dynamics, and reduces EPC-level packet transmissions by approximately 87-97%. Under short-range connectivity, it also requires approximately 13-29% fewer communication rounds to converge.

G. S. M. I. M. Saeid HaghighiFard, Fellow Ieee Sinem Coleri, M. S. HaghighiFard · 0 citations

Related blog posts

MIT News · Artificial Intelligence Aug 27, 2026

Looking beyond natural sequences

A new machine-learning framework aims to improve the success rate of computational protein design while moving away from results that reproduce sequences found in nature.