Nov 2026· ACM Interational Symposium on Mobile Ad Hoc Networking and Computing· 0 citations· 6 references
Computer Science
TL;DR
This paper proposes FrozenSFL, a resource-efficient SFL framework for collaborative fine-tuning of LLMs across heterogeneous edge devices, and introduces a server-side feature caching mechanism that reuses invariant features, allowing subsequent training epochs to proceed offline and reducing redundant computation and communication.
Abstract
Collaborative fine-tuning of large language models (LLMs) at the network edge enables privacy-preserving and personalized generative intelligence, but is constrained by the limited memory and compute resources of edge devices. Traditional approaches, such as split federated learning (SFL), partition models between devices and a server, requiring iterative exchanges of activations/gradients while the server manages multiple submodels. This leads to substantial communication overhead, high activation storage costs, and severe server-side memory pressure when scaling to massive heterogeneous devices. In this paper, we propose FrozenSFL, a resource-efficient SFL framework for collaborative fine-tuning of LLMs across heterogeneous edge devices. At its core, FrozenSFL strictly freezes device-side submodels to eliminate both deviceside backpropagation and server-to-device gradient transmission, thereby removing on-device activation storage requirements and downlink communication overhead. Building upon this design, we improve the framework in two aspects. First, we design a layerwise LoRA aggregation strategy to handle structural heterogeneity introduced by device-specific model partitioning and enable efficient server-side updates. Second, we introduce a server-side feature caching mechanism that reuses invariant features, allowing subsequent training epochs to proceed offline and reducing redundant computation and communication. We implement the FrozenSFL system as an asynchronous multi-threaded pipeline, which serves as our real-world testbed for evaluation. On the device side, forward computation and data transmission are decoupled via a producer-consumer mechanism. On the server side, a first-in-first-out scheduling strategy serializes fine-tuning tasks across devices. A hybrid memory-disk streaming mechanism further buffers incoming data and ensures stable training under network variability. Extensive evaluations with representative models, including BERT-Base (0.11B), ViT-Large (0.3B), and LLaMA-2-7B (7B), validate the effectiveness of FrozenSFL. In particular, for LLaMA-2-7B, FrozenSFL can reduce device/server VRAM footprint by up to 14%/82.7% with only 1% accuracy loss, while achieving up to 6.7× fine-tuning speedup.
This review examines four composable routes---parameter-efficient and quantized adaptation, backpropagation-free adaptation, proxy or submodel adaptation, and split federated adaptation---through a common framework that traces the objects each endpoint retains, exchanges, and discloses.
Yun-Heng Shen, Xiao Liu, Yang Yang et al.· Journal of Reliable and Secu...· 1 citation
An integrated framework that combines LLM fine-tuning using federated adaptive local low-rank adaptation (FedALoRA) with forecasting-driven autoscaling policies is proposed, making it well-suited for federated-LLM Autoscaling in dynamic edge environments.
Large language models (LLMs) are increasingly constrained by the scarcity of high-quality public data, making private data essential for further improvement. However, private data is typically distributed across resource-constrained devices and cannot be shared due to strict privacy requirements, rendering conventional...
Yi-Ming Chen, Nan He, Zheng Jiang et al.· Proceedings of the 35th ACM...· 0 citations
Large language models (LLMs) trained on vast amounts of data have demonstrated impressive performance over a range of tasks, but future performance gains will require increasing amounts of data and compute. Federated Learning (FL) facilitates training on decentralized private data, but client resource limitations can m...
G. Legate, Rahaf Aljundi, Eugene Belilovsky· 0 citations
Pervasive intelligent applications are increasingly deployed on mobile and Internet of Things (IoT) edge devices. Consequently, Large Language Models (LLMs) are increasingly used to support these applications. Yet, due to their high resource demands, LLMs are mostly deployed in the cloud. Layer-wise edge-cloud inferenc...
Jing-Po Xu, Paul Joe Maliakel, Ivona Brandić et al.· 0 citations
This work addresses leakage through a learned obfuscate-and-recover scheme that protects participants' private datasets while still allowing an independently deployable model to be trained on the server side, making split-based federated LLM fine-tuning practically viable.
Heng Jin, Chao-Yu Zhang, He-Xuan Yu et al.· 1 citation
A weeklong summer workshop brought higher education faculty to campus to explore how AI and machine learning materials can be adapted for their classrooms.
MIT News · Artificial Intelligence· news.mit.eduAug 27, 2026
A new machine-learning framework aims to improve the success rate of computational protein design while moving away from results that reproduce sequences found in nature.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.