Skip to content

QoS-Aware Federated Learning for Multimodal In-Cabin Interaction in Smart Vehicles

Sep 2026 · arXiv.org · Vol abs/2609.20123 · 0 citations · 30 references
Computer Science

TL;DR

FedQoS is proposed, a novel asynchronous, event-triggered FL framework that decouples local computation from global communication via a two-phase gating mechanism that achieves competitive personalized accuracy with only marginal performance loss compared to FedAvg, while substantially reducing QoS violations.

Abstract

Modern smart vehicles leverage multimodal sensors, ranging from high-bandwidth vision systems to low-rate physiological monitors, to provide personalized in-cabin services. However, integrating high-fidelity multimodal fusion with collaborative training is often hindered by the heterogeneous and time-varying Quality of Service (QoS) constraints of vehicular networks. Standard Federated Learning (FL) approaches enforce rigid synchronous rounds that fail to account for these resource asymmetries, leading to safety-critical timing violations and energy exhaustion. In this paper, we propose FedQoS, a novel asynchronous, event-triggered FL framework that decouples local computation from global communication via a two-phase gating mechanism. First, we introduce a resource-aware training gate that initializes local learning only when sensing buffers and energy reserves meet safety thresholds, preventing ML tasks from compromising core vehicle mobility. Second, a QoS-aware transmission policy gates uplink updates based on an efficiency score that balances model novelty against instantaneous latency and energy costs. Locally, clients optimize an objective featuring a staleness-aware proximal term that dynamically adjusts the global anchor strength based on update age. Extensive experiments on multimodal vehicular datasets demonstrate that FedQoS achieves competitive personalized accuracy with only marginal performance loss compared to FedAvg, while substantially reducing QoS violations, cutting communication overhead by 76.7\%, and lowering latency cost by 26.0\%, demonstrating a highly favorable accuracy and efficiency balance for real-world vehicular deployments.

View source

Similar papers

#federated learning Open access Sep 2026

Significance-Aware Federated Reinforcement Learning for AoI Optimization of Vehicular Sensing in UAV-Assisted Edge Networks

The effectiveness of CHFAC for freshness-aware vehicular sensing in dynamic UAV-assisted edge environments is demonstrated and the proposed collaborative heterogeneous federated actor–critic framework is proposed.

Xue-Yuan Wang, Si-Yu Bai, Yu Zhang et al. · 0 citations
Open access 2026

Maximizing Accuracy-Per-Cost in Vehicular Federated Learning via Active Inference and Two-Stage Resource Optimization

A unified framework to optimize accuracy per unit of utility in vehicular FL, combining learning-based global coordination with lightweight analytical local control is proposed, providing a practical and scalable tradeoff between adaptability, efficiency, and implementation complexity.

Xiang-Qing Su, Yan Huo, Zi-Han Chen et al. · 0 citations
Open access Aug 2026

Distributed Decision-making System for Intelligent Connected Vehicles Based on Federated Learning

Evaluated in the most challenging scenario characterized by maximum vehicle density, dynamic communication delays, packet loss, severe data Non-IIDness, and complex multi-intersection interactions, the proposed method demonstrates superior collaborative performance.

Y. Zhao, Zeng-Wei Guan, W.-Q. Wang et al. · 0 citations
Open access 2026

Delay-Driven Vehicle Scheduling and Resource Optimization for Multi-Task Federated Learning in Heterogeneous Vehicular Networks

Federated learning (FL) has become a promising paradigm for privacy-preserving and communication-efficient model training in vehicular networks. With the continuous expansion of vehicular networks, multiple FL tasks are often initiated concurrently by moving vehicles, which poses substantial challenges to the conventio...

Xiao-Na Jiang, Jie Tian, Tian-Tian Li et al. · 0 citations
Review Open access 2026

Predictive Quality of Service in Vehicular Communication Systems Models, Datasets, and Open Challenges

This survey provides a structured review of QoS prediction approaches spanning machine learning, deep learning, reinforcement learning, protocol-level evaluation, and security-trust mechanisms, and outlines promising research directions for developing adaptive, explainable, and privacy-preserving QoS prediction models...

Parita Patel, Mahesh M. Goyani · 0 citations

Related blog posts

MIT News · Artificial Intelligence Nov 17, 2026

Learning the language of machine learning

By studying the computational foundations of language learning, Associate Professor Jacob Andreas builds intelligent systems that can communicate effectively with humans.

Microsoft Research Blog Nov 16, 2026

TokenEconomizer: Learning from Experience to Make AI Coding Agents More Efficient

AI coding agents are increasingly help developers fix bugs and build features largely on their own, but every interaction with their models consumes tokens. In each session, an agent sends instructions, tool descriptions, and session history to its model. Most efforts to reduce this cost focus on individual tasks. Yet developers return to the same […] The post TokenEconomizer: Learning from Experience to Make AI Coding Agents More Efficient appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.