Experiments demonstrate that VDIB-JSCC achieves higher classification accuracy with less transmitted information than state-of-the-art semantic communication methods and show that leveraging historical knowledge enables task completion with less information, improving communication efficiency.
Abstract
Task-oriented communication improves communication efficiency by transmitting semantic information required for downstream tasks, but may incur redundancy with previously transmitted information. To address this issue, we propose a variational directed information bottleneck joint source-channel coding (VDIB-JSCC) framework that transmits only previously unacquired information. Specifically, we use directed information to characterize the causal flow of task-relevant incremental information and theoretically demonstrate its advantages over mutual information and conditional mutual information. Based on this metric, we formulate a directed information bottleneck (DIB) objective that balances task-relevant information preservation and redundant information compression. We further derive a variational formulation, termed VDIB, whose tractable upper bound serves as the training loss. The encoder integrates a Vision Transformer for frame-wise semantic extraction and a Mamba-based causal state-space model for capturing temporal dependencies and extracting incremental information, while the decoder uses a Mamba-based state-space model for task inference. Experiments on CIFAR-10 and CIFAR-100 video streams demonstrate that VDIB-JSCC achieves higher classification accuracy with less transmitted information than state-of-the-art semantic communication methods. These results show that leveraging historical knowledge enables task completion with less information, improving communication efficiency.
Task-oriented communications (ToC), also known as semantic communications, offers a promising paradigm for offloading deep neural network (DNN) inference from edge devices to more powerful remote servers. By transmitting only task-specific information, ToC significantly reduces the communication overhead inherent in co...
Huijeong Choe, Minjae Lee, Wooseung Nam et al.· Proceedings of the 32nd Annu...· 0 citations
Distributed semantic communication enables spatially separated terminals to support collaborative inference over wireless links for 6G edge intelligence. In multimodal sensing and cooperative perception, a single terminal captures only a partial view, and full task semantics emerge only when complementary observations...
Fan Gao, You-Zheng Wang, Zhi-Jin Qin et al.· 0 citations
Semantic communication jointly optimizes inference accuracy, channel use, and computation, yet the underlying communication program is typically specified before training. This paper presents ComRSI (Communications-Oriented Recursive Self-Improvement), a framework for recursively evolving that program through large-lan...
Yan Gong, Z. Chu, Wei-Ran Chai et al.· 0 citations
Cooperative perception (CP) requires substantial communication bandwidth to exchange sensing information among connected agents. A variety of compression techniques have been proposed to reduce transmission costs while retaining task-relevant information. However, most existing methods follow a frame-wise compression p...
Sheng-Hang Luo, Yin Xu, Ci-Xiao Zhang et al.· 0 citations
Communication-driven multi-view sensing relies on routine communication transmissions for sensing acquisition, while the resulting sensing data at distributed devices must be uploaded to an edge server under limited communication resources. This creates a unique coupling between sensing acquisition and edge inference:...
Ming-Jie Yang, Guang-Ming Liang, Dong-Zhu Liu et al.· arXiv.org· 0 citations
This work proposes AH-VIB, an attention-based autoregressive variational communication model that combines a variational information bottleneck (VIB) with sequential message generation and a hierarchical robustness loss, and evaluates it on a custom cooperative object-inspection and occupancy-mapping task.