Skip to content
Preprint

More Interactions Make Communications More Efficient: A Directed Information Bottleneck Approach to Task-Oriented Communication

Oct 2026 · 0 citations
Computer Science Mathematics

TL;DR

Experiments demonstrate that VDIB-JSCC achieves higher classification accuracy with less transmitted information than state-of-the-art semantic communication methods and show that leveraging historical knowledge enables task completion with less information, improving communication efficiency.

Abstract

Task-oriented communication improves communication efficiency by transmitting semantic information required for downstream tasks, but may incur redundancy with previously transmitted information. To address this issue, we propose a variational directed information bottleneck joint source-channel coding (VDIB-JSCC) framework that transmits only previously unacquired information. Specifically, we use directed information to characterize the causal flow of task-relevant incremental information and theoretically demonstrate its advantages over mutual information and conditional mutual information. Based on this metric, we formulate a directed information bottleneck (DIB) objective that balances task-relevant information preservation and redundant information compression. We further derive a variational formulation, termed VDIB, whose tractable upper bound serves as the training loss. The encoder integrates a Vision Transformer for frame-wise semantic extraction and a Mamba-based causal state-space model for capturing temporal dependencies and extracting incremental information, while the decoder uses a Mamba-based state-space model for task inference. Experiments on CIFAR-10 and CIFAR-100 video streams demonstrate that VDIB-JSCC achieves higher classification accuracy with less transmitted information than state-of-the-art semantic communication methods. These results show that leveraging historical knowledge enables task completion with less information, improving communication efficiency.

View source

Similar papers

Book Open access Oct 2026

TACToC: Enabling Task-Adaptive Communication System with a Task-Describable Encoder

Task-oriented communications (ToC), also known as semantic communications, offers a promising paradigm for offloading deep neural network (DNN) inference from edge devices to more powerful remote servers. By transmitting only task-specific information, ToC significantly reduces the communication overhead inherent in co...

Huijeong Choe, Minjae Lee, Wooseung Nam et al. · 0 citations
Preprint Oct 2026

Synergy-Aware Symbol Allocation for Distributed Semantic Communication

Distributed semantic communication enables spatially separated terminals to support collaborative inference over wireless links for 6G edge intelligence. In multimodal sensing and cooperative perception, a single terminal captures only a partial view, and full task semantics emerge only when complementary observations...

Fan Gao, You-Zheng Wang, Zhi-Jin Qin et al. · 0 citations
#machine learning Preprint Oct 2026

Recursive Code Evolution for Task-Oriented Semantic Communications

Semantic communication jointly optimizes inference accuracy, channel use, and computation, yet the underlying communication program is typically specified before training. This paper presents ComRSI (Communications-Oriented Recursive Self-Improvement), a framework for recursively evolving that program through large-lan...

Yan Gong, Z. Chu, Wei-Ran Chai et al. · 0 citations
Preprint Nov 2026

MirrorComm: A Communication-Efficient Cooperative Perception Framework via Mirrored World Models

Cooperative perception (CP) requires substantial communication bandwidth to exchange sensing information among connected agents. A variety of compression techniques have been proposed to reduce transmission costs while retaining task-relevant information. However, most existing methods follow a frame-wise compression p...

Sheng-Hang Luo, Yin Xu, Ci-Xiao Zhang et al. · 0 citations
Sep 2026

Source Entropy-Guided Adaptive Transmission for Communication-Driven Multi-View Sensing

Communication-driven multi-view sensing relies on routine communication transmissions for sensing acquisition, while the resulting sensing data at distributed devices must be uploaded to an edge server under limited communication resources. This creates a unique coupling between sensing acquisition and edge inference:...

Ming-Jie Yang, Guang-Ming Liang, Dong-Zhu Liu et al. · 0 citations

Attention-based Hierarchical Variational Information Bottleneck for Robust Multi-Agent Communication under Variable Bandwidth

This work proposes AH-VIB, an attention-based autoregressive variational communication model that combines a variational information bottleneck (VIB) with sequential message generation and a hierarchical robustness loss, and evaluates it on a custom cooperative object-inspection and occupancy-mapping task.

Lukas Koch Vindbjerg, Qi Zhang, Yury Brodskiy et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.