Skip to content

Robust Spiking Neural Networks by Temporal Mutual Information

· 0 citations · 49 references

TL;DR

This work revisits SNN robustness from an information-theoretic perspective and reveals the pivotal role of temporal characteristics, and proposes a Temporal Mutual Information (TMI) regularizer that explicitly exploits temporal characteristics to enhance robustness.

View source

Similar papers

Preprint Aug 2026

Noisy group neurons with synchronous resetting for high-performance spiking neural networks

This work proposes a noisy group neuron (NGN) model, which incorporates population-level synchronous resetting and neural stochasticity as fundamental computational mechanisms, and develops the NGN method as a framework that combines the NGN model with backpropagation learning based on mean-field dynamics.

Yajie Zhai, Yanmei Kang, Meng Li et al. · 0 citations
Open access Aug 2026

Why temporal spike order reversal drops spiking network accuracy and how to partially mitigate it

This study identifies a critical vulnerability in SNNs on recently established bit-based codes: consistent performance degradation when temporal spike encoding orders are reversed, and measures the per-timestep class-mutual-information profile of six encodings directly and shows that the resulting concordance ordering predicts the observed degradation.

N. T. Luu, Trung Duong Trung Luu, N. Pham et al. · 0 citations
Aug 2026

OT-SAN: One Timestep Spiking Actor Network With Mask-Adaptive Global Connection and Dynamic Thresholds

Spiking neural networks (SNNs) have garnered significant attention in reinforcement learning tasks for their low power consumption. However, traditional spiking reinforcement learning (SRL) methods, which rely on local-connected encoding and fixed-threshold learning, struggle to capture the inter-dimensional correlations of input information within short timesteps, limiting the network’s expressive capacity at low timesteps. While increasing timesteps can significantly enhance performance, excessive timesteps result in substantial delays. To address this contradiction and enhance the expressive and decision-making capabilities of SNNs within short timesteps, we propose Mask-Adaptive Global Connection (MAGC), a novel encoding method that efficiently captures long-range dependencies via sparse, adaptively masked connections—enabling global feature interaction in a single timestep. Additionally, dynamic-threshold spiking neurons are introduced to effectively capture and distinguish subtle changes in input signals at each timestep, thereby enhancing the spatial-temporal state representation during spike information transmission. Extensive experimental results demonstrate that the proposed method achieves performance comparable to state-of-the-art algorithms using only a single timestep, while significantly reducing inference latency and energy consumption. When extended to multiple timesteps, our approach consistently outperforms existing methods, showing substantial improvements across eight continuous control tasks from OpenAI Gym.

Rong Xiao, Zhiyuan Hu, Ping He et al. · 0 citations
Open access Aug 2024

PMSN: A Parallel Multi-Compartment Spiking Neuron for Multiscale Temporal Processing.

The proposed parallel multi-compartment spiking neuron (PMSN) presents a promising solution to harness the computational advantages of detailed biological neurons, enabling high-performance and efficient temporal processing on neuromorphic computing systems.

Xinyi Chen, Jibin Wu, Chenxiang Ma et al. · 16 citations · ⚡4