Skip to content

SpikeLite: Lightweight Spiking Neural Networks for Time-Series Forecasting

Sep 2026 · arXiv.org · Vol abs/2609.35097 · 0 citations · 28 references
Computer Science

TL;DR

Spiking forecasting framework SpikeLite is introduced, a spiking forecasting framework built around two modules: a Frequency-Selective Spiking Encoder for frequency-sensitive temporal encoding and a Sparse Spiking Channel Attention (SSCA) module for selective cross-channel interaction.

Abstract

Spiking neural networks (SNNs) offer an energy-efficient paradigm for time-series forecasting through spike-driven computation. However, recent SNN forecasters often pursue higher accuracy through increasingly complex attention mechanisms, or specialized neuronal dynamics, weakening the lightweight motivation of SNNs. We introduce SpikeLite, a spiking forecasting framework built around two modules: a Frequency-Selective Spiking Encoder (FSSE) for frequency-sensitive temporal encoding and a Sparse Spiking Channel Attention (SSCA) module for selective cross-channel interaction. FSSE exploits the low-pass filtering behavior of LIF dynamics to reorganize each input sequence into frequency-sensitive components while collectively preserving the input at the decomposition stage. SSCA then learns a binary mask from encoded channel representations and uses it to selectively exchange information within spike-driven self-attention, retaining informative cross-channel interactions while suppressing redundant ones. When explicit channel interaction is unnecessary, SpikeLite uses the lighter FSSE-only channel-independent path. Experiments under the SeqSNN and SpikF protocols cover four standard multivariate and eight long-term forecasting benchmarks. SpikeLite achieves the best aggregate performance under both protocols, with an average $R^2$ of 0.790 and RSE of 0.440, and lowest average MSE/MAE of 0.343/0.345 in long-term forecasting. Moreover, evaluation on the ECL dataset shows that SpikeLite achieves the lowest reported energy consumption, further demonstrating its potential for energy-efficient time-series forecasting.

View source

Similar papers

Open access Aug 2026

Why temporal spike order reversal drops spiking network accuracy and how to partially mitigate it

This study identifies a critical vulnerability in SNNs on recently established bit-based codes: consistent performance degradation when temporal spike encoding orders are reversed, and measures the per-timestep class-mutual-information profile of six encodings directly and shows that the resulting concordance ordering...

N. T. Luu, Trung Duong Trung Luu, N. Pham et al. · 0 citations
Preprint Aug 2026

BASC : Behavior-Aligned Quantization and Pruning for Low-Bit Spiking Neural Networks

Extensive experiments on static and neuromorphic benchmarks show that lower-bit BASC models match or outperform higher-bit baselines and retain this accuracy advantage after structured pruning, while further reducing model storage and synaptic operations.

Linliang Chen, Yan Zhong, Xin Liu et al. · 0 citations
#machine learning Preprint Sep 2026

Predictive Suppression Layers for Communication-Efficient Spiking Neural Networks

This work introduces a minimal predictive coding framework for SNNs with two layer variants sharing a predictor block: error units, which transmit signed spiking residuals, and predictive suppression, which uses residual magnitude to dynamically gate and forward only unpredictable,"surprising"activity.

Aidin Attar, Michele Rossi · 0 citations
Aug 2026

OT-SAN: One Timestep Spiking Actor Network With Mask-Adaptive Global Connection and Dynamic Thresholds

Spiking neural networks (SNNs) have garnered significant attention in reinforcement learning tasks for their low power consumption. However, traditional spiking reinforcement learning (SRL) methods, which rely on local-connected encoding and fixed-threshold learning, struggle to capture the inter-dimensional correlatio...

Rong Xiao, Zhi-Yuan Hu, Ping He et al. · 0 citations
#artificial intelligence Preprint Oct 2026

SpikeMoE: Brain-Inspired Competitive Routing for Flexible Spiking Mixture-of-Experts

Spiking Neural Networks (SNNs) enable event-driven computation through biologically inspired dynamics at the neuronal scale, while Mixture-of-Experts (MoE) perform conditional computation through expert selection at the model scale. Integrating their strengths offers potential for flexible neural architectures. A key c...

Xiao-Li Liu, Yu Liang, Jia-Lin Li et al. · 0 citations

QuantaSpike: Short-Window Spike-Driven Quantization for Large Language Models

QuantaSpike is proposed, a short-window spike-driven quantization framework for LLMs built around Logarithmic Ternary Integrate-and-Fire (LTIF) neurons that achieves state-of-the-art or competitive perplexity and zero-shot accuracy among spike-driven LLM quantization methods.

Bang Hu, Guo-Wei Zhu, Changze Lv et al. · 0 citations

Related blog posts

MIT News · Artificial Intelligence Sep 29, 2026

Who we become when we talk to machines

Professor Sherry Turkle’s new book, “Artificial Intimacy,” offers a withering critique of chatbots and the antisocial dynamics she believes they encourage.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.