Preprint

PTQ4SNN: Membrane-Aware Post-Training Quantization for Spiking Neural Networks

Hui Xie Tong Shi Haotong Qin Aishan Liu Xiaode Liu Jinyang Guo

Aug 2026 · 0 citations · 25 references

Computer Science

TL;DR

PTQ4SNN is proposed, a membrane-aware post-training quantization framework that jointly quantizes weights and recurrent membrane states using only a small calibration set and effectively preserves model accuracy under W4 quantization and approximately 4-bit membrane precision.

Abstract

Spiking neural networks (SNNs) enable sparse and event-driven computation, but their low-bit deployment remains incomplete because recurrent membrane states are commonly retained in floating point even after weight quantization. Quantizing these states is challenging because their distributions differ across channels and from the preceding weights, while small perturbations near the firing threshold may alter spike decisions and accumulate over time. We propose PTQ4SNN, a membrane-aware post-training quantization framework that jointly quantizes weights and recurrent membrane states using only a small calibration set. First, a channel-wise Unified Scale Bridge constrains the membrane scale as s_mem,c = s_w,c * 2^k_c, adapting to membrane distributions while enabling shift-compatible scale conversion. Second, Mixed-Precision Bit Allocation assigns 2/4/8-bit precision to membrane channels according to firing activity and quantization sensitivity under an average-bit budget. The framework operates on reusable projection-LIF pairs and supports both convolutional SNNs and spike-driven Transformers without backbone retraining. Experiments on static and event-based classification and semantic segmentation show that PTQ4SNN effectively preserves model accuracy under W4 quantization and approximately 4-bit membrane precision.

arXiv Semantic Scholar

View source

Similar papers

Preprint Aug 2026

BASC : Behavior-Aligned Quantization and Pruning for Low-Bit Spiking Neural Networks

Extensive experiments on static and neuromorphic benchmarks show that lower-bit BASC models match or outperform higher-bit baselines and retain this accuracy advantage after structured pruning, while further reducing model storage and synaptic operations.

Linliang Chen, Yan Zhong, Xin Liu et al. · 0 citations

Preprint Aug 2026

Reducing ANN-SNN Conversion Error via Residual Membrane Potential Alignment

This work analyzes flaws of conventional conversion pipelines from residual membrane potential statistics and proposes a novel conversion strategy combining dynamic initial potential tuning and feature enhancement, which generalizes to ReLU CNNs, ANN Transformers, and multi-threshold SNN variants.

Zirui Chen, Zihan Huang, Tong Bu et al. · 0 citations

Preprint Aug 2026

Lapis: Laplacian Spiking Attention via First-Spike Timing and Membrane Leakage

Lapis is proposed, a spiking attention mechanism that scores each token pair by the L1 distance between its query and key first-spike latency vectors under time-to-first-spike coding, and maps this distance to an affinity through a Laplacian kernel.

Kaiwen Tang, Jiaqi Zheng, Zixuan Zhu et al. · 0 citations

Preprint Aug 2026

SMM Transformer: Leveraging Spiking Neural Networks for Multimodal Tasks

Spiking Neural Networks (SNNs) enable event-driven computation with sparse activations, but building multimodal Transformers on SNNs is hindered by unstable training in deep spiking stacks and the mismatch between dense softmax attention and spike-based communication. We propose SMM Transformer, an SNN-based multimodal Transformer framework that combines (i)PLMP, a Parallel LIF with Multistage Learnable Parameters neuron and a tailored P-STBP algorithm for stable deep SNN training, (ii) SMSA, an attention-inspired spike-driven token-mixing module that replaces dense pairwise softmax attention with channel-wise spike co-activation and self-compensation, and (iii)SMoE, a spiking mixture-of-experts module for modality-aware fusion. Across visual and multimodal benchmarks, SMM Transformer achieves competitive accuracy compared to ANN baselines. Under a standard MAC/AC arithmetic model, SMSA reduces the estimated operator-level compute energy of the attention module by up to 97%, while whole-model profiling shows more moderate but consistent efficiency gains.

Xiubo Liang, Jinxing Han, Yuke Li et al. · 0 citations

Preprint Jul 2026

The Sparsity Ceiling: Where Spiking Networks Can and Cannot Trade Activity for Energy

It is argued the energy dividend of sparsity is not a property of SNNs but of the task, and the ceiling is formalized with an information-theoretic bound and confirmed: the floor rises with memory load, falls with state width, and (refuting a naive memory-only reading) rises with task difficulty.

Zeyu Wang · 0 citations

2025

Adaptive Fission: Post-training Encoding for Low-latency Spike Neural Networks

Adaptive Fission is proposed, a post-training encoding technique that selectively splits high-sensitivity neurons into groups with varying scales and weights that enables neuron-specific, on-demand precision and threshold allocation while introducing minimal spatial overhead.

Yizhou Jiang, Feng Chen, Yihan Li et al. · Neural Information Processin... · 2 citations