This work proposes ALNet, an adaptive lateral-interaction spiking neural network for event-driven motion deblurring, and develops a Lateral Deformable Interaction Spiking Neural Network (LDSNN), which introduces lateral spike interactions and adapts the offset-and-modulation mechanisms of deformable convolution to the lateral interactions of spiking neurons.
Abstract
Motion deblurring is an essential capability for high-speed vision applications such as autonomous driving and unmanned aerial vehicles. Existing frame-based deblurring methods often struggle with rapid motion, whereas event cameras offer a promising alternative. However, irregular motion patterns and event noise remain challenging. To address these issues, we propose ALNet, an adaptive lateral-interaction spiking neural network for event-driven motion deblurring. ALNet adopts a dual-branch image–event architecture. In the event branch, we develop a Lateral Deformable Interaction Spiking Neural Network (LDSNN), which introduces lateral spike interactions and adapts the offset-and-modulation mechanisms of deformable convolution to the lateral interactions of spiking neurons. The design dynamically adjusts the interaction region, aiming to enhance motion boundary modeling and reduce sensitivity to event perturbations. For temporal feature extraction from event streams, we design an Image-Guided Spiking Transformer (IGST), which uses image-domain spatial context to guide the temporal processing of event spikes. For image–event feature fusion, we introduce a Cross-Modal Attention Fusion module (CMAF) to align and selectively fuse multi-modal features, thereby improving edge reconstruction. Experiments on the GoPro, REBlur, and Ev-REDS datasets show that ALNet contains only 6.08 M parameters while achieving competitive PSNR and SSIM performance, providing a favorable trade-off between restoration accuracy and model compactness.
A novel temporal iterative refinement (TIR) framework to obtain low-latency flow updates at high frequency with SNN-based feature encoders, and exhibits better cross-domain generalization, hinting toward the strong inductive biases of the network.
M. Humais, Hussain M. Sajwani, Sajid Javed et al.· IEEE Transactions on Image P...· 0 citations
Experiments show SynNeura is a scalable, interpretable, and efficient solution for event-driven multimodal temporal alignment, and consistently outperforms frame-based and continuous-time baselines in alignment accuracy, temporal consistency, and efficiency.
Yu-Ping Zhang, Yan Liu· Neural Networks· 0 citations
SpikeYOLO-C2TCA, an improved SNN detector built upon the SpikeYOLO backbone, delivers better detection accuracy than the baseline while consuming less energy, offering a practical lightweight solution for edge platforms such as on-orbit satellites and long-endurance unmanned aerial vehicles.
Unknown authors· Journal of Superintelligence...· 0 citations
Dense Event-driven Local Learning is introduced, a block wise scheme for dense event-based vision that replaces global gradient propagation with local dense supervision and reduces peak training memory while substantially reducing training memory.
M. Vaillant, Axel Carlier, Xing-Ng Lai et al.· 0 citations
Although spiking neural networks (SNNs) provide an energy-efficient alternative to artificial neural networks (ANNs), their application to remote sensing image dehazing remains limited. A key challenge arises from the coupling between haze-induced high-frequency attenuation and discrete spike thresholding. This interac...
Jie Shao, Jiaqi Ma, Wen-Wen Min et al.· 0 citations
Experiments show that the proposed E-S2Feat method significantly outperforms baseline methods such as SuperEvent in pose estimation accuracy and achieves accuracy comparable to its artificial neural network counterpart while delivering an approximately 4.8-fold improvement in theoretical computational energy efficiency...
Yang Yi, Juntao Hua, Jinpu Zhang et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.