This paper devise a novel matrix-based approach to model the leaky integrate-and-fire (LIF) neuron dynamics and natively support dense and sparse execution modes and introduces SuperNeuroMAT, an open-source, scalable, and highly efficient Python-based SNN simulator.
Abstract
Spiking neural networks (SNNs) offer a promising pathway to energy-efficient AI and brain-inspired computing. However, their widespread adoption is hindered by a lack of fast, accessible, and versatile simulation frameworks. In this paper, we introduce SuperNeuroMAT, an open-source, scalable, and highly efficient Python-based SNN simulator. We devise a novel matrix-based approach to model the leaky integrate-and-fire (LIF) neuron dynamics and natively support dense and sparse execution modes. This enables fast simulation of approximately 10,000 neurons in dense mode and 100,000 neurons in sparse mode on standard laptops and desktops without requiring specialized hardware. We demonstrate that SuperNeuroMAT consistently outperforms four established SNN simulators---NEST, Brian2, BindsNET, and snnTorch---on two performance metrics (execution speed and peak resident memory) and across various network sizes and connection probabilities. Furthermore, we demonstrate SuperNeuroMAT's applicability across a diverse set of problems. SuperNeuroMAT can efficiently handle conventional machine learning benchmarks such as the Digits and citation network datasets as well as neuromorphic event-based vision tasks such as N-CARS and ASL-DVS. Moreover, it can be extended beyond machine learning workloads and facilitate general-purpose workloads. We validated this by implementing the neuromorphic shortest path algorithm and two arithmetic primitives (addition and multiplication). SuperNeuroMAT can be installed via the Python Package Index (PyPI), thereby lowering the barrier to entry into the field of neuromorphic computing and accelerating the broader development of neuromorphic algorithms.
It is aimed at proving that SNNs have potential in such areas as computer vision, robotics, and speech recognition, and their role in overcoming the barrier between artificial and biological neural systems is proved.
Mesala Sravani, K. Kumari, S. M. Reddy· International Journal of Unc...· 0 citations
This work proposes a noisy group neuron (NGN) model, which incorporates population-level synchronous resetting and neural stochasticity as fundamental computational mechanisms, and develops the NGN method as a framework that combines the NGN model with backpropagation learning based on mean-field dynamics.
Yajie Zhai, Yanmei Kang, Meng Li et al.· 0 citations
The proposed parallel multi-compartment spiking neuron (PMSN) presents a promising solution to harness the computational advantages of detailed biological neurons, enabling high-performance and efficient temporal processing on neuromorphic computing systems.
Xinyi Chen, Jibin Wu, Chenxiang Ma et al.· IEEE Transactions on Neural...· 16 citations· ⚡4
Neuromorphic computing is closely associated with spiking neuronal networks. However, an alternative class of so-called"rate-based"models arising from computational neuroscience and machine learning forgoes spiking interactions and instead relies on continuous coupling between neurons. Existing neuromorphic implementations designed around spike-based interactions are not well-suited for emulating such models. Here view the distributed simulation of these models as message-passing algorithms on parallel hardware. Leveraging prior art in numerical algorithms and distributed simulation, we outline steps that enable the design of efficient digital neuromorphic accelerators for non-spiking neuronal models. In particular, we show that multi-bit packets, rather than spikes, are the most efficient communication strategy in packet-switched networks and that compared to basic numerical integration methods, higher-order differential equation solvers decrease both computation and communication costs while achieving lower numerical error, but that these benefits are ultimately limited by arithmetic precision. Using our proposed design principles, we convert an existing neuromorphic architecture into a distributed numerical solver - a spikeless neuromorphic system - for continuously-coupled neuronal models. We thereby demonstrate that our theoretical considerations indeed translate into practical advantages, namely reduced energy consumption and delay.
Jakob Jordan, Ole Richter, Cong Li et al.· 0 citations
This work proposes a community-aware sparse topology design framework for graph-based SNNs and challenges the prevailing assumption that network size or sparsity alone is sufficient, demonstrating that how sparse connections are organized - the graph topology - critically influences learning efficiency, accuracy, and energy consumption.
F. Motaghian, S. Nazari, J. P. Dominguez-Morales et al.· Scientific Reports· 0 citations
This work proposes heterogeneous neural networks that combine spiking neural networks (SNNs) and artificial neural networks (ANNs) at bandwidth-limited regions, such as chip boundaries, where spike-based communication reduces data transfer overhead.
Joshua Nardone, Rui-Jie Zhu, Ruhai Lin et al.· International Conference on...· 0 citations