Skip to content

Rethinking Sparse Formats for RISC-V: A Hierarchical Approach to High-Performance SpMV

Sep 2026 · arXiv.org · Vol abs/2609.11352 · 0 citations · 39 references
Computer Science

TL;DR

A novel modification of the CSR format, Hierarchical CSR (HCSR), is proposed, which enhances SpMV performance on RISC-V processors and achieves the shortest execution time among all considered formats across a broad class of sparse matrices.

Abstract

The sparse matrix-vector multiplication (SpMV) algorithm is a fundamental computational kernel of linear algebra and serves as a building block for numerous applications, primarily iterative solvers for systems of linear equations used in scientific and engineering simulations. This paper compares vectorized implementations of the SpMV algorithm across eight established sparse matrix storage formats and proposes a novel modification of the CSR format, Hierarchical CSR (HCSR), which enhances SpMV performance on RISC-V processors. Our SpMV implementations utilize RVV 1.0 intrinsics and are publicly available as an open-source C++ library named RVVLASparse. Computational experiments conducted on SpacemiT K1 and K3 RISC-V boards demonstrate that the proposed HCSR format achieves the shortest execution time among all considered formats across a broad class of sparse matrices. HCSR outperforms the best CSR implementation on 8 cores, yielding an average speedup for double precision of 19% on K1 (13% on K3) and for single precision of 36% on K1 (34% on K3).

View source

Similar papers

Open access Oct 2026

Demystifying SpMV Performance: Bottleneck Characterization and Open Challenges

Sparse Matrix-Vector Multiplication (SpMV) is a critical computational kernel in scientific computing, graph processing, and machine learning. Despite its importance, SpMV achieves only a small fraction of peak performance, varying substantially across matrices and architectures. This paper comprehensively analyzes SpM...

Panagiotis Mpakos, Dimitrios Galanopoulos, Petros Anastasiadis et al. · 0 citations
Preprint Nov 2026

AscSpMM: Efficient SpMM on Ascend NPUs via Pipelined Vector-Cube Collaboration

Neural processing units (NPUs) provide high compute density and energy efficiency through specialized matrix engines and software-managed on-chip memory. However, their libraries primarily target dense computation. Sparse matrix-dense matrix multiplication (SpMM), a key kernel in graph analytics, sparse neural networks...

Fei Li, Hao-Xin Li, Ke-Hong Liu et al. · 0 citations
Preprint Nov 2026

Ascend-SpMM: Accelerating Sparse Matrix-Dense Matrix Multiplication on Ascend NPUs

Sparse Matrix-Dense Matrix Multiplication (SpMM) is a fundamental kernel in graph neural networks and scientific computing, yet its optimization on Ascend NPUs remains largely unexplored. The physically decoupled Cube/Vector architecture and single-threaded scalar instruction dispatch of modern NPUs introduce unique ch...

Jia-He Wang, Ying-Xia Shao, Shu-Han Wang et al. · 0 citations
Open access Dec 2026

FlexVector: A SpMM Vector Accelerator With Flexible VRF for GCNs on Varying-Sparsity Graphs

Graph Convolutional Networks (GCNs) are widely adopted for tasks involving relational or graph-structured data and can be formulated as two-stage sparse–dense matrix multiplication (SpMM) during inference. However, existing accelerators often struggle with the irregular workloads induced by power-law node degree distri...

Bo-Han Li, Sheng-Ming Li, Xin-Yu Shi et al. · 0 citations
Open access Oct 2026

CB-Sparse:A Cache-Friendly Data Aggregating Algorithm for Block-Based Sparse Matrix Multiplication on GPUs

Sparse matrix multiplications–including SpMV, SpMM, and SpGEMM–are fundamental to scientific computing, graph analytics, and machine learning. Despite extensive GPU-focused optimizations such as custom sparse formats and load balance, CSR-style and block-based methods can still underexploit fine-grained cache locality...

Xing Cong, Fu-Kai Sun, Yi-Ding Liu et al. · 0 citations
Preprint Oct 2026

Investigating ET-SoC-1 Vector and Parallel Performance with sGEMM

The Ainekko (formerly Esperanto) ET-SoC-1 is a massively parallel RISC-V accelerator. Its compute array comprises 1024 dual-threaded in-order ET-Minion cores (2048 harts) operating at 600 MHz, each core providing an eight-lane 256-bit packed-single (PS) SIMD datapath shared by its two harts, with access to LPDDR4X memo...

Richard Neale, Nick Brown · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.