Skip to content

CMP-LSTM: Accuracy-Driven Column-Wise Maximum Pruning for Efficient LSTM Acceleration

Nov 2026 · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · Vol 45, pp. 5853-5862 · 0 citations · 33 references

Abstract

Long short-term memory (LSTM) networks are widely used in sequence-based tasks such as speech recognition and sentiment analysis. However, the presence of gating units significantly increases computational overhead and memory usage, making LSTMs less suitable for resource-constrained edge devices and latency-sensitive applications. To address this, various model compression techniques, such as pruning and structured weight, have been explored to reduce memory access and computational demands. However, deploying these compressed models on conventional LSTM accelerators often suffers from low compute efficiency, limiting their practical applicability. This article proposes a novel column-wise pruning method that adaptively adjusts the sparsity of gating matrices based on their sensitivity to model accuracy, thereby maximizing overall sparsity (OS). To further reduce computational complexity, the sparse vectors processed using the delta network (DN) efficiently skip zero elements during matrix computations. Moreover, we introduce a highly optimized column-wise hardware architecture tailored for efficient LSTM inference. Our accelerator is implemented on an AMD Zynq 7000 XC7Z100 field-programmable gate array (FPGA) and evaluated using the TIMIT dataset. Experimental results demonstrate an <inline-formula> <tex-math notation="LaTeX">$80.5\times $ </tex-math></inline-formula> model compression rate without accuracy loss and 24.8 Top/s of effective throughput. Compared to state-of-the-art LSTM accelerators, our design achieves <inline-formula> <tex-math notation="LaTeX">$2.6\times \sim ~27\times $ </tex-math></inline-formula> speedup and <inline-formula> <tex-math notation="LaTeX">$2.3\times \sim ~25\times $ </tex-math></inline-formula> improvement in energy efficiency.

View source

Similar papers

#computer vision Review Sep 2017

Agile Software Development Methods: Review and Analysis

This publication proposes a definition and a classification of agile software development approaches and analyses ten software development methods that can be characterized as being "agile" against the defined criterion.

P. Abrahamsson, O. Salo, Jussi Ronkainen et al. · 727 citations · ⚡54
#computer vision Jun 2008

The impact of agile practices on communication in software development

The study shows that agile practices improve both informal and formal communication, but indicates that, in larger development situations involving multiple external stakeholders, a mismatch of adequate communication mechanisms can sometimes even hinder the communication.

M. Pikkarainen, Jukka Haikara, O. Salo et al. · 401 citations · ⚡48
#machine learning Review Open access Oct 2014

Software development in startup companies: A systematic mapping study

The results indicate that software engineering work practices are chosen opportunistically, adapted and configured to provide value under the constrains imposed by the startup context.

Nicolò Paternoster, Carmine Giardino, M. Unterkalmsteiner et al. · 394 citations · ⚡54

Related blog posts

MIT News · Artificial Intelligence Nov 17, 2026

Learning the language of machine learning

By studying the computational foundations of language learning, Associate Professor Jacob Andreas builds intelligent systems that can communicate effectively with humans.

Microsoft Research Blog Oct 29, 2026

Microsoft Research Focus – Edition #97

Host Sowbhagya Suresh shares some of the latest news and cutting-edge research from across Microsoft—from understanding the challenges facing coding agents to uncovering how people use AI at work and improving extended-range weather forecasting. The post Microsoft Research Focus – Edition #97 appeared first on Microsoft Research.

MIT News · Artificial Intelligence Oct 28, 2026

Making machines that can listen

Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.