Skip to content
Open access

ComPIM: A Processing-in-Memory Accelerator for Compressed DNNs without Decompression

2026 · Computers, Materials & Continua · 0 citations · 28 references

Abstract

: The increasing size and complexity of modern deep neural networks (DNNs) introduce significant challenges for deployment on resource-constrained embedded systems. Though the quantization techniques reduce memory usage and computational complexity by replacing high-precision parameters with low-precision counterparts, they are not sufficient for meeting the strict resource constraints in edge environments. To further reduce the model size, the compression techniques have been proposed. However, these techniques typically incur significant performance overhead due to the need for decompression before computation. In this paper, we propose ComPIM, a processing-in-memory accelerator for compressed DNNs without decompression. ComPIM compresses the DNN parameters (i.e., weights and activations) by leveraging a DNN characteristic that the parameter values follow a normal distribution, and then performs DNN inference directly on compressed parameters. Thus, ComPIM achieves high compute-throughput as well as low memory usage under the given memory bandwidth. In addition, all the operations of ComPIM are lossless, which does not cause DNN accuracy degradation. Our evaluation results show that ComPIM improves the average compute-throughput and memory usage by up to 34.2% and 18.8% across various DNN models, respectively, compared to the quantized neural network based on INT8 format.

Read PDF

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.