Sparse linear algebra is a fundamental workload in scientific computing and machine learning, but its performance is severely constrained by memory bandwidth. Processing-in-memory (PIM) has shown great potential for sparse linear algebra, yet its efficiency is heavily bottlenecked by irregular computation and memory ac...
Rui Liu, Xiao-Yu Zhang, Bo-Wen Liu et al.· Proceedings of the 32nd ACM...· 0 citations
Transformer-based large language models (LLMs) primarily consist of weight-intensive fully connected (FC) layers and cache-dependent attention layers. While batching significantly enhances the throughput of FC layers, it paradoxically increases the cache demands of attention layers. This provides no performance benefit...
Xiaotian Sun, Xinyu Wang, Wanqian Li et al.· IEEE Transactions on Compute...· 0 citations
FlashAccel integrates HBF into HBM-based GPUs, providing architectural support to mitigate access latency and introduces an HBF-aware storage management layer together with a programming model to organize persistent data in HBF and coordinate heterogeneous memory resources at the system level.
Xinyu Wang, Yalong Xue, Xiaotian Sun et al.· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.