TileGEMM is proposed, a high-performance GEMM implementation on AMX that systematically enhances data reuse across the memory hierarchy, and achieves average speedups of 3.27 × and 1.96 × over AVX-512-based implementations TVM and MKL, respectively.
Kang-Kang Chen, Hua-You Su, Meng-Han Jia et al.· International Conference on...· 0 citations
PruneInfer is the only system on the authors' experimental configuration that maintains accuracy comparable to full-graph inference across all evaluated models and achieves up to 4.49 × speedup over DGL and up to 7.05 × speedup over GDL-GNN across the evaluated datasets.
Li-Yang Wu, Meng-Han Jia, Chun-Ye Gong et al.· Proceedings of the Internati...· 0 citations
General Matrix Multiplication (GEMM) is the cornerstone of high-performance computing and deep learning. Its efficiency significantly influences the performance of applications ranging from large language models to scientific simulations. Intel Advanced Matrix Extensions (AMX) significantly boost matrix operations thro...
Kang-Kang Chen, Hua-You Su, Menghan Jia et al.· Proceedings of the Internati...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.