LineShine is presented, a newly deployed exascale supercomputer whose online acceleration architecture provides a new design point for converged HPC and AI and demonstrates that its balanced architecture and software stack can translate system capability into high throughput, robust scalability, and sustained scientific productivity at exascale.
(English) High-performance computing (HPC) platforms are evolving towards increasingly complex architectures: many-core CPUs with multi-level NUMA hierarchies, heterogeneity with multiple classes of accelerators and higher-capacity interconnects. The increasing complexity and variety of resources in these machines make...
FlashGPU-sim is presented, an open-source, execution-driven, cycle-accurate GPU simulator for modern AI workloads that faithfully models modern hardware features such as asynchronous data movement, fine-grained synchronization, tensor-core execution, and distributed shared memory.
Si-Ying Yu, Yi-Xun Hong, Guo-Zhi Qiu et al.· 0 citations
HOCCCL, a zero-SM collective communication framework consisting of three components: a stream manager, a point-to-point (P2P) executor, and a collective scheduler, which improves end-to-end training throughput by up to 5%.
Yao Fei, Gong-Ming Zhao, Hong-Li Xu et al.· arXiv.org· 0 citations
A critical survey of supercomputer architecture from early vector machines to contemporary exascale systems, with particular emphasis on three persistent challenges: memory hierarchy design, interconnection network scalability, and thermal management.
Oraye Godspower· International Journal of Com...· 0 citations
A benchmarking study of Python-Rust interoperability reveals that the Rust enhanced versions systematically execute faster than pure Pythoncode- up to three times faster in some cases.
S. Singh, R.pradeep Raj· International Journal For Mu...· 0 citations
Inspired by the efficient communication principles of federated learning (FL), this work introduces two hybrid algorithms - FL+FSDP and FL+HSDP - interleaving sharded DP with FedAvg-style aggregations, demonstrating superior computational efficiency and improved model quality.
Gianluca Mittone, Marco Aldinucci· European Conference on Paral...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.