HAT-MPI: Hierarchical Auto Tuning of MPI Inter-Node Communication on InfiniBand Clusters
This work presents HAT-MPI, an ML-based framework that identifies the UCX Eager-Rendezvous protocol threshold and the optimal collective algorithm on InfiniBand HPC clusters and introduces two complementary techniques that improve the conventional data collection and evaluation workflow, namely LLM-assisted HPC hardwar...