Book
Open access
Sep 2026
Low-bit and Sparsified Gradient Communication for Accelerating Distributed Deep Learning with Convergence Guarantees
A low-bit and sparsified gradient communication algorithm with convergence guarantees, called QTopKA2A, which enables effectively overlapping communications with both feed-forward and backpropagation computations through a decomposed communication framework.
Jia-Qi Li, Shao-Huai Shi, Jing Peng et al.
· Proceedings of the Internati... · 0 citations