Communication-Efficient Distributed Deep Learning: Survey, Evaluation, and Challenges

Shi Shaohuai
Shi Shaohuai
Tang Zhenheng
Tang Zhenheng
Wang Wei
Wang Wei
Cited by: 0|Bibtex|Views15|Links

Abstract:

In recent years, distributed deep learning techniques are widely deployed to accelerate the training of deep learning models by exploiting multiple computing nodes. However, the extensive communications among workers dramatically limit the system scalability. In this article, we provide a systematic survey of communication-efficient dis...More

Code:

Data:

Your rating :
0

 

Tags
Comments