GPipe: Efficient Training of Giant Neural Networks using Pipeline Parallelism

ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019.

Cited by: 0|Bibtex|Views19|Links

Abstract:

Scaling up deep neural network capacity has been known as an effective approach to improving model quality for several different machine learning tasks. In many cases, increasing model capacity beyond the memory limit of a single accelerator has required developing special algorithms or infrastructure. These solutions are often architectu...More

Code:

Data:

Your rating :
0

 

Tags
Comments