GPipe: Efficient Training of Giant Neural Networks using Pipeline Parallelism

    NeurIPS, 2019.

    Cited by: 199|Bibtex|Views105|Links
    EI
    Keywords:
    image classificationsingle 6pipeline parallelismlinear speedup

    Abstract:

    Scaling up deep neural network capacity has been known as an effective approach to improving model quality for several different machine learning tasks. In many cases, increasing model capacity beyond the memory limit of a single accelerator has required developing special algorithms or infrastructure. These solutions are often architectu...More

    Code:

    Data:

    Your rating :
    0

     

    Tags
    Comments