PyTorch DistributedDataParallel workshop
Learn how to train a neural network in parallel with PyTorch's built-in DistributedDataParallel framework, and how to adapt an existing model to it.
AI
HPC
difficulty:
intermediate
maturity:
beta
Overview
There are multiple ways of using parallel processing power with PyTorch. This workshop goes through PyTorch's built-in DistributedDataParallel framework and how to adapt an existing model to it. Familiarity with PyTorch and experience with implementing neural networks is assumed.
Learn More
Visit the lesson page to access the full content.