ENCCS - EuroCC National Competence Centre Sweden logo Learn More

PyTorch DistributedDataParallel workshop

Learn how to train a neural network in parallel with PyTorch's built-in DistributedDataParallel framework, and how to adapt an existing model to it.

AI HPC
difficulty: intermediate maturity: beta

Overview

There are multiple ways of using parallel processing power with PyTorch. This workshop goes through PyTorch's built-in DistributedDataParallel framework and how to adapt an existing model to it. Familiarity with PyTorch and experience with implementing neural networks is assumed.

Learn More

Visit the lesson page to access the full content.

Show the lesson