ENCCS - EuroCC National Competence Centre Sweden logo Learn More

CASTIEL2 Multi-GPU AI

Material from the CASTIEL2 Multi-GPU AI Train the Trainer workshop on scaling AI for model training and inference: PyTorch Distributed Data Parallel, model parallelism, PyTorch Lightning, fine-tuning, MLOps on HPC, Ray, RAG and hyperparameter tuning.

AI HPC
difficulty: intermediate maturity: stable

Overview

Material from the Castiel2 Multi-GPU AI Train the Trainer workshop, for scientists, engineers and PhD students who need to scale AI models efficiently or optimise distributed training workflows. Familiarity with AI frameworks is assumed.

Learn More

Visit the lesson page to access the full content.

Show the lesson