CASTIEL2 Multi-GPU AI
Material from the CASTIEL2 Multi-GPU AI Train the Trainer workshop on scaling AI for model training and inference: PyTorch Distributed Data Parallel, model parallelism, PyTorch Lightning, fine-tuning, MLOps on HPC, Ray, RAG and hyperparameter tuning.
AI
HPC
difficulty:
intermediate
maturity:
stable
Overview
Material from the Castiel2 Multi-GPU AI Train the Trainer workshop, for scientists, engineers and PhD students who need to scale AI models efficiently or optimise distributed training workflows. Familiarity with AI frameworks is assumed.
Learn More
Visit the lesson page to access the full content.