CASTIEL2 Multi-GPU AI
The lesson materials
1M: Access to Leonardo
1A: Introduction to Deep Learning
2M: PyTorch Distributed Data Parallel
2A: Model parallelism with Pytorch
3M: PyTorch Lightning
3A: Fine-tuning neural networks
3A: Accelerate FSDP Fine-Tuning
4M: Computer Vision with CNN
4A: MLOps on HPC
5M: Introduction to Ray
5M: Retrieval Augmented Generation (RAG)
5A: Hyperparameter tuning
Code
Reference
Quick Reference
Instructor’s guide
Directives
CASTIEL2 Multi-GPU AI
5A: Hyperparameter tuning
Edit on GitHub
5A: Hyperparameter tuning
Note
See
content/fi
Code
Note
content/fi/exercise
=======