CASTIEL2 Multi-GPU AI Logo

The lesson materials

  • 1M: Access to Leonardo
  • 1A: Introduction to Deep Learning
  • 2M: PyTorch Distributed Data Parallel
  • 2A: Model parallelism with Pytorch
  • 3M: PyTorch Lightning
  • 3A: Fine-tuning neural networks
  • 3A: Accelerate FSDP Fine-Tuning
  • 4M: Computer Vision with CNN
  • 4A: MLOps on HPC
  • 5M: Introduction to Ray
    • Code
    • Scripts and Configuration
      • Ray Tutorial Notebooks
        • Available Notebooks
    • Additional Resources
  • 5M: Retrieval Augmented Generation (RAG)
  • 5A: Hyperparameter tuning

Reference

  • Quick Reference
  • Instructor’s guide
  • Directives
CASTIEL2 Multi-GPU AI
  • 5M: Introduction to Ray
  • Ray Tutorial Notebooks
  • Edit on GitHub

Ray Tutorial Notebooks

Note

content/it/intro_to_ray/notebooks

These notebooks provide hands-on tutorials for learning Ray’s core components.

  1. 01_ray_core.ipynb: Introduction to Ray core concepts and distributed computing

  2. 02_ray_data.ipynb: Working with Ray Data for distributed data processing

  3. 03_ray_train.ipynb: Distributed training with Ray Train

  4. 04_ray_tune.ipynb: Hyperparameter tuning with Ray Tune

Available Notebooks

Ray Core

  • Ray Core
  • Connecting to a Ray cluster
  • Ray Core - Tasks, Actors and Objects
  • Ray Actors
  • Object storage
  • Specifying resources for Tasks and Actors
  • Exercises
  • Embeddings workflow
  • Release resources

Ray Data

  • Ray Data
  • Introduction to Ray Data
  • Imports
  • Environment configuration
  • Ray Data - Datasets
  • Ray Data - API
  • Exercises
  • Release resources

Ray Train

  • Ray Train
  • Introduction to Ray Train
  • Exercise
  • Lightning Torch example
  • Exercise
  • Release resources

Ray Tune

  • Ray Tune
  • What is hyperparameter tuning?
  • Core concepts
  • Getting started with Ray Tune
  • Hyperparameter tuning using Ray (DL framework)
  • Exercise
  • Hyperparameter tuning using schedulers (ASHA)
  • Bonus: Hyperparameter tuning using Ray (ML framework)
  • Release resources
Previous Next

© Copyright 2026, The contributors.

Built with Sphinx using a theme provided by Read the Docs.