Tools

Tools required for this training. The environment can be created using conda if required. HPC systems such as Leonardo provide a module that contains all the necessary tools.

What is it?

1. environment_full_specs.yml: conda environment file for installing the necessary dependencies, all dependencies with explicit versions (less portable).

2. environment_from_history.yml: conda environment file for installing the necessary dependencies, only high-level packages (more portable, less reproducible); see below:

3. requirements.txt: requirements file for installing the necessary dependencies.

name: ai_tools_fine_tuning
channels:
  - conda-forge
dependencies:
  - accelerate
  - bitsandbytes
  - datasets
  - jupyterlab
  - matplotlib
  - peft
  - python=3.13
  - python-dotenv
  - pytorch
  - transformers

prefix: "/home/gjb/mambaforge/envs/ai_tools_fine_tuning"