Introduction to Deep Learning (mini-course)

Basic Deep Learning Tasks from CPUs to GPUs

This is a hands-on introduction to the first steps in deep learning, intended for researchers who are familiar with (non-deep) machine learning.

The use of deep learning has seen a sharp increase of popularity and applicability over the last decade. While deep learning can be a useful tool for researchers from a wide range of domains, taking the first steps in the world of deep learning can be somewhat intimidating. This introduction covers the basics of deep learning in a practical and hands-on manner, so that upon completion, you will be able to train your first neural network and understand what next steps to take to improve the model.

We start with explaining the basic concepts of neural networks, and then go through the different steps of a deep learning workflow. Learners will learn how to prepare data for deep learning, how to implement a basic deep learning model in Python with Keras, how to monitor and troubleshoot the training process and how to implement different layer types such as convolutional layers.

Preparation

• Setup

The lesson

• 0. GPU programming
• 1. Introduction
• 2. Classification by a neural network using Keras
• 3. Monitor the training process

Reference

• Reference for learners
• Instructor notes
• Learner profiles

Schedule

All times are in CET (Central European Time). Click here to get the starting time in your timezone.

Session 1

Time	Topic
14:00	GPU programming
14:20	Introduction to Deep Learning
14:50	Classification by a neural network using Keras + exercises
15:45	Coffee Break

Session 2

Time	Topic
16:00	Monitor the training process + exercises
17:15	Outlook and further reading
17:30	END

Other related lessons

Original carpentries lesson

This lesson is an adaptation of https://carpentries-lab.github.io/deep-learning-intro, and its Sphinx adaptation https://enccs.github.io/deep-learning-intro, both of which are licensed CC-BY-4.0

Introduction to artificial neural networks in Python

The Introduction to artificial neural networks in Python lesson takes a different angle to introducing deep learning, focusing on computer vision with the application on medical images.

Introduction to machine learning in Python with scikit-learn

The Introduction to machine learning in Python with scikit-learn lesson introduces practical machine learning using Python. It is a good lesson to follow in preparation for this lesson, since basic knowledge of machine learning and Python programming skills are required for this lesson.

Prerequisites

Learners are expected to have the following knowledge:

• Basic Python programming skills and familiarity with the Pandas package.

• Basic knowledge on machine learning, including the following concepts: Data cleaning, train & test split, type of problems (regression, classification), overfitting & underfitting, metrics (accuracy, recall, etc.).