ITI41720 Machine Learning and Deep Learning (Autumn 2023)

Knowledge in:

• Statistics and statistical programming
• Mathematics
• Programming
• Algorithms and data structures

First semester (autumn) in the full-time and part-time programme (For those who started in 2023)

First, third and seventh semster in the part-time programme (For those who started in 2021 and 2022)

This course gives an advanced insight into the main methods used in machine learning. The topics covered in this course are:

• Concepts related to basic types of learning (supervised, unsupervised, reinforcement): preprocessing, feature extraction, overfitting, error functions
• Decision and regression trees, random forest and XGBoost
• Artificial neural networks, deep learning
• Optimization (evolutionary algorithms and other search methods)
• Bayesian inference / classification

Ethics and privacy in machine learning is also mentioned.

Additionally, the course contains up to date topics that are not known when this text is being written.

Knowledge

The student

• is familiar with both the possibilities and advantages of employing the machine learning methods in the course, as well as possible problems that may be encountered and how to overcome them.
• knows how the algorithms presented in the course work and their characteristics, for example which problems they work best for, overfitting, expected accuracy and computational requirements, for example how much benefit that accelerators may provide.

Skills

Given a machine learning application, the student is able to

• determine which theory and which methods that are presented in the course that are relevant and also how to apply them.
• perform hyperparameter tuning or in some cases even perform modifications of the source codes.
• use at least one implementation for each of the major machine learning techniques that are taught in the course.

General competence

The student

• is able to independently read machine learning papers and other literature and evaluate what works well and what does not for new problems.
• knows the terminology of machine learning and is familiar with the mathematics that is common in the field.
• knows the general behaviour of machine learning methods for example regarding how much data that is required, how to preprocess the data and ensure that its quality is sufficient.

Portfolio and individual written exam

The exam consists of both a portfolio and an individual written exam.

The portfolio (determines 65% of the final grade) consists of two projects. The projects can be carried out individually or in groups of maximum tree students. The students will get an individual grade.

The individual written exam determines 35% of the final grade and focuses on theory. Duration 3 hours. No supporting materials allowed.

Both parts of the exam must be passed to pass the exam as a whole. The student will get an individual joint grade for the entire course. Grades: A - F.

This course is evaluated by a

• Mid-term evaluation (compulsory)

The responsible for the course compiles a report based on the feedback from the students and his/her own experience with the course. The report is discussed by the study quality committee of the faculty of Computer Sciences.