CS-E4710 - Machine Learning: Supervised Methods D, Lecture, 5.9.2023-11.12.2023
Kurssiasetusten perusteella kurssi on päättynyt 20.02.2024 Etsi kursseja: CS-E4710
Osion kuvaus
-
Course position and Prerequisites
Course is MSc course in Machine learning, targeted to MSc students in CCIS and Life Science Technologies programmes. The course is also suitable for PhD studies.
The course assumes basic background in computer science and statistics, as follows:
- CS-C3240 Machine Learning, or MS-C1620 Statistical inference, or equivalent knowledge
- Basics of probability theory
- Basic of linear algebra
- Basics of multivariate calculus
- Programming skills (Python preferable)
Learning Outcomes
After the course, the student knows how to recognize and formalize supervised machine learning problems, how to implement basic optimization algorithms for supervised learning problems, how to evaluate the performance supervised machine learning models, and has understanding of the statistical and computational limits of supervised machine learning, as well as the principles behind commonly used machine learning models.
Contents
Part I: Theory
- Introduction
- Generalization error analysis & PAC learning
- Rademacher Complexity & VC dimension
- Model selection
Part II: Algorithms and models
- Linear models: perceptron, logistic regession
- Support vector machines
- Kernel methods
- Neural networks (MLPs)
- Ensemble methods
Part III: Additional topics
- Feature learning, selection and sparsity
- Multi-class classification
- Preference learning, ranking
Course personnel
- Lecturer: Prof. Juho Rousu
- Course assistants: Dr Sandor Szedmak, Dr Riikka Huusari, Ines Riahi
Course schedules
- Lectures (A-hall/Aalto-hall - Y202a, Undergraduate Centre): Tuesdays 10:15-12:00 (first lecture 5.9.2023). Attending the lectures is voluntary. The lectures are recorded and slides are published in MyCourses before each lecture (See the tabs Lecture slides and Recordings).
- Assignments : completed at home, and submitted online (See the tab Assignments).
- Tutorial sessions (A-hall/Aalto-hall - Y202a, Undergraduate Centre): Every other Friday 10:15-12:00 (first session 15.9.2023). TAs present the model solutions for the exercises. Attending the solution sessions is voluntary.
- Exam (online in MyCourses): 11.12.2023 at 17.00–20.00. The exam will be open book.
- Repeat exam (online in MyCourses): 20.2.2024 at 09.00–12.00. The exam will be open book. The same grading principles will be used for the repeat exam as for the original exam.
Grading
The course can be completed by two alternative ways:
- Exercises (max 30 points) + Exam (max 70 points). Lowest passing points total is 50. 85 points will give the grade of 5.
- Exam only (max. 100 points). Lowest passing points total is 50. 85 points will give the grade of 5.
The better of the resulting two grades will be taken into account.
Language of Instruction
English
Course Material
Lecture slides and exercises are the examined content
Additional reading
The lectures are mostly based on the books:
- Main source: Mohri, Rostamizadeh, Talwakar: Foundations of Machine Learning. Second Edition. Available online in Aalto eBookAalto Central: https://ebookcentral.proquest.com/lib/aalto-ebooks/detail.action?pq-origsite=primo&docID=6246520
- Some material also from: Shalev-Shwartz, Ben-David: Understanding Machine Learning, Cambridge University Press. Downloadable for personal use from https://www.cs.huji.ac.il/~shais/UnderstandingMachineLearning/courses.html
Discussion forum
MyCourses discussion forum will be available when the course begins available, if you have questions. Teaching assistant monitor the forum and aim to answer within 24 hours.