Topic outline

  • General

    The information in SISU may be outdated. The up-to-date information is on these web pages. Course slack: deeplearn22-aalto.slack.com

    Contact information
    • If you have questions regarding the course, please send an email to cs-e4890@aalto.fi .

    Course description

    Machine learning with deep neural networks, programming using PyTorch. After the course, the student understands the basic principles of deep learning: multi-layer perceptrons, convolutional and recurrent neural networks; stochastic gradient descent and backpropagation; means to prevent overfitting. The student understands methods for supervised and unsupervised deep learning. The student knows modern neural architectures used for image classification, time series modeling and natural language processing. The student has experience on training deep learning models in PyTorch.

    Assessment
    Returned assignments and an exam.

    Prerequisites
    • NB: good knowledge of Python and numpy
    • linear algebra: vectors, matrices, eigenvalues and eigenvectors
    • basics of probability and statistics: sum rule, product rule, Bayes' rule, expectation, mean, variance, maximum likelihood, Kullback-Leibler divergence
    • basics of machine learning (recommended): supervised and unsupervised learning, overfitting

    Course contents
    • Introduction to deep learning
    • Optimization methods
    • Regularization methods
    • Convolutional neural networks
    • Recurrent neural networks
    • Attention-based models
    • Graph neural networks
    • Deep learning with few labeled examples
    • Deep autoencoders
    • Flow-based and autoregressive generative models
    • Generative adversarial networks
    • Unsupervised learning via denoising

     Diploma 2021