ELEC-E8125 - Reinforcement learning D, Lecture, 13.9.2021-8.12.2021

Topic outline

• Assignments
  Rules and arrangements
  

  The course will have six compulsory individual assignments making up 50% of the final grade. The assignments will be introduced in the exercise sessions. Instructions and materials will appear on this page.
  

  Each assignment will be graded and the assignments constitute towards the course grade.

  Keep in mind that the assignments and quizzes are to be completed individually by each student. While it is perfectly fine to discuss the algorithms, implementations and the concepts taught in the course with your peers, directly sharing answers, data or code will not be accepted. In short—share ideas, not answers.
  

  Remember to submit all your solutions on time, and double check that your submission contains all the necessary files, as listed at the end of the assignment instruction document. We do not accept any submissions or additional files after the submission system in MyCourses closes. The only exceptions are in well justified cases such as illness (supported by a proper certificate) or military service. If you cannot submit the assignment on time due to university-related reasons, such as attending a conference, please inform the course staff in advance.
  

  Exercise Sessions

  There are three exercise sessions per week in which you can ask questions about the lectures and exercises. Attendance is optional. The sessions take place online: https://aalto.zoom.us/j/64468034932?pwd=RlpYd2grYkNVQUdJKy8zQWF6VHdKdz09
  

  H02 Exercises - Monday 12:15-14:00
  

  H03 Exercises - Tuesday 12:15-14:00

  H01 Exercises - Wednesday 10:15-12:00
  

  Quizzes

  The quizzes are individual works and should be completed independently. The answers can be found in the lectures and readings. The quizzes will make up 20% of the final grade.
  

  Deadlines

  The hard-deadlines for each assignments is listed below. There are three weeks from when the assignment is uploaded until the deadline.
  

  • Exercise 1 - Release: 13.09.2021 - Deadline 04.10.2021
    

  • Exercise 2 - Release: 20.09.2021 - Deadline 11.10.2021
    

  • Exercise 3 - Release: 27.09.2021 - Deadline 18.10.2021
    

  • Exercise 4 - Release: 04.10.2021 - Deadline 25.10.2021
    

  • Exercise 5 - Release: 11.10.2021 - Deadline 01.11.2021
    

  • Exercise 6 - Release: 18.10.2021 - Deadline 08.11.2021
    

  
  

  
  

  • Select activity Exercise sessions on campus

    

    Exercise sessions on campus Choice
  • Select activity Assignments Setting-up and Introduction

    Assignments Setting-up and Introduction

  • Select activity Setting Things Up and Submission Instructions

    

    Setting Things Up and Submission Instructions File PDF
  • Select activity Exercise intro slides

    

    Exercise intro slides File PDF
  • Select activity Exercise Report Latex Template

    

    Exercise Report Latex Template File ZIP
  • Select activity PyTorch intro

    

    PyTorch intro Folder
  • Select activity Exercises

    Exercises
    

  • Select activity Exercise 1 - Reinforcement Learning introduction

    

    Exercise 1 - Reinforcement Learning introduction Assignment
  • Select activity Exercise Week 1 - Intro

    

    Exercise Week 1 - Intro File MP4
  • Select activity Exercise 2 - Value iteration

    

    Exercise 2 - Value iteration Assignment
  • Select activity Exercise 3 - Grid-based Q-Learning

    

    Exercise 3 - Grid-based Q-Learning Assignment
  • Select activity Exercise 4 - Q-Learning with Function Approximation

    

    Exercise 4 - Q-Learning with Function Approximation Assignment
  • Select activity Exercise 4 Intro

    

    Exercise 4 Intro File MP4
  • Select activity Mnih, Volodymyr, et al. "Playing Atari with Deep Reinforcement Learning". (2013)

    

    Mnih, Volodymyr, et al. "Playing Atari with Deep Reinforcement Learning". (2013) URL
  • Select activity Exercise 5 - Policy Gradient

    

    Exercise 5 - Policy Gradient Assignment
  • Select activity Exercise 6 - Actor Critic

    

    Exercise 6 - Actor Critic Assignment
  • Select activity Quizzes

    Quizzes
    

  • Select activity Quiz 1

    

    Quiz 1
  • Select activity Quiz 2

    

    Quiz 2
  • Select activity Quiz 3

    

    Quiz 3
  • Select activity Quiz 4

    

    Quiz 4
  • Select activity Quiz 5

    

    Quiz 5
  • Select activity Quiz 6

    

    Quiz 6
  • Select activity Quiz 7

    

    Quiz 7