Credits: 3

Schedule: 11.09.2019 - 04.12.2019

Contact information for the course (applies in this implementation): 

Neda B. Marvasti

neda.marvasti@aalto.fi

Teaching Period (valid 01.08.2018-31.07.2020): 

Varies.

Content (valid 01.08.2018-31.07.2020): 

Postgraduate level knowledge from one of the fields of computer and information science. The actual contents of the course vary from year to year. The course can be lectured, or arranged in seminar form.

Details on the course content (applies in this implementation): 

CS-E4070 - Approximate Bayesian Computation: 2019  (3 ECTS)

Responsible Teacher: Neda B. Marvasti

Level of the Course: Master's and PhD level

Teaching Period: I-II (Autumn)

Description:  Approximate Bayesian Computation (a.k.a. ABC, likelihood-free inference) is a new class of computational inference methods that can be used when the likelihood function is difficult to evaluate or unknown, and one has a simulator for generating data that (hopefully) resemble observations when generated with correct parameters. The underlying intuition is that similar model parameters are likely to generate similar data, but the practice is of course a bit more complex... 

ABC has applications from medicine to particle physics, and is expected to revolutionise computational sciences that cannot apply traditional statistical methods.


Assessment Methods and Criteria (valid 01.08.2018-31.07.2020): 

To be specified at the start of the course.

Elaboration of the evaluation criteria and methods, and acquainting students with the evaluation (applies in this implementation): 

To pass the course you have to :

  1. Give a presentation (approx 30 min) on a related topic (50%)
  2. Act as an opponent in a presentations (5%)
  3. Finish an assignment (30%)
  4. Peer-review 2 assignments (5%)
  5. Present your assignment (approx 5-10 min) (10%)

First meeting on 11 September at 12:15 in room T3. An introduction to ABC will be given along with agreeing about seminar duties and schedule.


Details on calculating the workload (applies in this implementation): 

Opponents should have a look at the topic beforehand and actively ask questions. It's ok to substitute missed duties at other times as well.

Lectures should cover the general idea of the algorithm, theory and examples, and last about 30 minutes. Consider implementing the algorithm yourself and presenting how it works (this is probably the best way to learn!).

The assignment is to perform a case study on some proper problem, either with real data or a toy model, and produce a "notebook" (Jupyter Notebook) with introduction, methods, codes and results. Please check your topic with lecturer.

The due date for assignments is 27 November, after which there's one week for peer-reviewing. The assignments can be done within the ELFI framework.


Study Material (valid 01.08.2018-31.07.2020): 

Usually some new study book or collection of articles.

Details on the course materials (applies in this implementation): 

Check introduction.pdf in materials

Some material in arbitrary order (also check references therein):

Review papers to find references of your selected topic (do not present the review papers itself):

Useful for lecture 1:
Useful for lecture 2 & 3 (you can select one of the following papers or find a recent paper):
Useful for lecture 4 & 5: 
Check slide 15 of the introduction slide

Useful for lecture 6:
Check slide 16 in the introduction slide

Useful for lecture 7:

Useful for lecture 8
Useful for lecture 9


Substitutes for Courses (valid 01.08.2018-31.07.2020): 

T-61.6010 Special Course in Computer and Information Science I, T-61.6020 Special Course in Computer and Information Science II, T-61.6030 Special Course in Computer and Information Science III, T-61.6040 Special Course in Computer and Information Science IV, T-61.6050 Special Course in Computer and Information Science V, T-61.6060 Special Course in Computer and Information Science IV, CS-E4010 Special Course in Machine Learning and Data Science I, CS-E4020 Special Course in Machine Learning and Data Science II, CS-E4030 Special Course in Machine Learning and Data Science III, CS-E4040 Special Course in Machine Learning and Data Science IV, CS-E4050 Special Course in Machine Learning and Data Science V, CS-E4060 Special Course in Machine Learning and Data Science VI.

Grading Scale (valid 01.08.2018-31.07.2020): 

0-5, may be graded with pass/fail

Further Information (valid 01.08.2018-31.07.2020): 

The contents of the course vary.

Additional information for the course (applies in this implementation): 

A maximum of 30 students will be accepted to the course.


Details on the schedule (applies in this implementation): 

Meeting dates (subject to changes!): 

  • 11 September (Introduction & practicals)
  • 18 September (Rejection sampling +MCMC-ABC +SMC-ABC), (Convergence, validation, post-processing in ABC), (Distance metrics & summary statistics)
  • 25 September(Summary statistics selection methods)
  •  2 October (Summary statistics selection methods)
  • 9 October (Sampling-based ABC methods)
  • 16 October (Sampling-based ABC methods)
  • 30 October (Regresion based ABC methods)
  • 6 November (BOLFI, Variational methods in ABC)
  • 13 November  (GANs for LIFE)
  • 20 November (High-dimensional ABC)(Model selection in ABC)
  • 27 November (Assignment presentations)

Description

Registration and further information