Skip to main content
MyCourses MyCourses
  • Schools
    School of Arts, Design, and Architecture (ARTS) School of Business (BIZ) School of Chemical Engineering (CHEM) –sGuides for students (CHEM) – Instructions for report writing (CHEM) School of Electrical Engineering (ELEC) School of Engineering (ENG) School of Science (SCI) Language Centre Open University Library Aalto university pedagogical training program UNI (exams) Sandbox
  • CORONAVIRUS INFO
    Koronavirus - tietoa opiskelijalle Coronavirus - information for students Coronavirus - information för studerande Koronaviruksen vaikutus opiskeluun: kysymyksiä ja vastauksia Effects of the coronavirus on studies: questions and answers Coronaviruset och studierna: frågor och svar Corona help for teachers
  • Service Links
    MyCourses - Instructions for Teachers - Teacher book your online session with a specialist - Digital tools for teaching - Personal data protection instructions for teachers - Instructions for Students - Workspace for thesis supervision WebOodi Into portal for students Courses.aalto.fi Library Services - Resourcesguides - Imagoa / Open science and images IT Services Campus maps - Search spaces and see opening hours Restaurants in Otaniemi ASU Aalto Student Union Aalto Marketplace
  • ALLWELL?
    Study Skills Support for Studying Starting Point of Wellbeing About AllWell? study well-being questionnaire
  •   ‎(en)‎
      ‎(en)‎   ‎(fi)‎   ‎(sv)‎
  • Toggle Search menu
  • Hi guest! (Log in)

close

CS-E4070 - Probabilistic Modelling for Cognition and Interaction: Towards AI That Understands Its User, 19.02.2018-14.05.2018

  1. Home
  2. Courses
  3. School of Science
  4. department of...
  5. cs-e4070 - pr...
Syllabus

General

  • General

    General

    Humans are the drivers and benefactors of the progress in artificial intelligence and machine learning. On the other hand, artificial intelligence and machine learning are breaking ground for new kinds of user interfaces and user experiences. Closing this loop, that is, optimally combining the strengths of humans and machines, is one of the most interesting scientific questions at the moment. This course provides a look into state-of-the-art research at this intersection of probabilistic machine learning, cognitive models, and human-machine interaction.

    The course will be useful for students how are interested in:

    • machine learning: A bottleneck for AI systems is that they don't understand humans.
    • cognitive science: Understanding human behaviour is of interest as such.
    • human-computer interaction: A bottleneck for intelligent interfaces is modeling human cognition and behavior and getting humans to understand the system.

    All these fields share a common underlying challenge, for which the modelling of humans, machines, and their environment can provide the solution.

    The course will include (1) high-level introductory lectures on the main topics, including computational rationality, reinforcement learning, probabilistic programming, and user modelling, (2) a project work for hands-on experience and a deeper look into a topic, and (3) select readings of research papers for a wider scope overview.

    Prerequisites: Either (1) good understanding of probabilistic modelling/machine learning and programming experience (implementing machine learning algorithms) with interest in HCI/cognitive science/reinforcement learning, or (2) good understanding of HCI and some background in probabilistic modelling/machine learning with interest to learn more. The course is intended for advanced Master’s level or PhD level students. Courses providing relevant background include, for example, CS-E3210 - Machine Learning: Basic Principles, CS-E4820 - Machine Learning: Advanced Probabilistic Methods, CS-E5710 - Bayesian Data Analysis, CS-E4800 - Artificial Intelligence.

    Credits: 3 or 5 ECTS.

    Passing the course
    (1 and 2 required for 3 ECTS, and in addition 3 for 5 ECTS):
    (1) present (20 minute presentation) one paper, which will then be discussed (~25 min for discussion) and prepare a handout (1--3 pages including notes about the discussion after the presentation; returned to mycourses within the week of the presentation); possibly done in groups of 2-3 students depending on the number of students; required for passing the course
    (2) learning diaries on papers (learning diaries should be returned to mycourses before the meeting where the paper will be discussed; learning diaries returned late will count only half point)
    (3) project work, including short presentation of it (~10min or poster, to be decided based on how many students) and report (3-6 pages, returned to mycourses); project work can be done in pairs

    Grading:
    For 3 ECTS: grade=min(5, number of learning diaries returned); 0 if no paper presentation done; all course work must be returned to mycourses by the end of period V, 18.5.2018, to count.
    For 5 ECTS: grade=(2/5) * grade of project work + (3/5) * min(5, number of learning diaries returned); 0 if no paper presentation done (and 3 ECTS if no project work returned); all course work must be returned to mycourses by the end of period V, 18.5.2018, to count.

    Schedule
    (all meetings on Mondays at 14.15-16.00 in T3, CS building, except on 9.4. the meeting is in T6):

    19.2. Overview, practicalities; Introductory lecture: Interactive machine learning (Lecturer: Dr. Tomi Peltola)

    26.2. Introductory lecture: Reinforcement learning (Lecturer: Prof. Ville Kyrki)

    5.3. Seminar: Experimental design and Bayesian optimization for interaction

    1. Sections 1,2, and 5 of Eric Brochu, Vlad M. Cora, Nando de Freitas. A Tutorial on Bayesian Optimization of Expensive Cost Functions, with Application to Active User Modeling and Hierarchical Reinforcement Learning. https://arxiv.org/abs/1012.2599 [assigned: course staff]
    2. Brochu et al. A Bayesian interactive optimization approach to procedural animation design. 2010, Proceedings of the 2010 ACM SIGGRAPH/Eurographics Symposium on Computer Animation. https://dl.acm.org/citation.cfm?id=1921443 [assigned: course staff]

    12.3. Introductory lecture: Computational rationality I (Lecturer: Prof. Antti Oulasvirta)

    19.3. Introductory lecture: Computational rationality II (Lecturer: Dr. Jussi Jokinen)

    26.3. Introductory lecture: Probabilistic programming (Lecturer: Prof. Aki Vehtari, Dr. Henri Vuollekoski)

    2.4. No meeting

    9.4.  Seminar: Computational rationality and reinforcement learning I. Note: Room T6.

    1. Gershman, Horvitz, Tenenbaum. Computational rationality: A converging paradigm for intelligence in brains, minds, and machines, Science, Vol. 349, Issue 6245, pp. 273-278, 2015. http://science.sciencemag.org/content/349/6245/273 [assigned: Pradeep]
    2. Lewis, Howes, Singh, Computational Rationality: Linking Mechanism and Behavior Through Bounded Utility Maximization, Topics in Cognitive Science 6 (2014) 279–311. http://onlinelibrary.wiley.com/doi/10.1111/tops.12086/full [assigned: Buse, Karina]

    16.4. Seminar: Computational rationality and reinforcement learning II

    1. Howes et al., Interaction as an emergent property of a partially observable Markov decision process. Chapter 10 in Computation Interaction, edited by Oulasvirta, Kristensson, Bi, and Howes, Oxford University Press, 2018. [assigned: Thomas, Ville]
    2. Rabinowitz et al. Machine Theory of Mind, https://arxiv.org/abs/1802.07740 [assigned: Janin] (Kangasrääsiö et al. Inferring Cognitive Models from Data using Approximate Bayesian Computation, CHI2017, https://dl.acm.org/citation.cfm?doid=3025453.3025576)

    23.4. Seminar: Probabilistic programming

    1. Cusumano-Towner et al., Probabilistic programs for inferring the goals of autonomous agents, https://arxiv.org/abs/1704.04977 [assigned: course staff]
    2. Owain Evans, Andreas Stuhlmueller, Noah Goodman. Learning the Preferences of Ignorant, Inconsistent Agents, AAAI2016. https://www.aaai.org/ocs/index.php/AAAI/AAAI16/paper/view/12476 [assigned: Mauro, Tinka]

    30.4. Seminar: Compositionality, causality, and learning to learn I

    1. Lake, Salakhutdinov, Tenenbaum, Human-level concept learning through probabilistic program induction. 2015, Science. http://science.sciencemag.org/content/350/6266/1332 [assigned: Kunal, Stig-Arne]
    2. Santoro et al, Meta-Learning with Memory-Augmented Neural Networks, ICML2016, http://proceedings.mlr.press/v48/santoro16.pdf [assigned:] - there will probably not be a presentation of this paper

    7.5. Seminar: Compositionality, causality, and learning to learn II [note: these papers will be assigned to 2 groups of students, who decide how to split the presentation between them (that is, split the first paper in a suitable way and second group takes additionally the second paper); assigned: Fabio]

    1. Lake et al. Building Machines That Learn and Think Like People, Behavioral and Brain Sciences, 40, E253, 2017. https://www.cambridge.org/core/journals/behavioral-and-brain-sciences/article/building-machines-that-learn-and-think-like-people/A9535B1D745A0377E16C590E14B94993
    2. Botvinick et al. Building Machines that Learn and Think for Themselves: Commentary on Lake et al., Behavioral and Brain Sciences, 2017, https://www.cambridge.org/core/journals/behavioral-and-brain-sciences/article/building-machines-that-learn-and-think-for-themselves/E28DBFEC380D4189FB7754B50066A96F

    14.5. Final meeting: project presentations, summary, feedback on course No meeting!


    Course organizers: Tomi Peltola, Mert Çelikok, Samuel Kaski; Probabilistic Machine Learning research group

    Please, use the course forum for general questions and issues regarding the course. The course staff can also be contacted by e-mail if necessary.


    • icon for activity Announcements Forum
    • icon for activity General discussion Forum

Course home

Course home

Next section

Materials / Lecture slides►
Skip Upcoming events
Upcoming events
Loading There are no upcoming events
Go to calendar...
  • CS-E4070 - Probabilistic Modelling for Cognition and Interaction: Towards AI That Understands Its User, 19.02.2018-14.05.2018
  • Sections
  • General
  • Materials / Lecture slides
  • Assignments
  • Course work instructions
  • Home

Aalto logo

Tuki / Support
  • MyCourses help
  • mycourses(at)aalto.fi
Palvelusta
  • MyCourses rekisteriseloste
  • Tietosuojailmoitus
  • Palvelukuvaus
  • Saavutettavuusseloste
About service
  • MyCourses protection of privacy
  • Privacy notice
  • Service description
  • Accessibility summary
Service
  • MyCourses registerbeskrivining
  • Dataskyddsmeddelande
  • Beskrivining av tjänsten
  • Sammanfattning av tillgängligheten

Hi guest! (Log in)
  • Schools
    • School of Arts, Design, and Architecture (ARTS)
    • School of Business (BIZ)
    • School of Chemical Engineering (CHEM)
    • –sGuides for students (CHEM)
    • – Instructions for report writing (CHEM)
    • School of Electrical Engineering (ELEC)
    • School of Engineering (ENG)
    • School of Science (SCI)
    • Language Centre
    • Open University
    • Library
    • Aalto university pedagogical training program
    • UNI (exams)
    • Sandbox
  • CORONAVIRUS INFO
    • Koronavirus - tietoa opiskelijalle
    • Coronavirus - information for students
    • Coronavirus - information för studerande
    • Koronaviruksen vaikutus opiskeluun: kysymyksiä ja vastauksia
    • Effects of the coronavirus on studies: questions and answers
    • Coronaviruset och studierna: frågor och svar
    • Corona help for teachers
  • Service Links
    • MyCourses
    • - Instructions for Teachers
    • - Teacher book your online session with a specialist
    • - Digital tools for teaching
    • - Personal data protection instructions for teachers
    • - Instructions for Students
    • - Workspace for thesis supervision
    • WebOodi
    • Into portal for students
    • Courses.aalto.fi
    • Library Services
    • - Resourcesguides
    • - Imagoa / Open science and images
    • IT Services
    • Campus maps
    • - Search spaces and see opening hours
    • Restaurants in Otaniemi
    • ASU Aalto Student Union
    • Aalto Marketplace
  • ALLWELL?
    • Study Skills
    • Support for Studying
    • Starting Point of Wellbeing
    • About AllWell? study well-being questionnaire
  •   ‎(en)‎
    •   ‎(en)‎
    •   ‎(fi)‎
    •   ‎(sv)‎