Lecture 10 - Discounted problems, numerical methods

Stationary, discounted problems

DP algorithm and infinite horizon

Bellman equation and numerical methods:

  • backward recursion
  • value iteration
  • policy iteration

functional equation, fixed-point iteration

Sections from the book: Bertsekas vol 2, Miranda&Fackler 2002: Applied computational economics and finance