Decision Support Systems 2
Lecture #10: Markov decision processes
Time and place:
Thursday 16 November 2000, 10:15-12:00 in Room E1-214
Responsible:
Peter Jensen
Literature:
Stuart Russell and Peter Norvig (1995),
Artificial Intelligence, A Modern Approach,
Prentice Hall, Ch. 17, pages 498-506.
Michael L. Littman (1996),
Algorithms for Sequential Decision Making
, PhD Thesis, Departmant of Computer Science, Brown University, Providence, RI USA, Ch. 1-2.
Tutorial:
Tony's POMDP Page
, Departmant of Computer Science, Brown University, Providence, RI, USA.
Supplementary literature:
Richard S. Sutton (1998?),
On the Significance of Markov Decision Processes
, Departmant of Computer Science, University of Massachusetts, Amherst, MA USA.
Michael L. Littman, Thomas L. Dean and Leslie Pack Kaelbling (1995?),
On the Complexity of Solving Markov Decision Problems
, Departmant of Computer Science, Brown University, Providence, RI USA.
Exercises:
Not (yet) available
Slides:
Not (yet) available
A master copy of the excerpt from Chapter 17 in the book of Stuart Russell and Peter Norvig is available in Regitze's office (C1-210).