Look Who it Was Random video

[PURDUE MLSS] A Short Course on Reinforcement Learning by Satinder Singh Baveja (Part 2/6)

2,398 views · Published 30 November 2011 · 1:04:36 · Indexed 29 September 2026

Channel: Purdue University · 2011 · Science & Technology

Watch on YouTube

Lecture notes: http://learning.stat.purdue.edu/mlss/_media/mlss/singh.pdf

A Short Course on Reinforcement Learning

This short course will be a three-part tutorial on reinforcement learning (RL) interpreted broadly to include related methods from decision theoretic planning, optimal control and operations research.

The first part of the course will cover the basics of RL. Topics covered will include Bandit problems and algorithms for solving them, Markov decision problems (MDPs) and foundational algorithms for solving them in planning and learning settings, as well as Partially observable MDPs (POMDPs) and foundational algorithms for solving them in the planning and learning settings.

The second part of the course will cover advanced methods for solving MDPs and POMDPs, the use of function approximation in RL, a case study of a couple of applications of RL, and narrower topics such as inverse RL and apprenticeship learning. Time permitting I might cover some results from RL in multiagent settings.

The third part of the course will cover cutting-edge topics including approaches to state estimation such as predictive state representations (PSRs), the use and learning of structured probabilistic models in controlled dynamical systems, and the recently defined optimal reward problem. I will conclude with some open challenge problems in RL.

See other lectures at Purdue MLSS Playlist: http://www.youtube.com/playlist?list=PL2A65507F7D725EFB&feature=view_all

More from this channel