This is a draft schedule and is subject to change.
| Week | Date | Broad Area | Reading List | Slides / Video |
|---|---|---|---|---|
| 1 | Aug 18 | Course Intro | Lecture 1 Slides | |
| Aug 20 | Intro to RL | Lecture 2 Slides | ||
| 2 | Aug 25 | RL methods overview | Lecture 3 Slides | |
| Aug 27 | Policy Gradients | Lecture 4 Slides | ||
| 3 | Sep 1 Labor Day | Actor-critic | Lecture 5 Slides | |
| Sep 3 | Value function methods | Lecture 6 Slides | ||
| 4 | Sep 8 | Deep RL with Q-Functions | Lecture 7 Slides | |
| Sep 10 | Advanced Policy Gradients | Lecture 8 Slides | ||
| 5 | Sep 15 | Optimal Control and Planning | Lecture 9 Slides | |
| Sep 17 | Model-Based Reinforcement Learning | |||
| 6 | Sep 22 | Model-Based Reinforcement Learning | ||
| Sep 24 | Model-Based Reinforcement Learning | |||
| 7 | Sep 29 | Model-Based Policy Learning | ||
| Oct 1 | Diff Sim + RL | |||
| 8 | Oct 6 Fall Break | Supervised Learning + Modern Architectures | ||
| Oct 8 | Inverse Reinforcement Learning | |||
| 9 | Oct 13 | Multi-agent RL | ||
| Oct 15 | Offline Reinforcement Learning | |||
| 10 | Oct 20 | Exploration | ||
| Oct 22 | Exploration | |||
| 11 | Oct 27 | Hierarchical RL | ||
| Oct 29 | RL with Sequence Models | |||
| 12 | Nov 3 | No Class | ||
| Nov 5 Online Lecture | ||||
| 13 | Nov 10 | |||
| Nov 12 | Constrained RL: Safe RL | |||
| 14 | Nov 17 | Goal-Conditioned RL, Meta-Learning and Transfer Learning | ||
| Nov 19 | RL for Preference alignment | |||
| 15 | Nov 24 | Challenges and Open Problems | ||
| Nov 26 Thanksgiving Break | ||||
| 16 | Dec 1 | final class |