2018-09-06 | Lecture 1: Introduction and Course Overview (slides) (test) | (watch in the class together) |
2018-09-13 | Lecture 2: Supervised Learning and Imitation (slides) (test) | (watch home, test and discussion in class) |
2018-09-20 | Lecture 3: TensorFlow and Neural Nets Review Session (slides) (notebook) | (watch home if needed, no test) |
| Homework 1: Imitation Learning (code) | (solution presentations, deadline next day) |
2018-09-27 | Lecture 4: Reinforcement Learning Introduction (slides) (test) | (watch home, test and discussion in class) |
2018-10-04 | Lecture 5: Policy Gradients Introduction (slides) (test) | (watch home, test and discussion in class) |
2018-10-11 | Homework 2: Policy Gradients (code) | (solution presentations 1-5, deadline next day) |
2018-10-18 | Lecture 6: Actor-Critic Introduction (slides) (test) | (watch home, test and discussion in class) |
2018-10-25 | Homework 2: Policy Gradients (code) | (solution presentations 6-8, deadline next day) |
2018-11-01 | Lecture 7: Value Functions and Q-Learning (slides) (test) | (watch home, test and discussion in class) |
2018-11-08 | Lecture 8: Advanced Q-Learning Algorithms (slides) (test) | (watch home, test and discussion in class) |
2018-11-15 | Homework 3: Q-Learning and Actor-Critic (code) | (solution presentations, deadline next day) |
2018-11-22 | Lecture 9: Advanced Policy Gradients (slides) (test) | (watch home, test and discussion in class) |
2018-11-29 | Lecture 10: Optimal Control and Planning (slides) (test) | (watch home, test and discussion in class) |
2018-12-06 | Lecture 11: Model-Based Reinforcement Learning (slides) (test) | (watch home, test and discussion in class) |
2018-12-13 | Homework 4: Model-Based RL (code) | (solution presentations, deadline next day) |
2018-12-20 | Lecture 12: Advanced Model Learning and Images (slides) | (watch home, test and discussion in class) |
??? | Lecture 13: Learning Policies by Imitating Other Policies (slides) | (watch home, test and discussion in class) |
2019-02-14 | Lecture 14: Probability and Variational Inference Primer | (watch home, test and discussion in class) |
2019-02-21 | Lecture 15: Connection between Inference and Control | (watch home, test and discussion in class) |
2019-02-28 | Lecture 16: Inverse Reinforcement Learning | (watch home, test and discussion in class) |
2019-03-07 | Homework 5: Advanced Topics | (solution presentations, deadline next day) |
2019-03-14 | Lecture 17: Exploration: Part 1 | (watch home, test and discussion in class) |
2019-03-21 | Lecture 18: Exploration: Part 2 | (watch home, test and discussion in class) |
2019-03-28 | Lecture 19: Transfer Learning and Multi-Task Learning | (watch home, test and discussion in class) |
2019-04-04 | Project milestone 1 | (presentations from teams?) |
2019-04-11 | Lecture 20: Meta-Learning | (watch home, test and discussion in class) |
2019-04-18 | Lecture 21: Parallelism and RL System Design | (watch home, test and discussion in class) |
2019-04-25 | Lecture 22: Advanced Imitation Learning and Open Problems | (watch home, test and discussion in class) |
2019-05-02 | Project milestone 2 | (presentations from teams?) |
2019-05-09 | Lecture 23: Guest Lecture: Craig Boutilier | (watch home, no test) |
| Lecture 24: Guest Lecture: Kate Rakelly & Gregory Kahn | (watch home, no test) |
2019-05-16 | Lecture 25: Guest Lecture: Quoc Le | (watch home, no test) |
| Lecture 26: Guest Lecture: Karol Hausman | (watch home, no test) |
2019-05-23 | Project presentations 1 |
2019-05-30 | Project presentations 2 |