Chapter 1 Introduction of Reinforcement Learning -- Chapter 2 Principles of RL Problems -- Chapter 3 Model-free Indirect RL: Monte Carlo -- Chapter 4 Model-Free Indirect RL: Temporal-Difference -- Chapter 5 Model-based Indirect RL: Dynamic Programming -- Chapter 6 Indirect RL with Function Approximation -- Chapter 7 Direct RL with Policy Gradient -- Chapter 8 Infinite Horizon Approximate Dynamic Programming -- Chapter 9 Finite Horizon ADP and State Constraints -- Chapter 10 Deep Reinforcement Learning -- Chapter 11 Advanced RL Topics.