ch. 1. Introduction -- ch. 2. An introduction to dynamic programming and reinforcement learning -- ch. 3. Dynamic programming and reinforcement learning in large and continuous spaces -- ch. 4. Approximate value iteration with a fuzzy representation -- ch. 5. Approximate policy iteration for online learning and continuous-action control -- ch. 6. Approximate policy search with cross-entropy optimization of basis functions.