THE DYNAMICS OF AUTOMATIC CONTROL SYSTEMS

By JOSEPH JOHNSON

1 INTRODUCTION 2 AN INTRODUCTION TO DYNAMIC PROGRAMMING AND REINFORCEMENT LEARNING 3 DYNAMIC PROGRAMMING AND REINFORCEMENT LEARNING IN LARGE AND CONTINUOUS SPACES 4 APPROXIMATE VALUE ITERATION WITH A FUZZY REPRESENTATION 5 APPROXIMATE POLICY ITERATION FOR ONLINE LEARNING AND CONTINUOUS-ACTION CONTROL 6 APPROXIMATE POLICY SEARCH WITH CROSS-ENTROPY OPTIMIZATION OF BASIS FUNCTIONS APPENDIX A: EXTREMELY RANDOMIZED TREES A1 STRUCTURE OF THE APPROXIMATOR A2 BUILDING AND USING A TREE APPENDIX B: THE CROSS-ENTROPY METHOD B1 RARE-EVENT SIMULATION USING THE CROSS-ENTROPY METHOD B2 CROSS-ENTROPY OPTIMIZATION SYMBOLS AND ABBREVIATIONS BIBLIOGRAPHY