Reinforcement Learning Using Expectation Maximization Based Guided Policy Search for Stochastic Dynamics

Abstract Guided policy search algorithms have been proven to work with incredible accuracy not only for controlling complicated dynamical systems, but also in learning optimal policies from exploration of various unseen instances. This paper deals with a trajectory optimization problem for an unknown dynamical system subject to measurement noise using expectation maximization and extends it to learning (optimal) policies which have less stochasticity in trajectories because of the higher exploitation efficiency. Theoretical and empirical evidence of learned optimal policies for the new approach is depicted in comparison to some well known baselines which are evaluated on an autonomous system with widely used performance metrics.