2000 character limit reached
Analyzing the Variance of Policy Gradient Estimators for the Linear-Quadratic Regulator (1910.01249v1)
Published 2 Oct 2019 in cs.LG and stat.ML
Abstract: We study the variance of the REINFORCE policy gradient estimator in environments with continuous state and action spaces, linear dynamics, quadratic cost, and Gaussian noise. These simple environments allow us to derive bounds on the estimator variance in terms of the environment and noise parameters. We compare the predictions of our bounds to the empirical variance in simulation experiments.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.
