An Analysis of Linear Models, Linear Value-Function Approximation, and Feature Selection for Reinforcement Learning

We show that linear value function approximation is equivalent to a form of linear model approximation. We derive a relationship between the model approximation error and the Bellman error, and show h