M. Buvanasankari

Mathematical Foundations of Reinforcement Learning and Stochastic Control Systems

The paper concludes that convergence guarantees degrade in a predictable, representation-dependent order as function approximation grows more expressive, and identifies extending stochastic approximation theory to nonlinear function approximation as the central future research prospect.