Ming-Zhe Dai

Poisson Tangent Limits and Critical Policy Switching for Sampled Bellman Operators

Consider a discounted Markov decision process with continuous action space in which, at each state visit, the controller draws a random pool of $N$ candidate actions and selects among them. When the optimal action set has zero mass under the sampling distribution, the value of this random-candidate model converges to t...