A Model-Free Continuous-Time RL Algorithm from Discrete-Time Off-Policy Data with End-to-End Guarantees
This paper develops a model-free PhiBE policy iteration framework that uses a single state-action critic while preserving the continuous-time action-ranking scale and identifies a bias-variance trade-off: smaller sampling intervals improve the approximation to the continuous-time problem but can increase statistical er...