Offline Policy Evaluation via Mixed Bellman Residuals and Adaptive Critic Representations
A convex combination of one-step and two-step residuals with a fixed mixing weight is considered to provide a natural bias--variance trade-off between approximation error under a restricted value-function class and the increased variance arising from multi-step importance weighting.
Amitakshar Biswas, Yu-Han Li, Ruo-Qing Zhu
· 0 citations