Riccardo Venturelli

Reusing Past Samples in Proximal Policy Optimization: When and How Does It Help?

Among on-policy deep reinforcement learning methods, Proximal Policy Optimization (PPO) has become the de facto standard, due to its consistently strong empirical performance across diverse application domains. However, on-policy methods are inherently sample inefficient: fresh data collected under the current policy i...