DiffusionRVGE: Reinforcement Learning via Regression-Based Value Gradient Estimation
Reinforcement learning improves diffusion models using rewards on generated images, but repeated denoising and gradient estimation make training expensive. We introduce \method, an efficient method that constructs useful update directions by regressing centered rewards on centered final denoised images. It requires nei...