Let It Go or Learn to Self-Correct: Continuous Diffusion for Constrained Discrete Tasks
The results suggest that continuous diffusion models can learn nontrivial global constraints, but discrete reasoning tasks require better alignment between training and inference: either through samplers that reduce commitment to early decisions, or through training that teaches the model to correct its own inference-t...