Less Uniform Discrete Diffusion is More Powerful and Scalable
Although uniform diffusion language models (UDLMs) represent a promising diffusion paradigm, scaling them remains challenging. We identify the core obstacle as an over-uniform training objective and condition-target confusion during sampling. To address these, we propose Less Uniform Diffusion (LUDI), a novel UDLM fram...
Kai-Bo Wang, Ding Ding, Fang-Yuan Ding et al.
· 0 citations