Informed Masking: Structure-Aware Perturbation for Reinforcement Learning in Diffusion Large Language Models
This work identifies a systematic upstream/downstream structure in dLLM rollouts and proposes Informed Masking (IM), which derives a per-token priority score from the denoising trajectory at zero extra inference cost and biases mask sampling toward downstream tokens.
Xiao-Yi Yu, E. Sangineto, Pei Fu et al.
· Conference on Empirical Meth... · 0 citations