Low-Confidence Remasking Traps Flexibility: Realizing Arbitrary-Order Potential for Diverse Rollouts in Diffusion LLMs
This work traces diversity loss to low-confidence remasking not to arbitrary-order generation itself, but largely to low-confidence remasking (LCR), a widely used decoding rule, and introduces Entropy-Guided Initialization (EGI), which samples the first token at the highest-entropy position and then follows TPP.