DA-DLM: Explicitly Modeling Token Dependencies in Diffusion Language Models
DA-DLM is proposed, a model that adapts DAG-based dependency modeling to DLMs'iterative setting through a position-oriented DAG design, and consistently outperforms Block Diffusion, especially under fewer denoising steps, and matches autoregressive models while preserving the parallel generation advantage.
Peng-Yu Ji, Zi-Chen Zhang, Xiang Hu et al.
· 0 citations