Diffusion and flow matching are now dominant frameworks for generative modeling in continuous domains, but they typically require multiple network evaluations at inference. This has motivated extensive research on one-step generative modeling primarily built on diffusion and flow, though existing approaches often rely...
Woobin Park, Jaeyeon Kim, Yi-Lun Du et al.· 0 citations
Next-token prediction has driven remarkable progress in large language models, yet a growing body of evidence suggests that they can struggle on problems governed by complex global constraints. In this work, we focus on this regime and ask whether some of these limitations arise from the inference interface induced by...
Woosang Jeon, Jaeyeon Kim, S. Kakade et al.· 0 citations
This work introduces block-hybrid attention, which retains exact softmax attention within the active denoising block while applying linear attention over previous blocks, and shows that pretrained dLLMs can be efficiently linearized for faster inference.
Jinha Kim, Younghun Roh, Jaeyeon Kim· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.