Skip to content

Author

Guang-Han Wang

2 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Oct 2026

Revisiting the 16x Pretraining Compute Gap between Diffusion and Autoregressive Language Models

Diffusion language models (DLMs) have attracted wide attention for their fast, parallel decoding, but they are believed to be far less efficient to train than autoregressive language models (ARMs): a widely cited study reports that a DLM needs roughly 16x the training compute of an ARM to match its likelihood, a figure...

Guang-Han Wang, B. He, Zhan Shi et al. · 3 citations
Review Oct 2026

How To Build A Modern Diffusion Language Model

The frontier of large language model (LLM) performance has advanced rapidly in recent years, fueled by scaling laws for pretraining on large text corpora. However, mainstream LLMs have fundamental limitations: they generate text autoregressively, producing outputs sequentially from left to right one token at a time. Th...

V. Kuleshov, Marianne Arriola, Yair Schiff et al. · 1 citation

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.