Skip to content

Author

Ali Modarressi

2 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Oct 2026

Diffusion Language Models Change Speed Across Tasks and Languages

Diffusion language models can write several tokens in one forward pass, and they decide during generation how many passes to spend. Two outputs of the same token length can therefore vary a lot in cost. To understand the underlying factors of this cost variation, we analyze two diffusion models across 10 tasks. We find...

Mohsen Fayyaz, Ali Modarressi, Daniel Mingyi Israel et al. · 0 citations

Expert-Aware Causal Tracing of Factual Recall in Sparse MoE Language Models

Findings show that successful MoE-block restoration does not necessarily imply localization to a single expert, as it is shown that successful MoE-block restoration does not necessarily imply localization to a single expert.

Yuetian Lu, Ali Modarressi, Yihong Liu et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.