Author

Quanquan Gu

h-index 4 View on Semantic Scholar

We have 2 of 7 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#artificial intelligence Jan 2026

Deep Delta Learning

This work pretrain decoder-only models with approximately GPT-2 small and medium sizes on the FineWeb-Edu dataset and introduces Deep Delta Learning (DDL), which applies the delta rule over network depth.

Yi-Fan Zhang, Yi-Feng Liu, Mengdi Wang et al. · arXiv.org · 8 citations · ⚡2

Jul 2026

DeepLoop: Depth Scaling for Looped Transformers

The results show that stable recurrent depth requires residual scaling rules that account for parameter visits, not only nominal layer count, and DeepLoop is neutral when no physical block is revisited and improves validation loss and downstream accuracy once recurrent depth is activated.

Shu-zhen Li, Yi-Fan Zhang, Jiacheng Guo et al. · arXiv.org · 2 citations