Skip to content

Author

Xian-Duo Li

2 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Sep 2026

SlideDP: Scaling Host-Resident LLM Fine-Tuning Across Multiple GPUs

SlideDP is presented, a synchronous data-parallel runtime for shared-host multi-GPU systems that maintains one authoritative host state, decouples communication routes from state layout, and pipelines parameter delivery, gradient aggregation, and CPU updates across ranks and chunks.

Rui-Jia Yang, Shi-Yuan Lin, Yu-Long Ao et al. · 0 citations
#artificial intelligence Preprint Sep 2026

MassAlloc Attention: Let Attention Allocate Its Own Compute

FullAttn often assigns negligible normalized mass to much of the causal score space, yet dense kernels execute the complete post-score path after forming each QK tile. We introduce MALA, a fused attention primitive that preserves score access to every legal causal interaction and uses normalized contribution to allocat...

Jing-Ze Shi, Zhang-Yang Peng, Xian-Duo Li et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.