Skip to content

Author

Yudong Wang

We have 4 of 13 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Oct 2026

UltraData-Code: From Raw Repositories to Algorithmically Dense and Task-Oriented Code Data

Code generation has become a core capability of large language models (LLMs), and code data is central to the pre-training process that develops it. As obtaining public code of sufficient quality becomes more difficult, further progress cannot rely on corpus expansion alone. Tiered data management instead applies incre...

Cheng-Ying Tu, Heng-Yu Zhao, Shuai-Kang Xue et al. · 0 citations
#artificial intelligence Preprint Oct 2026

AutoSFT: An Agentic System for Automated Data Research in Supervised Fine-Tuning

Language model agents increasingly automate post-training, but when given the full training stack they converge on supervised fine-tuning and spend most effort revising training data. Existing systems give the agent one kind of control, selecting rows from a fixed pool or calling a generator, whereas a human data engin...

Bing-Xiang He, Peng Sun, Shi-Hao Peng et al. · 0 citations

NOSA: Native and Offloadable Sparse Attention

This work proposes NOSA, a trainable sparse attention mechanism natively designed for KV cache offloading that explicitly constrains the volume of CPU-GPU KV transfers, thereby achieving low communication overhead and high decoding throughput.

Yu-Xiang Huang, Peng-Jie Wang, Ji-Cheng Han et al. · 4 citations · ⚡1
Preprint Jul 2026

UltraX: Refining Pre-Training Data at Scale with Adaptive Programmatic Editing

UltraX is proposed, a function-calling refinement framework for large-scale pre-training data that completes the editing function space by introducing insertion in addition to deletion and modification, enabling fine-grained instance-level editing.

Xinlong Zhao, Dongsheng Liu, Hengyu Zhao et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.