Many real-world applications require language models to internalize knowledge that was absent from pretraining, to incorporate continually updated facts, or to learn new domain skills. Self-distillation has emerged as a natural approach for this task. A model conditioned on the source material acts as the teacher, and...
Shayan Talaei, A. Bhatia, Arshia Soltani Moakhar et al.· 1 citation
This work introduces ThunderSyncRL, which starts gradient computation as soon as all required inputs are fixed, without policy staleness, and proves that gradient streaming produces the same GRPO and OPD updates as batch-synchronous training, without changing either objective.
Seil Kang, Hangoo Kang, Tarun Suresh et al.· 0 citations
An emerging hypothesis about reinforcement learning (RL) post-training of large language models (LLMs) is that it merely sharpens existing behaviors of a base model, improving single-shot accuracy at the cost of solution coverage. Although this trade-off has been observed in math and coding tasks, it need not extend to...
Compiler backends are expensive to build and maintain as programming models, workloads, and accelerators evolve. We investigate whether large language models can replace the conventional optimizing and lowering pipeline, a process that we call AI lowering. We study AI lowering from Triton to NVIDIA PTX: an LLM agent tr...
François Costa, Charly Castes, Thomas Bourgeat et al.· 0 citations
To scale BP to long contexts, this work introduces context-sharded block parallelism (CSBP), which keeps corrupted K/V and gradients local, avoids replicated clean prefixes, and preserves BDLM training semantics.
Tarun Suresh, Pranshu Chaturvedi, Hangoo Kang et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.