Diffusion large language models dLLMs) have emerged as a promising alternative to autoregressive language models through bidirectional diffusion-based token generation. However, their growing model sizes and high inference costs make efficient deployment challenging: full-sequence denoising repeatedly invokes compute-i...
Donghyun Lee, Arkapravo Ghosh, Varun Manjunath et al.· 0 citations
Language models are moving beyond generating answers to pursuing long-horizon goals in interactive environments. Post-training these agents requires long, heterogeneous trajectories, and synchronous systems leave learner engines idle until rollout and verification finish. To squeeze out these pipeline bubbles, asynchro...
Seil Kang, Hangoo Kang, Tarun Suresh et al.· 0 citations
Diffusion language models (DLMs) enable fast generation by predicting multiple tokens in parallel, but their practical adoption remains limited by a persistent quality gap relative to comparably sized autoregressive (AR) models. We attribute this gap to a computation-difficulty mismatch: within a partially observed seq...
Lian-Cheng Fang, Zhuo-Wei Li, Youngeun Kim et al.· 0 citations
ReaLVR is proposed, which brings visual-evidence supervision to the model's own free-running latent trajectories, and is the first to scale visual reasoning in latent space, showing that the framework continues to deliver robust improvements at frontier model scales up to 235B.
Xi Xiao, Tian-Chen Zhao, Youngeun Kim et al.· 0 citations
ForGE is proposed, a unified framework for adapting frozen models through per-query routing over a joint action space that spans both support form and thinking depth and improves accuracy at 42-45% lower token cost on both main hosts.
Xi Xiao, Yun-Bei Zhang, Chen Liu et al.· 0 citations
Task-specific fine-tuning on SkillRet improves NDCG@10 by 12.9 points over the strongest prior retriever and by 16.2 points over the strongest off-the-shelf retriever, establishing SkillRet as a strong benchmark and foundation for future research on retrieval in large-scale agent systems.
H. Cho, Ryan Kang, Youngeun Kim· arXiv.org· 40 citations· ⚡7
This work proposes A-PACK, a two-stage framework that defers audio pruning until query-conditioned multimodal interactions emerge inside the LLM, and shows that audio exhibits higher task-relevant information density and representational diversity per token than video.
Kyeong-Jae Lee, Hongyeob Kim, Youngeun Kim et al.· 2 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.