Speculative decoding accelerates autoregressive generation by using a lightweight draft to propose multiple tokens for parallel verification. However, existing methods often require an additional draft model or weight representation, introducing non-negligible memory overhead on resource-constrained devices. Self-specu...
Chen-Ce Yang, Ning-Xi Cheng, Arash Akbari et al.· 0 citations
We present IronLLM-0.6B, a 654M-parameter language model designed for efficient on-device inference. IronLLM-0.6B combines a hybrid attention architecture with X-MTP, a lightweight shared-KV multi-token prediction design that eliminates per-depth KV-cache replay and employs a lightweight verification head for rollback-...
Chang-Di Yang, Feng-Quan Jiao, Hao-Chih Lin et al.· arXiv.org· 0 citations
CoverPruner is proposed, a training-free pruner that asks the complementary demand-side question: after a token is removed, which surviving original token represents it for the target VLM?
Qin Zhu, Wei-Hang You, Han-Qi Jiang et al.· 3 citations
A three-stage fine-tuning curriculum applied to Qwen3-27B is described that is designed to progressively specialize the model for the C-to-Rust (C2Rust) translation task, and the resulting model is evaluated using the agentic, static-analysis-guided verification framework of SACTOR.
Pu Zhao, Chang-Di Yang, Yi-Xiao Chen et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.