Preprint
Aug 2026
AdaMTP: An Adaptive Training Paradigm for Multi-Token Prediction
AdaMTP is proposed, an adaptive training paradigm that dynamically aligns the prediction horizon with the intrinsic predictability of the sequence, and consistently outperforms standard MTP in both task performance and inference speedup.
Ziqiang Cui, Han Shi, Bowei He et al.
· 0 citations