TreeSpark: Learning to Draft the Trees You Verify for Speculative Decoding
TreeSpark is introduced, a unified training and inference framework extending the semi-autoregressive DSpark architecture that constructs parent-conditioned candidate trees from one backbone pass and replays their expansion, pruning, and budgeted packing during training.
Jihao Zhao, Qian-Yu Jiang, Shuai-Shuai Zu et al.
· 0 citations