BV Loss: Block Verification-Aware Loss for Block Diffusion Speculative Decoding
Block Verification-aware loss (BV loss), a training objective designed to maximize the expected acceptance length of a drafted sequence, outperforms tokenwise acceptance objectives such as TV loss and LK loss, and its gains extend to token verification and greedy decoding.
Suyoung Kim, Jahyun Koo, Hyeonjin Kim et al.
· 0 citations