Whisper-Flash: Acoustically Conditioned Parallel Drafting for Faster Whisper Decoding
This work presents Whisper-Flash, a two-layer drafter built on a property of speech recognition: the words still to be written have already been spoken, which reads Whisper's encoded audio and accepted decoder states and proposes eight tokens in a single forward pass.