Preprint
Aug 2026
Listening Forward: Next Patch Embedding Prediction Enables Scalable Audio Learners
NAPE (Next-Audio-Patch-Embedding prediction), a self-supervised framework in which a causal Transformer predicts each next patch embedding of a log-mel spectrogram from the previous ones, using causal masking and stop-gradient as its sole training signal is introduced.
Umberto Cappellazzo, Xubo Liu, Stavros Petridis et al.
· 0 citations