CoReLoop is proposed, which enables controlled recurrent refinement through loop-specific LoRA and lightweight modules that adapt recurrent inputs, regulate state updates, and align refined representations with the frozen classifier.
Abstract
Audio deepfake detectors are expected to remain robust to diverse attacks, datasets, and recording conditions, yet collecting training data that cover every future condition is impractical. We investigate whether an already-trained SSL-based detector can improve its generalization through additional recurrent computation, without introducing new training data or updating its original parameters. Directly feeding the encoder output back as its next input, however, severely degrades detection, revealing a mismatch between the representations produced and consumed by a model trained for single-pass inference. We therefore propose CoReLoop, which enables controlled recurrent refinement through loop-specific LoRA and lightweight modules that adapt recurrent inputs, regulate state updates, and align refined representations with the frozen classifier. Across 14 diverse test sets, CoReLoop improves pooled EER across 3-, 6-, 12-, and 24-layer encoders; on the 24-layer model, two-pass refinement reduces EER from 4.85% to 3.74% while training only approximately 11M of 598M parameters. An optional halting head further selects refinement depth per utterance, achieving 3.73% EER with an average of 1.18 passes. Analysis shows that later-pass saturation coincides with smaller applied updates and nearly balanced corrections and regressions, while the recurrent state continues to change.
The proposed Real-Anchored Mechanism-Incremental (RAMI) protocol reflects the practical setting in which available real speech provides a recurring mixed-domain reference while new deepfake mechanisms arrive incrementally and RF-Prompt, an asymmetric continual prompt-learning method that preserves reusable real-speech...
Yuan-Kun Xie, Xiao-Xuan Guo, Xiao-Peng Wang et al.· arXiv.org· 0 citations
Advances in speech synthesis have made deepfake speeches increasingly convincing, posing growing threats to security. While self-supervised learning (SSL) based detectors achieve state-of-the-art performance, their computational demands (typically 300M+ parameters) prevent deployment on resource-constrained devices. Ex...
Miao He, Peng Cheng, Zhong-Jie Ba et al.· Interspeech· 0 citations
Looped transformers increase effective depth by repeatedly applying a shared set of transformer layers, offering a parameter-efficient way to scale computation. However, standard residual connections aggregate information across recurrent depth into a single stream, providing limited control over which intermediate rep...
Yue-Kun Yao, Yu-Pei Du, Da-Wei Zhu et al.· 0 citations
AdaVSkip is proposed, which equips each layer with two lightweight routers that independently determine whether visual tokens pass through by or skip the self-attention and MLP modules, and maintains strong task performance with substantially less computation.
Yu-Yao Sun, Tao Deng, Shuang-Hua Li et al.· arXiv.org· 0 citations
Audio deepfake detection (ADD) aims to distinguish bonafide speech from synthetic or manipulated speech. Representations from different layers of self-supervised learning (SSL) speech encoders vary in their ability to distinguish bonafide from spoofed speech. Comparing representations of the same utterance across encod...
Yang-Yang Qu, Si-Qing Qin, Kong Aik Lee et al.· 0 citations
Modern text-to-speech (TTS) systems are rarely deployed as unchanged pre-trained models. They are often adapted through supervised fine-tuning (SFT) or preference optimization such as DPO and GRPO. This raises a practical question for audio deepfake forensics: do fingerprints learned from a foundation generator remain...
Li Wang, Kun-Yu Feng, Wan Lin et al.· arXiv.org· 0 citations