Franz Pernkopf

Multi-Teacher Distillation for Cross-Domain Streaming Electrolaryngeal Speech Encoding

Self-supervised learning (SSL) has improved speech representations, yet performance degrades in pathological domains such as electrolaryngeal (EL) speech, and the computational footprint of SSL models limits their applicability in real-time, on-device deployment. We propose a multi-teacher knowledge distillation framew...