In Mixture-of-Experts language models, the router typically selects and weights experts based on the token's hidden state, utilizing limited contextual information. We propose Attention-Aware Routing (AAR), which augments the router with temporal and spectral features extracted from a sliding window of attention weight...
Despoina Kosmopoulou, Anastasios Tsetsilas, Efthymios Georgiou et al.· 0 citations
A unified evaluation framework testing gradient and loss-based balancing strategies under controlled settings, and a theoretical diagnosis explaining why these methods fail, as they conflate fitting speed with discriminative contribution are provided.
Ioanna Kaffeza, Efthymios Georgiou, A. Potamianos· 0 citations
Modern TTS systems approach human quality for high-resource languages but degrade when clean speech data is scarce. Modern Greek exemplifies this, lacking the curated corpora behind state-of-the-art synthesis. We propose a data curation recipe that transforms audiobook recordings into TTS-ready data via WhisperX alignm...
Georgios Syllas, Efthymios Georgiou, Kosmas Kritsis et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.