X-AuT: Progressive Audio-Encoder Compression for Speech LLMs with Cross-Scale Distillation
Reducing audio-encoder depth lowers the inference cost of speech large language models, but removing complete blocks perturbs the embeddings consumed by the decoder and can cause deletion and premature end-of-sequence errors. We introduce X-AuT, a progressive framework that selects layer combinations through short beha...
Hao-Jun Zhang, Yi Zou, Min Chen et al.
· 0 citations