Speech large language models (LLMs) are often built using pretrained acoustic encoders as an audio interface to an LLM decoder. However, LLMs scale poorly with input sequence length, while acoustic encoders tend to produce substantially longer sequences than typical textual inputs. This motivates learning to compress e...
Ci-Han Xiao, Yuan Tseng, Matthew Wiesner et al.· 0 citations
Large Language Models (LLMs) have shown strong performance in low-resource offline translation; however, extending them to simultaneous speech-to-speech translation (Simul-S2ST) remains challenging due to the scarcity of causally aligned training data with high cross-lingual speaker fidelity. In addition, existing appr...
A. Hussein, Enas Albasiri, Travis M. Bartley et al.· 0 citations
We propose LAYERSCOPE, a label-free, layerwise framework that aims to characterize a model's learned representations in video and multimodal settings. Evaluating downstream performance using representations from final or intermediate layers typically requires large amounts of labeled data, repeated task-specific evalua...
Sandra Arcos-Holzinger, Debashish Chakraborty, Rohita Mocharla et al.· 0 citations
This work aims to explore how well vector-based pseudo relevance feedback can adapt to dense retrieval models when it is not feasible to use surface-form information to pick discriminating expansion tokens.
X. Velez, Andrew Yates, Eugene Yang et al.· Annual International ACM SIG...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.