I'll Keep an Ear Out: Teaching AudioLLMs Proactive Audio Assistance
Interrupt and Silent Modeling (ISM), a model-agnostic paradigm that embeds proactive decisions into LLM decoding via two special tokens, is proposed, capturing four states: onset detection, sustained-relevance triggering, irrelevance suppression, and de-duplication.
Amit Kumar Singh Yadav, Ritvik Shrivastava, Xuan Zhang et al.
· 1 citation