Tim J. Schoonbeek

"Great! The Next Step Is...": In Pursuit of Proactive Assistance with Multimodal Foundation Models

Large language and multimodal models have been largely employed to reactively generate content and assistance. In contrast, we explore how models can be employed to provide proactive assistance that fluidly supports ongoing human activities. We identify and tackle challenges in such streaming scenarios—where models mus...