A cross-modal behavioral marker is tested under frozen pretrained models across gaze, text, and audio that separates semantic engagement from production mechanics without training on dementia data at any stage, and the implication for multimodal interaction systems is direct: adapt to semantic engagement, not productio...
Leticia Pinto-Alva, Gale M. Lucas, Maja J. Matarić et al.· Proceedings of the 28th Inte...· 0 citations
Dementia is commonly described as impairing what people attend to, say, and mean more than how they move their eyes or produce speech. We test this asymmetry with a cross-modal behavioral marker—negative log-likelihood (NLL) under frozen pretrained models across gaze, text, and audio—that separates semantic engagement...
Leticia Pinto-Alva, Gale M. Lucas, Maja J. Matarić et al.· Proceedings of the 28th Inte...· 0 citations
SSP first abstracts the underlying question structure into a skeleton, retrieves a small set of same-skeleton questions from a lightweight question pool, then prompts the VLM to analyze their shared negation pattern and synthesize a single-sentence answering strategy.
Yu-Liang Cai, Mohammad Rostami, Jesse Thomason· 0 citations
This paper presents HIVE (Human Input-Variation Engine), a suite of voice transcription perturbations and QWERTY keyboard perturbations and uses HIVE to evaluate how robust models are to these perturbations.
Zizhao Hu, N. Segura, Mohammad Rostami et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.