ForeSightGuide, an anticipatory assistive guidance framework that couples semantic scene understanding with predictive hazard assessment, significantly mitigates information overload by reducing redundant alerts to 0.299 per guidance output while maintaining a low missed-hazard rate.
Abstract
Electronic travel aids are pivotal for the independent mobility of the visually impaired. While Vision-Language Models (VLMs) offer rich environmental understanding, they often suffer from excessive false positives in dynamic scenarios, leading to cognitive overload. To address this, we present ForeSightGuide, an anticipatory assistive guidance framework that couples semantic scene understanding with predictive hazard assessment. Unlike reactive systems, ForeSightGuide leverages the reasoning capabilities of VLMs to anticipate obstacle motion, effectively filtering out non-threatening objects to provide concise, actionable guidance. To validate our approach, we introduce a novel dataset captured in complex, dynamic real-world traffic scenes, designed to benchmark predictive capabilities. Extensive experiments on both public benchmarks and our proposed dataset demonstrate that ForeSightGuide achieves state-of-the-art performance. Notably, it significantly mitigates information overload by reducing redundant alerts to 0.299 per guidance output while maintaining a low missed-hazard rate of 0.112, proving its efficacy for safe walking assistance.
In human-aware vision-and-language navigation (HA-VLN), agents need to follow instructions while navigating safely among people in crowded environments. Existing methods often struggle to effectively transform forward-looking risk prediction into decision-making basis, resulting in intelligent agents being prone to col...
Jun-Yi Zhang, Zi-Wen Luo, Yin-Zhe Zhou et al.· Proceedings of the Thirty-Fi...· 0 citations
Long-horizon robotic tasks are vulnerable to unexpected environmental changes that can render planned actions ineffective or unsafe. To address this, robots must detect such changes as they occur, interpret their impact, and adjust their actions accordingly. Traditional rule-based decision-making pipelines are brittle...
Ahmed N. Ahmed, Omar Moured, Mughni Irfan Mohammed Abdul et al.· 0 citations
Talk2Escape is introduced, a proactive and model-agnostic dialogue intervention framework that reframes navigation as a closed-loop interactive process and proves that proactive dialogue drastically improves navigation robustness in physical environments.
Ze-Rui Li, Si-Hao Lin, Yan-Yan Shao et al.· 0 citations
Results show that BLV-focused post-training improves both accessibility-specific spatial grounding and general visual-text reasoning, and is substantially outperforms the baseline across various benchmarks.
Rishabh C. Choudhary, S. Raj, Umesh Goyal et al.· 0 citations
VeriFuse assigns the VLM a clear and constrained role in cooperative perception: semantic reasoning resolves ambiguity among cross-agent hypotheses, while deterministic constraints determine the final 3D geometry.
Hong-Yi Lin, Yi-Yao Liu, Qi Kang et al.· 0 citations
Recent vision-language models (VLMs) have advanced vision-and-language navigation (VLN), enabling models to predict navigation actions from visual observations and language instructions. In this work, we explore VLN with panoramic observations and introduce PanoVLN. The motivation is straightforward: more complete visu...
Zhen Wang, Chang-Peng Wang, Zhe Liu et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.