Mimo Shirasaka

Contextual Observer Grounding: Evaluating Situated Spatial Reasoning in Vision-Language Models

Reasoning over language instructions in embodied tasks such as robotics often requires understanding spatial relations from a speaker's situated perspective. Humans infer such perspectives from shared environmental knowledge, activity context, and commonsense. Recent vision-language models (VLMs) appear capable of spat...