Collecting high-quality robot data remains a fundamental challenge for training robot foundation models. Task and motion planning (TAMP) offers a scalable way to generate demonstrations, but our experiments show that raw TAMP trajectories provide surprisingly little benefit when used to fine-tune pretrained vision-lang...
Samrat Sahoo, Yi-Xuan Huang, Tom Silver· 1 citation· ⚡1
Human teleoperators spend substantial time demonstrating behaviors that robots can already perform autonomously, limiting the scalability of data collection for robot foundation models. Task and motion planning (TAMP) can automate many of these behaviors, but a fixed planning domain may not support every stage of a lon...
Samrat Sahoo, Li Ji, Tom Silver et al.· 0 citations
Robot Question Answering (RQA), a modular evaluation framework and RoboVista, a benchmark curated from real robotic systems, research papers, and expert annotations are proposed and physical robot experiments suggest strong correlation between RoboVista performance and real-world task execution.