The Global User Intent Dual-phase Estimation for Robots (GUIDER) is deployed on data collected from a robotic arm to test the manipulation phase across various assistance scenarios, including making tea and fetching medicine.
Abstract
This paper presents an evaluation of a goal-free probabilistic framework for human intent inference during robotic manipulation. We deploy the Global User Intent Dual-phase Estimation for Robots (GUIDER) on data collected from a robotic arm to test the manipulation phase across various assistance scenarios, including making tea and fetching medicine. To support operation, we add online probability updates, workspace limits, support-plane filtering, and a grasping mode that prioritizes feasible grasp regions, all of which are tested on the recorded data while preserving its original temporal conditions. Across 20 manipulation steps in three scenarios, GUIDER estimated human intent within the correct grasp-candidate set in all cases and achieved a time to confident prediction of 3.7 s, a remaining time before first grasp of 49.6 s, a prediction stability of 96.4%, and a runtime of 4.857/4.474 s (mean/median) per perceptual phase of intent.
To eliminate the inherent biases in decision-making of large language models (LLMs), a multi-source knowledge fusion module is introduced to generate more reasonable exploration sequences and to achieve a better balance between the accuracy and efficiency of the grasping detection network.
Jin Liu, Kai Sun, Lei-Bing Xiao et al.· Robotica (Cambridge. Print)· 0 citations
The Universal Manipulation Interface (UMI), originally developed by the Robotics and Embodied AI Lab at Stanford University, has demonstrated remarkable effectiveness for training manipulation policies for terrestrial robotic manipulators using imitation and diffusion based learning techniques. The long term objective...
Neal D'Andrea, Joshua Wachs, A. Wade et al.· National Aerospace and Elect...· 0 citations
ActivAsk is presented, a zero-shot framework for resolving referential ambiguity before robotic grasping that selects among VLM-proposed candidate partitions using an expected free energy (EFE) criterion motivated by active inference; with neutral response preferences, this reduces to information gain over candidate pa...
Haoandong Yang, Gabriel W. Haddon-Hill, Teresa Zielińska et al.· Robotics· 0 citations
This work demonstrates that a general-purpose agent can directly drive a physical robot throughout task execution without any task-specific or environment-specific training and introduces Agent as Policy (AGP), which places task planning and execution under the agent's control.
Meng-Zhao Jia, Yang Lin, Xi-Xin Zhang et al.· 15 citations· ⚡1