Handshape and orientation are geometric components of sign language, yet many sign encoders learn from appearance alone. We introduce SignDEG (DINO Eats Geometry), a temporal sign encoder that uses articulated hand geometry as a pre-training target and requires only video at inference. Frozen DINOv3 features of tracked...
Jun-Yi Hu, Zhe-Wen He, Hao Huang et al.· 0 citations
A robot demonstration records two things in the same frames: what happened to the objects, and how one particular arm made it happen. We condition on the first. A demonstration is compiled into an effect program: the 3D keypoint trajectories of the objects that moved, two points marking where each was held, and the con...
Jun-Yi Hu, Zhe-Wen He, Zhen-Hua Li et al.· 0 citations
Humanoid whole-body controllers can now track a diverse set of dynamic motions, but they are typically trained offline and then frozen, so teaching such a controller a new skill tends to erode the skills it already mastered. We study continual learning for humanoid whole-body motion, where a single controller must acqu...
The framework, GauScoreMap, performs hierarchical scoring: a training-free global stage produces a CLIP relevance field over Gaussians and prunes the scene to a small set of candidate regions, and a local stage performs ray-image cross-attention within those regions and triangulates the 6D camera pose from the top-scor...
Yijie Deng, Shuaihang Yuan, Geeta Chandra Raju Bethala et al.· IEEE Robotics and Automation...· 4 citations· ⚡1
Embodied visual tracking requires a robot to choose actions that keep a moving target observable at a suitable distance, and to recover it after occlusion, out-of-view drift, or distractor crossings. We cast the task as planning over future target evidence with an action-conditioned world model. In logged tracking data...
Jun-Yi Hu, Shuaihang Yuan, Jia-Zhao Liang et al.· 0 citations
SignDino, a self-supervised sign-video encoder that moves the DINOv3 student--teacher recipe from the spatial domain of image crops to the temporal domain of tracked sign streams, provides a strong public self-supervised representation and shows competitive or state-of-the-art performance under matched downstream evalu...
Jun-Yi Hu, Zhe-Wen He, Hao Huang et al.· 0 citations
VTaMo is presented, a framework that introduces explicit multi-granularity alignment at three levels: local alignment via entropy-regularized optimal transport with a learnable null token for fine-grained frame-to-token correspondences; global alignment via a learnable orthogonal transformation that calibrates embeddin...
