UniMo is proposed, a unified point cloud-based motion generation framework that bypasses topological discrepancies by converting parametric skeletons into unparametric representations, further enhanced by dynamic sampling that allocates more points to active joints.
Abstract
The conditional generation of 3D motion has emerged as a key research topic due to its wide applicability across robotics, AR/VR, gaming, and content creation. However, extending recent advances in text-driven human motion generation to the animal domain remains challenging due to two core limitations. First, animals exhibit highly diverse skeletal topologies, unlike the standard human structure, making unified modeling across species difficult and leading to inefficient per-species models. Second, existing animal motion datasets suffer from limited scale and annotation quality, constraining model performance. To address these challenges, we propose UniMo, a unified point cloud-based motion generation framework that bypasses topological discrepancies by converting parametric skeletons into unparametric representations, further enhanced by dynamic sampling that allocates more points to active joints. Additionally, we present UniML3D, a large-scale motion-language dataset spanning both human and animal categories, containing 145,907 motion sequences and 433,388 captions-over 102x larger than existing animal datasets. Our method achieves state-of-the-art results on UniML3D and three public benchmarks including HumanML3D, KIT-ML, and AnimalML3D, demonstrating the feasibility and effectiveness of unified human-animal motion generation. Website: https://steve-zeyu-zhang.github.io/UniMo.
Kirin is introduced, a framework that reconstructs motion from video, learns motion priors at scale, and generates realistic motion that can be directly applied to animated assets that establishes a new foundation for large-scale, text and image conditioned animal motion generation and animation.
Brian Nlong Zhao, Zhuo-Yang Pan, J. Rehg et al.· 1 citation
UniMate is presented, a unified foundation model that synthesizes articulated motion for arbitrary skeletons from a rigged 3D asset and a text prompt, with no test-time optimization or per-skeleton retraining, and outperforms state-of-the-art baselines in quality, generalization, and efficiency.
Lin-Zhan Mou, Jia-Hui Lei, Zhi-Yang Dou et al.· SIGGRAPH Asia Conference Pap...· 3 citations
HardMo++ is introduced, a scalable benchmark dataset built by an automated pipeline that combines large-scale data collection, re-annotation, and targeted optimization for systematic failure cases and shows that models trained with HardMo++ improve over the corresponding 4DHumans- and HardMo-trained baselines on the pr...
Jun-Ran Peng, Si-Lei Shen, Zong-Xing Li et al.· Electronics· 0 citations
World2Motion, a framework that generates scene-aware 3D human motion and corresponding video from a single image and a text prompt, and proposes a shift-decoupled noise schedule that assigns different noise levels to video and motion through shared denoising progress, reducing motion jitter.
Fang-Yuan Tu, Xiang-Yue Zhang, Yi-Yi Cai et al.· 0 citations
This work presents HiPHI, a 600+ hour scale high-fidelity whole-body human motion dataset designed to systematically maximize coverage of the human motion and interaction manifold, and introduces a benchmark suite evaluating motion-space diversity, interaction grounding, object consistency, and physical AI applications...
Jiahao Ji, Ji Ma, Runhan Zhang et al.· 2 citations· ⚡1
RididBench is introduced, a simulator-grounded benchmark that compares a generated continuation with a reference rollout from the same initial frame and motion description, with per-frame masks, depth, 6-DoF trajectories, and contacts available for scoring.
Swarnim Jain, Shang-Zhe Wu· 5 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.