Skip to content
Preprint

Topology-Unified 2D Pose Estimation across Intact, Residual and Prosthetic Limbs

Aug 2026 · 0 citations · 47 references
Computer Science

TL;DR

This work proposes ProLoss, a structure-aware objective that enforces keypoint dependencies within a single limb to prevent unrealistic limb predictions, and sets a foundation for inclusive pose estimation, unlocking new possibilities for understanding the interactions between human bodies and assistive devices.

Abstract

Driven by the availability of large-scale datasets, Human Pose Estimation (HPE) plays a critical role in numerous downstream tasks. However, mainstream benchmarks exhibit severe representation bias, predominantly featuring able-bodied individuals. While a few pioneering datasets have attempted to address limb differences, their annotation protocols fail to generalize, struggling to represent specialized mechanical structures like running blades or unprosthetized residual limbs. To bridge this gap, we introduce ProPose, a large-scale benchmark featuring a novel annotation protocol that unifies the topological representation of biological limbs, diverse prostheses, and physical absences within a single framework. Because real-world prosthetic images are inherently scarce and exhibit extreme long-tail distributions, we design a Real-to-Synthetic data expansion pipeline to explicitly synthesize and expand the underrepresented cases. However, simply training existing models on this enriched dataset often leads to suboptimal solutions, as they estimate each keypoint independently and might hallucinate non-existent joints on mechanical structures. To resolve this, we propose ProLoss, a structure-aware objective that enforces keypoint dependencies within a single limb to prevent unrealistic limb predictions. Extensive experiments demonstrate that our approach improves the classification accuracy of long-tail prosthetic joints by 2% to 6% without compromising spatial coordinate localization performance. This work sets a foundation for inclusive pose estimation, unlocking new possibilities for understanding the interactions between human bodies and assistive devices.

View source

Similar papers

Open access Aug 2026

HardMo++: A Large-Scale Hard-Case Dataset for Motion Capture

HardMo++ is introduced, a scalable benchmark dataset built by an automated pipeline that combines large-scale data collection, re-annotation, and targeted optimization for systematic failure cases and shows that models trained with HardMo++ improve over the corresponding 4DHumans- and HardMo-trained baselines on the pr...

Jun-Ran Peng, Si-Lei Shen, Zong-Xing Li et al. · 0 citations
Preprint Sep 2026

UniMo: Unifying Human and Animal Motion Generation

UniMo is proposed, a unified point cloud-based motion generation framework that bypasses topological discrepancies by converting parametric skeletons into unparametric representations, further enhanced by dynamic sampling that allocates more points to active joints.

Ze-Yu Zhang, Zhi-Yuan Zhang, Si-Heng Wang et al. · 0 citations
Preprint Aug 2026

TransHands: Repurposing Human Pose Encoders as Hand Pose Encoders

Lifting 3D hand poses from 2D monocular representations remains challenging due to the limited availability of large-scale, diverse 3D-annotated hand datasets, in contrast to the abundance of human body motion data. We address this limitation by transferring motion representations learned from large body pose corpora t...

M. Piccioli, G. Amprimo, Claudia Ferraris et al. · 0 citations
Preprint Open access Sep 2026

Prosthesis-Aware 3D Human Pose Estimation: A Dataset and Benchmark for RSP Users

Recovering 3D human body motion from video is important for applications such as rehabilitation assessment and sports performance evaluation. For prosthesis users, this requires capturing both natural body joints and the geometry of the prosthetic device, a challenge that existing methods are not designed to address. M...

Yi-Lin Wen, Ke-Chuan Dong, Fumiya Suginaka et al. · 0 citations
Preprint Aug 2026

RigidBench: Evaluating Rigid-Body Physics in Video Generation Models

RididBench is introduced, a simulator-grounded benchmark that compares a generated continuation with a reference rollout from the same initial frame and motion description, with per-frame masks, depth, 6-DoF trajectories, and contacts available for scoring.

Swarnim Jain, Shang-Zhe Wu · 5 citations
#machine learning Preprint Sep 2026

UniMate: One Unified Model to Animate Diverse Skeletons

UniMate is presented, a unified foundation model that synthesizes articulated motion for arbitrary skeletons from a rigged 3D asset and a text prompt, with no test-time optimization or per-skeleton retraining, and outperforms state-of-the-art baselines in quality, generalization, and efficiency.

Lin-Zhan Mou, Jia-Hui Lei, Zhi-Yang Dou et al. · 1 citation

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.