Skip to content
Review Open access

Real-Time Markerless Motion Capture for Interactive Applications and Game Engines: Pipelines, Spatio-Temporal Refinement, and Latency Budgets

Oct 2026 · Information · Vol 17, pp. 1006 · 0 citations · 42 references

TL;DR

This work synthesizes methodologies to optimize the responsiveness of AI-based MoCap systems within contemporary real-time software architectures and focuses on integrating 3D human pose estimation (HPE) into standard graphics engines.

Abstract

The rapid evolution of deep learning and computer vision has transformed markerless motion capture (MoCap) from specialized biomechanical tools into a key technology for real-time interactive systems, video game engines, and virtual production. This review analyzes state-of-the-art markerless pipelines and focuses on integrating 3D human pose estimation (HPE) into standard graphics engines. We evaluate the shift from single-view regression to temporal convolutional architectures. Our review emphasizes the trade-offs between spatial precision and algorithmic overhead for interactive use cases. Central to our analysis is the spatio-temporal refinement of noisy skeletal data. We assess adaptive smoothing techniques, such as the 1-Euro filter and predictive neural filtering, designed to minimize jitter and motion-to-photon latency. Findings indicate that modern markerless systems approach the standards of marker-based tools. However, maintaining temporal consistency under strict real-time budgets remains a fundamental challenge for human-display feedback loops. We examine industry-standard engines and their role in permitting seamless character retargeting throughout diverse applications, including clinical monitoring and sports coaching. Ultimately, this work synthesizes methodologies to optimize the responsiveness of AI-based MoCap systems within contemporary real-time software architectures.

Read PDF

Similar papers

Preprint Nov 2026

FlashMotion: Ultra-Fast Long-Term 3D Motion Generation

3D human motion generation plays a crucial role in game development, extended reality (XR), digital humans, and embodied simulation. Beyond motion generation, practical pipelines include rigging, retargeting, and rendering, making ultra-fast long-term 3D motion generation without compromising quality valuable for real-...

Kai-Xing Yang, Xu-Long Tang, Rong-Hui Li et al. · 0 citations
Review Open access Oct 2026

Motion capture and retargeting for character animation: A Survey

This paper systematically reviews representative literature on motion capture and retargeting, organized into five categories following the complete industrial workflow: multi-modal motion acquisition and preprocessing, cross-skeleton shape-adaptive retargeting, AI-assisted motion generation, physically constrained int...

Zu-Ling Li · 0 citations
Preprint Nov 2026

REACT: Towards Real-Time Completion of Skeletal Motion Signals

Tracking user motion in interactive and immersive applications is increasingly common (e.g., video games, XR systems, smartphones). Yet, processing and transmitting human motion data remain critical challenges, as current approaches strongly rely on the quality of the tracked motion signals. In general, affordable moti...

P. de Clermont Gallerande, Q. Avril, P. Gosselin et al. · 0 citations
Oct 2026

Mobile vision-based kinematic screening for ballet: A pilot validation of a contactless approach using geometric constraints

High-fidelity biomechanical assessment typically relies on instrumented systems (e.g. optical motion capture or inertial measurement units (IMUs)), which can be costly, intrusive, and difficult to deploy at scale. This study presents a contactless, smartphone-based framework for preliminary kinematic screening of a b...

Feng Zhang, Yu Chen, Hai-Gang Liu et al. · 0 citations
Review Open access Oct 2026

From Pixels to Performance: A Survey of the Estimation-to-Biomechanics Pipeline for Vision-Based Human Pose Estimation in Sports and Movement Health

Traditional quantitative movement analysis relies either on the subjective visual observations of a coach or laboratory-based motion capture involving markers. Human Pose Estimation (HPE) using deep learning could provide a third solution where markers can be omitted, and anatomical landmarks can be extracted from regu...

Sushma Zade, Vedika Andhale, Aman Mishra, Vishal Pandit, and Pratik Meshram · 0 citations
Sep 2026

E-WAVE: Event-based Continuous Optical Flow via Warping-Aligned Visual Encoding

E-WAVE is presented, a correlation-free framework for high-temporal-resolution (HTR) optical flow estimation from event streams that employs global attention mechanism to model long-range feature dependencies and performs trajectory guided feature warping using B\'ezier curve.

Jia-Le Wu, Xiao-Yang Bai, Hao-Ming Yu et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.