Skip to content
Open access

An algorithm for 6D object pose estimation based on generative single-image 3D reconstruction

Oct 2026 · Journal of Instrument Engineering · 0 citations · 3 references

Abstract

Reliable 6D object pose estimation is a foundational capability for robotic manipulation in Industry 4.0 and unstructured warehouse environments. Current state-of-the-art methods, such as PVN3D and SAM-6D, predominantly rely on “Model-Based” paradigms that necessitate high-fidelity CAD models of the target objects for training or template matching. This requirement severely limits their applicability in open-world scenarios where such CAD models are unavailable in real-time. To bridge this gap, a novel 6D Pose Estimation Framework without fine-tuning on the target object (Zero-Shot) is proposed to eliminate the dependency on prior CAD models. A single-view 3D generative model is leveraged to synthesize a geometrically plausible 3D mesh from a single RGB image. To address the scale ambiguity inherent in generative models, which poses a critical challenge for robotic grasping, a Template-Prior Iterative Closest Point (TP-ICP) based on the classical ICP is introduced for iterative recovery of the metric scale. This algorithm robustly recovers the metric physical scale of the neural-generated mesh using depth information, employing median-based outlier removal and template-guided ICP to handle occlusions and sensor noise. The recovered metric mesh is then seamlessly integrated into a standard 6D pose estimation pipeline, establishing a closed-loop framework comprising model self-generation, metric scale calibration, and pose estimation. A fully reproducible implementation scheme is presented. Systematic experiments on the LINEMOD dataset demonstrate that the proposed approach achieves robust 6D pose estimation suitable for robotic tasks, even in the complete absence of prior CAD models.

Read PDF

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.