An instance-based object perception pipeline with task-driven object pose estimation, developed within the SOPRANO EU project, for automated automotive door disassembly is presented, highlighting the benefits of aligning perception outputs with task-specific requirements.
Abstract
Industrial disassembly processes require robust and efficient perception systems capable of handling heterogeneous objects under real-world constraints. In automotive manufacturing and disassembly scenarios, components exhibit significant variability in geometry, size, symmetry, and placement, making it impractical to rely on a single, uniform object pose estimation strategy. At the same time, such environments impose strict requirements on the perception systems in terms of reliability, computational efficiency, and ease of deployment.This work presents an instance-based object perception pipeline with task-driven object pose estimation, developed within the SOPRANO EU project, for automated automotive door disassembly. The pipeline assumes a known set of object instances and depending on the objects’ geometric characteristics, the manipulation task requirements , the system performs (i) full 6D pose estimation, (ii) planar-constrained 3D localization via RGB-D lifting, or (iii) planar localization with structured multi-instance refinement and instance identification.The perception process consists of two stages: pose formulation selection and execution of the corresponding estimation method. Model-based 6D pose estimation using RGB data is applied to rigid objects, while RGB-D-based lifting of 2D detections is used for planar or quasi-planar elements. For structured arrangements of multiple instances of a single object type, such as screw arrays, a multi-instance matching strategy ensures consistent indexing and reduces ambiguity.The system is deployed as a modular perception service and validated in an automotive disassembly pilot. Experimental results demonstrate high accuracy across heterogeneous tasks, highlighting the benefits of aligning perception outputs with task-specific requirements.
An innovative approach is introduced for the random bin-picking of planar objects by developing a multi-task model for instance segmentation and keypoint detection in 2D images and a grasp candidate selection strategy is proposed to enable reliable grasping in cluttered industrial environments.
The-Thinh Pham, Tuan-Khanh Nguyen, Chi-Cuong Tran et al.· Journal of Technical Educati...· 0 citations
This work presents a monocular 6D pose estimation approach using hybrid representations and adaptive multi-feature fusion to address challenges of augmented reality-assisted assembly, human–robot collaboration, and quality inspection in intelligent manufacturing.
Neng-Bin Lv, Zhang-Mao Xu, Yi Feng et al.· The Visual Computer· 0 citations
OmniCAD is introduced, a large-scale benchmark for assembly-aware 3D spatial reasoning across diverse industrial systems, including robotic mechanisms, automotive components, aerospace structures, and agricultural machinery, and tool-augmented agentic reasoning.
Mingjia Wang, Tai-Ting Lu, Zi-Wei Dong et al.· 1 citation
A real-time point cloud processing and workpiece localization system that integrates multi-module optimization with a dynamic adaptive framework that sustains reliable performance under Gaussian noise up to 0.6 mm and occlusion levels up to 40%, confirming its viability for high-throughput industrial applications.
Detecting and grasping small objects remains a significant challenge in robotics. Active vision, where the robot moves closer to the object, is an intuitive solution, yet comparing approaches on common ground is difficult since identical physical scene setups are required. Hence, we introduce BRAVE-6D, a benchmark desi...
Philipp Ausserlechner, Bernhard Neuberger, Alessandro Scherl et al.· 0 citations
This paper studies monocular 6D pose estimation of small cubic objects from a single RGB image and proposes a two-stage manipulation- oriented framework, which achieves the strongest overall balance in ADD-S, translation accuracy, rotation stability, and task-oriented usability metrics.
Xinmiao Du· Poster Volume 0007 The 2026...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.