Experiments show that Fysiverse-3D-SimReady improves input-view alignment, contact plausibility, and physical stability over existing single-image reconstruction and scene generation baselines, while enabling goal-conditioned physical interactions from a single image.
Abstract
Agentic recognition requires visual perception to move beyond static scene understanding and produce structured scene representations that support the perception--reasoning--action loop. Existing single-image 3D generation methods, however, mainly produce visually plausible object assets rather than simulation-ready scene states. When independently generated meshes are composed in a shared space, they may fail to align with the input camera, violate gravity, interpenetrate nearby objects, or become unstable under physics simulation. We present Fysiverse-3D-SimReady, a grounded refinement framework for reconstructing simulation-ready multi-object scenes from a single RGB image with instance and ground prompts. The method places generated object meshes into a shared gravity-aligned scene, refines their camera-space poses through differentiable rendering, and corrects scene-level supports and contacts for stable physical execution. The scene is then used by an agentic simulation workflow, which converts a scene-specific task goal into an executable physics rollout rendered from the original camera view. Experiments show that Fysiverse-3D-SimReady improves input-view alignment, contact plausibility, and physical stability over existing single-image reconstruction and scene generation baselines, while enabling goal-conditioned physical interactions from a single image.
Fysiverse-3D-Vision is proposed, a unified vision-language-geometry framework for generative 3D scene reconstruction and executable asset construction from a single image that establishes a shared representation where spatial reasoning and geometric reconstruction mutually enhance each other, allowing object layouts to...
NeoWorld-Pro is proposed, a framework that reformulates monocular scene reconstruction as procedural programming for interactive 3D environments and outperforms open-loop and prior monocular reconstruction methods, while enabling complex downstream tasks such as stable stacking and fine-grained manipulation.
Yu-Meng He, Eachen Soong, Xiao-Tian Yang et al.· 1 citation
CoDimRecon is presented, an agentic framework that reconstructs editable scenes containing rigid, articulated, and deformable objects from multi-view RGB observations that achieves competitive compositional reconstruction accuracy while additionally producing deformable assets for rod, shell, and solid simulation.
Shu-Zhao Xie, Le-Lin Wang, Gu-Ying Lin et al.· 0 citations
Embodied agents benefit from 3D environments that combine visual fidelity to real-world observations with physical interactivity. Existing single-image tabletop reconstruction methods recover plausible scene geometry but typically represent objects as monolithic rigid bodies, limiting interaction to whole-object rigid...
These readouts suggest that program-constructed scenes from current coding agents are a promising but not yet sufficiently precise representation of natural images, suggesting that program-constructed scenes from current coding agents are a promising but not yet sufficiently precise representation of natural images.
A framework that combines the merits of both parametric image-to-3D scene models and vision-language models, SceneMosaic is proposed, which obtains the initial candidate from the learned image-based prior, and subsequently evolves the result through VLM agents, ensuring both efficiency and physical validity.
Xingjian Ran· 2 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.