Skip to content

Fysiverse-3D-SimReady Technical Report: Agentic Physical Simulation for Pragmatic 3D World Reconstruction

Sep 2026 · arXiv.org · Vol abs/2609.31715 · 1 citation · 53 references
Computer Science

TL;DR

Experiments show that Fysiverse-3D-SimReady improves input-view alignment, contact plausibility, and physical stability over existing single-image reconstruction and scene generation baselines, while enabling goal-conditioned physical interactions from a single image.

Abstract

Agentic recognition requires visual perception to move beyond static scene understanding and produce structured scene representations that support the perception--reasoning--action loop. Existing single-image 3D generation methods, however, mainly produce visually plausible object assets rather than simulation-ready scene states. When independently generated meshes are composed in a shared space, they may fail to align with the input camera, violate gravity, interpenetrate nearby objects, or become unstable under physics simulation. We present Fysiverse-3D-SimReady, a grounded refinement framework for reconstructing simulation-ready multi-object scenes from a single RGB image with instance and ground prompts. The method places generated object meshes into a shared gravity-aligned scene, refines their camera-space poses through differentiable rendering, and corrects scene-level supports and contacts for stable physical execution. The scene is then used by an agentic simulation workflow, which converts a scene-specific task goal into an executable physics rollout rendered from the original camera view. Experiments show that Fysiverse-3D-SimReady improves input-view alignment, contact plausibility, and physical stability over existing single-image reconstruction and scene generation baselines, while enabling goal-conditioned physical interactions from a single image.

View source

Similar papers

Sep 2026

Fysiverse-3D-Vision Technical Report: Generating Executable 3D Worlds from Images through Unified Spatial Reasoning

Fysiverse-3D-Vision is proposed, a unified vision-language-geometry framework for generative 3D scene reconstruction and executable asset construction from a single image that establishes a shared representation where spatial reasoning and geometric reconstruction mutually enhance each other, allowing object layouts to...

Ding-Kang Yang, Yi-Zhou Liu, Wen-Dong Cheng et al. · 0 citations
Preprint Aug 2026

NeoWorld-Pro: Programming Interactive Scenes from Monocular Images for Embodied Simulation

NeoWorld-Pro is proposed, a framework that reformulates monocular scene reconstruction as procedural programming for interactive 3D environments and outperforms open-loop and prior monocular reconstruction methods, while enabling complex downstream tasks such as stable stacking and fine-grained manipulation.

Yu-Meng He, Eachen Soong, Xiao-Tian Yang et al. · 1 citation
Preprint Sep 2026

CoDimRecon: Agentic Reconstruction of Sim-Ready 3D Scenes with Deformable Curves, Surfaces, and Volumes

CoDimRecon is presented, an agentic framework that reconstructs editable scenes containing rigid, articulated, and deformable objects from multi-view RGB observations that achieves competitive compositional reconstruction accuracy while additionally producing deformable assets for rod, shell, and solid simulation.

Shu-Zhao Xie, Le-Lin Wang, Gu-Ying Lin et al. · 0 citations
Preprint Oct 2026

ArticuTable: Generating Instance-Level Interactive Rigid-Articulated 3D Tabletop Scenes from a Single Image

Embodied agents benefit from 3D environments that combine visual fidelity to real-world observations with physical interactivity. Existing single-image tabletop reconstruction methods recover plausible scene geometry but typically represent objects as monolithic rigid bodies, limiting interaction to whole-object rigid...

Kai Lv, Yi-Bo Yin, Li-Jun Guo et al. · 0 citations
Sep 2026

LEGO-Anything: Coding Agents for 3D Scene Reconstruction

These readouts suggest that program-constructed scenes from current coding agents are a promising but not yet sufficiently precise representation of natural images, suggesting that program-constructed scenes from current coding agents are a promising but not yet sufficiently precise representation of natural images.

Xi-Rui Li, Peng Shi, Ming-Wen Dong et al. · 1 citation
Preprint Sep 2026

SceneMosaic: Efficient and Diverse Simulation-Ready Scene Generation via Hybrid Agentic Layout Evolution

A framework that combines the merits of both parametric image-to-3D scene models and vision-language models, SceneMosaic is proposed, which obtains the initial candidate from the learned image-based prior, and subsequently evolves the result through VLM agents, ensuring both efficiency and physical validity.

Xingjian Ran · 2 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.