Skip to content
Preprint

GeoVerse: World-Consistent Novel View Synthesis in Geometric Latent Space

Sep 2026 · 0 citations · 56 references
Computer Science

TL;DR

GeoVerse is a framework that synthesizes world-consistent novel views by performing generation within the geometric latent space of a pretrained 3D foundation model and injecting appearance priors from a video generative model via a ControlNet-style adapter.

Abstract

Novel view synthesis from sparse images must reconcile faithful reconstruction of observed regions with plausible completion of unseen content, while maintaining world consistency across viewpoints. Existing geometry-based methods preserve observed scene structure but often struggle to complete unseen regions, whereas video generative models offer rich appearance priors but accumulate inconsistencies during sequential view generation. We propose GeoVerse, a framework that synthesizes world-consistent novel views by performing generation within the geometric latent space of a pretrained 3D foundation model and injecting appearance priors from a video generative model. Specifically, GeoVerse extracts multilevel features from Wan2.2 VACE and injects them into the geometric latent diffusion model via a ControlNet-style adapter, incorporating video-learned appearance priors to enhance structural completion. To enforce cross-view coherence, a global spatial memory continuously aggregates observed and synthesized content, reprojecting target-aligned guidance to anchor subsequent predictions to a shared scene representation. Extensive experiments across diverse datasets demonstrate improved visual quality and geometric consistency, with a 2.23 dB higher PSNR on DL3DV and 32.4% lower ATE on Mip-NeRF360 compared to GLD.

View source

Similar papers

VGGT-Diff: Visual Geometry Meets Diffusion for Sparse-View Novel View Synthesis

This work presents VGGT-Diff, a geometry-routed multi-view diffusion model for sparse-view novel view synthesis, and introduces robust geometry conditioning, combining training-time regularization with inference-time guidance for improved robustness.

Kang-Jie Chen, Xiang-Yu Li, Dong-Bin Zhang et al. · 0 citations
Preprint Sep 2026

RoGe: Novel View Synthesis via End-to-End Implicit Reconstruction and Generation

RoGe is an end-to-end unified reconstruction and generation framework that removes this explicit bridge between reconstruction and generation, and outperforms reconstruction-based, generation-based, and hybrid baselines in terms of image-level quality and video-level temporal and geometric consistency.

Xiao-Lei Lang, Ze Kang, Ze-Hao Huang et al. · 0 citations
Preprint Aug 2026

ReconSplat: Generalizable 3D Scene Reconstruction Beyond Observed Views

We introduce ReconSplat, a feed-forward model for 3D scene reconstruction that aims to address the longstanding trade-off between plausible view generation for unobserved regions and geometric consistency, providing both geometrically aligned novel views and sharp depth estimates. Our approach builds on 3D Gaussian spl...

Giuseppe Stracquadanio, Kevin Raj, Julia Grabinski et al. · 0 citations
Sep 2026

VIP-GS: Enhancing Sparse Novel View Synthesis via In-Place Virtual Viewpoint Inpainting.

A few-shot 3DGS framework that leverages scene-adapted generative priors gated by multi-view geometric consistency to enhance the reconstruction quality for both interpolated and extrapolated views given limited observing viewpoints is proposed.

Hao-Yu Zhang, Shuai-Feng Zhi, Zhen-Hua Du et al. · 0 citations
Preprint Oct 2026

WorldRecon: Generative Multi-View Mesh Reconstruction for Large-Scale 3D World

Reconstructing complete, high-quality meshes of large-scale scenes from unposed multi-view images requires faithful geometric grounding while plausibly completing surfaces that are unobserved or only sparsely captured. We present WorldRecon, a generative multi-view reconstruction framework for recovering complete, larg...

Meng-Chen Zhang, Yang Li, Chun-Shi Wang et al. · 0 citations
#diffusion models Preprint Sep 2026

StreetDiff: Multi-view Street Scenes Generation via Cross-view Consistent Multi-view Stable Diffusion with Structure Prompts

The proposed StreetDiff introduces a Panorama--Perspective Synergy design to decouple global layout reasoning from local detail synthesis, and incorporates a Panorama Alignment Module (PAM) that establishes spherical-projection-based attention constraints across views to achieve robust cross-view coherence in challengi...

Qi Zhang, Yanyifan Wang, Wei-Yuan Zhang et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.