Skip to content

VIP-GS: Enhancing Sparse Novel View Synthesis via In-Place Virtual Viewpoint Inpainting.

Sep 2026 · IEEE Transactions on Visualization and Computer Graphics · Vol PP · 0 citations
Medicine

TL;DR

A few-shot 3DGS framework that leverages scene-adapted generative priors gated by multi-view geometric consistency to enhance the reconstruction quality for both interpolated and extrapolated views given limited observing viewpoints is proposed.

Abstract

While radiance field representations have achieved remarkable success in photo-realistic novel view synthesis with densely captured images, their performance sharply degrades under sparse input conditions, resulting in floater artifacts and missing regions caused by its inherent shape-radiance ambiguities and lack of informative observations, respectively. To address these challenges, we propose a few-shot 3DGS framework that leverages scene-adapted generative priors gated by multi-view geometric consistency to enhance the reconstruction quality for both interpolated and extrapolated views given limited observing viewpoints. Built upon coarse 3D Gaussians initiated via multi-view stereo, the core of our approach lies in lightweight personalized adaptation of a pretrained inpainting model from only the sparse input images, requiring no task-specific paired training data. During scene reconstruction, the current 3DGS reconstruction itself localizes unreliable virtual-view regions through multi-view warping consistency, where our personalized inpainting model is selectively invoked, and the repaired views are iteratively integrated to enrich the training corpus of Gaussian Splatting, progressively expanding the observing coverage and intensifying multi-view constraints. Extensive experimental results on three popular benchmark datasets including Tanks and Temples, MVImgNet and MipNeRF-360 demonstrate that our method, without using any specialized external training assets, dramatically improves the rendering quality of sparse-view novel view synthesis with a single consumer-grade GPU.

View source

Similar papers

Sep 2026

GAPS: Generative Active Pseudo-view Selection for Sparse-View 3D Gaussian Splatting

An alternating optimization framework that uses a pre-trained image diffusion model to generate geometrically consistent pseudo-views for additional 3DGS supervision and introduces Generative Active Pseudo-view Selection (GAPS) to balance reconstruction informativeness and generative reliability when choosing target vi...

Hong-Fei Zhu, Hao-Chen Deng, Si-Tao Zhang et al. · 0 citations
Sep 2026

ORCA: Occlusion-Aware Refinement and Completion for Novel View Synthesis

Novel-view synthesis from a single image is a fundamentally ambiguous problem. As the camera moves away from the input viewpoint, previously hidden regions become visible, exposing missing geometry and holes in the reconstructed scene. Existing methods often rely on generative models to complete such regions. However,...

W. Jakubowska, Maciej Zięba, P. Spurek · 0 citations
Preprint Sep 2026

RoGe: Novel View Synthesis via End-to-End Implicit Reconstruction and Generation

RoGe is an end-to-end unified reconstruction and generation framework that removes this explicit bridge between reconstruction and generation, and outperforms reconstruction-based, generation-based, and hybrid baselines in terms of image-level quality and video-level temporal and geometric consistency.

Xiao-Lei Lang, Ze Kang, Ze-Hao Huang et al. · 0 citations
Sep 2026

D3GS: Depth, DINO, and RGB Diffusion Co-Guided 3D Gaussian Splatting for Sparse-View Reconstruction

Novel view synthesis from sparse inputs remains challenging for 3D Gaussian Splatting (3DGS) due to ambiguous geometry, cross-view inconsistency, and missing details in under-constrained regions, resulting in degraded reconstruction and unstable rendering. To tackle these issues, we propose D$^{3}$GS, a Depth-DINO-Diff...

Yun-Qi Gao, Zhan-Feng Liao, Han-Zhang Tu et al. · 0 citations
Preprint Oct 2026

Holi-Spatial 360: Generative Reconstruction from Sparse Panoramas for Spatial Rendering and Intelligence

Spatial intelligence requires scalable 3D environments that are both photorealistic and semantically grounded, yet existing indoor datasets are dominated by room-scale captures and costly LiDAR acquisition. Online real-estate platforms offer abundant panoramas of diverse multi-room homes, but sparse viewpoints and text...

Yuan-Yuan Gao, Zhi-Rui Liu, Yu-Ning Gong et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.