Sep 2026· IEEE Transactions on Visualization and Computer Graphics· Vol PP· 0 citations
Medicine
TL;DR
A few-shot 3DGS framework that leverages scene-adapted generative priors gated by multi-view geometric consistency to enhance the reconstruction quality for both interpolated and extrapolated views given limited observing viewpoints is proposed.
Abstract
While radiance field representations have achieved remarkable success in photo-realistic novel view synthesis with densely captured images, their performance sharply degrades under sparse input conditions, resulting in floater artifacts and missing regions caused by its inherent shape-radiance ambiguities and lack of informative observations, respectively. To address these challenges, we propose a few-shot 3DGS framework that leverages scene-adapted generative priors gated by multi-view geometric consistency to enhance the reconstruction quality for both interpolated and extrapolated views given limited observing viewpoints. Built upon coarse 3D Gaussians initiated via multi-view stereo, the core of our approach lies in lightweight personalized adaptation of a pretrained inpainting model from only the sparse input images, requiring no task-specific paired training data. During scene reconstruction, the current 3DGS reconstruction itself localizes unreliable virtual-view regions through multi-view warping consistency, where our personalized inpainting model is selectively invoked, and the repaired views are iteratively integrated to enrich the training corpus of Gaussian Splatting, progressively expanding the observing coverage and intensifying multi-view constraints. Extensive experimental results on three popular benchmark datasets including Tanks and Temples, MVImgNet and MipNeRF-360 demonstrate that our method, without using any specialized external training assets, dramatically improves the rendering quality of sparse-view novel view synthesis with a single consumer-grade GPU.
An alternating optimization framework that uses a pre-trained image diffusion model to generate geometrically consistent pseudo-views for additional 3DGS supervision and introduces Generative Active Pseudo-view Selection (GAPS) to balance reconstruction informativeness and generative reliability when choosing target vi...
Novel-view synthesis from a single image is a fundamentally ambiguous problem. As the camera moves away from the input viewpoint, previously hidden regions become visible, exposing missing geometry and holes in the reconstructed scene. Existing methods often rely on generative models to complete such regions. However,...
W. Jakubowska, Maciej Zięba, P. Spurek· arXiv.org· 0 citations
RoGe is an end-to-end unified reconstruction and generation framework that removes this explicit bridge between reconstruction and generation, and outperforms reconstruction-based, generation-based, and hybrid baselines in terms of image-level quality and video-level temporal and geometric consistency.
Xiao-Lei Lang, Ze Kang, Ze-Hao Huang et al.· 0 citations
This paper proposes a novel iterative refinement framework based on a video diffusion model to improve the completeness and consistency of dynamic 4D scenes, and substantially outperforms existing baselines.
Novel view synthesis from sparse inputs remains challenging for 3D Gaussian Splatting (3DGS) due to ambiguous geometry, cross-view inconsistency, and missing details in under-constrained regions, resulting in degraded reconstruction and unstable rendering. To tackle these issues, we propose D$^{3}$GS, a Depth-DINO-Diff...
Yun-Qi Gao, Zhan-Feng Liao, Han-Zhang Tu et al.· arXiv.org· 0 citations
Spatial intelligence requires scalable 3D environments that are both photorealistic and semantically grounded, yet existing indoor datasets are dominated by room-scale captures and costly LiDAR acquisition. Online real-estate platforms offer abundant panoramas of diverse multi-room homes, but sparse viewpoints and text...
Yuan-Yuan Gao, Zhi-Rui Liu, Yu-Ning Gong et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.