Jul 2026· ACM Transactions on Graphics· Vol 46, pp. 1-13· 0 citations· 10 references
TL;DR
This work presents a rendering pipeline that seamlessly integrates a physically accurate and differentiable depth-of-field model into the 3D Gaussian Splatting (3DGS) rasterization process, and enables high-fidelity 3D reconstruction from blurry, multi-focus image sets, while supporting realistic post-capture effects such as refocusing and aperture manipulation.
Abstract
Recent advancements in 3D Gaussian Splatting (3DGS) have achieved impressive photorealism; however, its foundational assumption of perfectly sharp, all-in-focus imagery often breaks down in real-world scenarios. Lens-induced defocus blur, common in natural captures, can significantly degrade reconstruction quality. While prior work has attempted to address this, existing solutions either rely on implicit deblurring, restricting post-capture artistic flexibility, or employ physically inaccurate blur approximations, particularly under large apertures. We present a rendering pipeline that seamlessly integrates a physically accurate and differentiable depth-of-field model into the 3D Gaussian Splatting (3DGS) rasterization process. At its core, our method models defocus by convolving each projected 3D Gaussian with a kernel shaped by the camera’s Circle of Confusion (CoC). To maintain efficiency, we derive a closed-form analytical solution for this convolution using the error function (erf). Our approach further extends to anisotropic Gaussians and approximates arbitrary polygonal apertures by decomposing them into non-overlapping rectangles. As a result, our method enables high-fidelity 3D reconstruction from blurry, multi-focus image sets, while supporting realistic post-capture effects such as refocusing and aperture manipulation. Experiments on defocus-focused benchmarks show that our technique yields visibly sharper in-focus details and smoother defocus transitions, delivering results competitive with the current best-performing methods.
The proposed framework provides a simple and effective path toward fast and inherently compact 3DGS training, and leverages a synergistic design: an L2 reconstruction loss to provide error-proportional gradients that stabilize optimization, and a novel Polarized Opacity Prior to actively manage the Gaussian population.
Zi-Ming Wang, Kai-Wen Duan, Ko-Wei Huang et al.· 0 citations
EffGS, a more general acceleration framework that improves training and rendering efficiency while maintaining reconstruction quality comparable to or better than vanilla 3DGS across bounded and large-scale scenes, is proposed.
Chang-Bai Li, Shuo Yang, Yi-Chen Yang et al.· 0 citations
Novel view synthesis from unconstrained outdoor photo collections remains challenging for robust 3D scene representation. 3D Gaussian Splatting (3DGS) achieves real-time rendering with high visual fidelity, yet its static formulation is vulnerable to illumination changes, weather variations, and transient occluders. Op...
Qiao Chen, Zhi-Cheng Li, Yao-Wen Chen et al.· 2026 6th International Confe...· 0 citations
This work proposes GSPotential, a framework that quantifies view-space supervision imbalance using a Camera Potential Field, and uses the potential field to guide reconstruction from two complementary aspects.
Zeyuan An, Yang Xiao, Zhiying Leng et al.· 0 citations
Across datasets, major structures were generally reproduced well, whereas sparse foliage, low-contrast repetitive textures, fine surface details, and distant background objects required ROI-level verification, whereas sparse foliage, low-contrast repetitive textures, fine surface details, and distant background objects...
Tomohiro Mizoguchi· Italian National Conference...· 0 citations
This paper proposes a method that introduces an anchor re-growing module that dynamically increases neural Gaussian density in high-gradient regions using edge-aware optimization, and the Segment Anything Model (SAM) for generating accurate object segmentation masks to guide segmentation-based loss computation.
Meng-Yi Wang, Beiqi Chen, Niansheng Liu et al.· Signal, Image and Video Proc...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.