This paper addresses the problem of defective or missing view restoration in light-field camera arrays by proposing a novel generative framework that synthesizes the absent views by exploiting information from a carefully selected subset of neighboring cameras.
Abstract
In light-field (LF) imaging systems, dense spatial sampling from a camera array enables powerful post-capture capabilities such as refocusing and depth estimation. However, real-world LF capture is often affected by hardware malfunctions, where one or more cameras in the array fail, leading to missing sub-aperture images and degraded reconstruction quality. This paper addresses the problem of defective or missing view restoration in light-field camera arrays. We propose a novel generative framework that synthesizes the absent views by exploiting information from a carefully selected subset of neighboring cameras. These selected images, along with a positional encoding map indicating both their locations and the desired target view, are fed into a conditional Generative Adversarial Network (cGAN) trained to generate the missing viewpoint in a geometrically consistent manner. Extensive experiments on synthetic and real-world LF datasets demonstrate that our method produces visually plausible and photometrically accurate reconstructions, outperforming baselines for view interpolation both quantitatively and qualitatively. The proposed framework thus offers a robust and efficient solution for fault-tolerant light-field image acquisition.
A dual representation-based LFVS method that employs deformable convolutional and Deep Residual Channel Attention (DRCA) networks that achieves state-of-the-art performance on synthetic and real-world LF benchmarks.
Muhammad Zubair, Paulo J. L. Nunes, Caroline Conti et al.· IEEE Open Journal of Signal...· 0 citations
It is demonstrated that using multiple cameras, even with a low baseline, significantly improves reconstruction quality in single-shot, few-shot, and casual video settings, and under a fixed sensor budget, angular sampling improves reconstruction when exposures are scarce despite lower spatial resolution.
Shamus Li, Ruiming Cao, Laura Waller et al.· 0 citations
While radiance field representations have achieved remarkable success in photo-realistic novel view synthesis with densely captured images, their performance sharply degrades under sparse input conditions, resulting in floater artifacts and missing regions caused by its inherent shape-radiance ambiguities and lack of i...
Hao-Yu Zhang, Shuai-Feng Zhi, Zhen-Hua Du et al.· IEEE Transactions on Visuali...· 0 citations
This work proposes GSPotential, a framework that quantifies view-space supervision imbalance using a Camera Potential Field, and uses the potential field to guide reconstruction from two complementary aspects.
Zeyuan An, Yang Xiao, Zhiying Leng et al.· 0 citations
It is concluded that adversarial training is beneficial if and only if the reconstruction loss is not too constrained, and non-adversarial training outperforms (or is on par with) any method trained with a GAN when a constrained reconstruction loss is used in combination with batch normalisation.
R. Groenendijk, Sezer Karaoglu, Theo Gevers et al.· 0 citations
GenRec is introduced, a multi-view flow matching model that builds the reconstruction--generation split directly into its architecture, supervision, and gradient flow, and attains the best reconstruction fidelity in observed regions while also surpassing purely generative baselines on perceptual quality in unobserved o...
Ata Çelen, Jaewoo Jung, Federico Tombari et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.