Skip to content
Preprint

Neighbor-Aware View Synthesis for Restoring Missing Views in Light-Field Camera Arrays

Aug 2026 · 0 citations · 17 references
Computer Science

TL;DR

This paper addresses the problem of defective or missing view restoration in light-field camera arrays by proposing a novel generative framework that synthesizes the absent views by exploiting information from a carefully selected subset of neighboring cameras.

Abstract

In light-field (LF) imaging systems, dense spatial sampling from a camera array enables powerful post-capture capabilities such as refocusing and depth estimation. However, real-world LF capture is often affected by hardware malfunctions, where one or more cameras in the array fail, leading to missing sub-aperture images and degraded reconstruction quality. This paper addresses the problem of defective or missing view restoration in light-field camera arrays. We propose a novel generative framework that synthesizes the absent views by exploiting information from a carefully selected subset of neighboring cameras. These selected images, along with a positional encoding map indicating both their locations and the desired target view, are fed into a conditional Generative Adversarial Network (cGAN) trained to generate the missing viewpoint in a geometrically consistent manner. Extensive experiments on synthetic and real-world LF datasets demonstrate that our method produces visually plausible and photometrically accurate reconstructions, outperforming baselines for view interpolation both quantitatively and qualitatively. The proposed framework thus offers a robust and efficient solution for fault-tolerant light-field image acquisition.

View source

Similar papers

Open access 2026

Dual Representation-Based Light Field View Synthesis using Deformable Convolutional and Deep Residual Channel Attention Networks

A dual representation-based LFVS method that employs deformable convolutional and Deep Residual Channel Attention (DRCA) networks that achieves state-of-the-art performance on synthetic and real-world LF benchmarks.

Muhammad Zubair, Paulo J. L. Nunes, Caroline Conti et al. · 0 citations
Preprint Aug 2026

Sparse Light Field Sampling Improves Casual 3D and 4D Reconstruction

It is demonstrated that using multiple cameras, even with a low baseline, significantly improves reconstruction quality in single-shot, few-shot, and casual video settings, and under a fixed sensor budget, angular sampling improves reconstruction when exposures are scarce despite lower spatial resolution.

Shamus Li, Ruiming Cao, Laura Waller et al. · 0 citations
Sep 2026

VIP-GS: Enhancing Sparse Novel View Synthesis via In-Place Virtual Viewpoint Inpainting.

While radiance field representations have achieved remarkable success in photo-realistic novel view synthesis with densely captured images, their performance sharply degrades under sparse input conditions, resulting in floater artifacts and missing regions caused by its inherent shape-radiance ambiguities and lack of i...

Hao-Yu Zhang, Shuai-Feng Zhi, Zhen-Hua Du et al. · 0 citations

Computer Vision and Image Understanding

It is concluded that adversarial training is beneficial if and only if the reconstruction loss is not too constrained, and non-adversarial training outperforms (or is on par with) any method trained with a GAN when a constrained reconstruction loss is used in combination with batch normalisation.

R. Groenendijk, Sezer Karaoglu, Theo Gevers et al. · 0 citations
Preprint Aug 2026

GenRec: Knowing Where to Reconstruct and Where to Generate

GenRec is introduced, a multi-view flow matching model that builds the reconstruction--generation split directly into its architecture, supervision, and gradient flow, and attains the best reconstruction fidelity in observed regions while also surpassing purely generative baselines on perceptual quality in unobserved o...

Ata Çelen, Jaewoo Jung, Federico Tombari et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.