Rapid volumetric reconstruction and tracking for Fourier light-field microscopy enables real-time calcium imaging in freely behaving Hydra
TL;DR
OpenFLR, an open-source software framework for real-time volumetric reconstruction, three-dimensional particle tracking, and calcium image processing using FLFM is presented, and a hybrid experimental-computational PSF calibration strategy and a triangulation approach to tracking are used to extract particle positions in 3D directly from raw light field frames, bypassing reconstruction.
Abstract
Fourier light field microscopy (FLFM) enables high-speed volumetric imaging by encoding multiple angular perspectives of a three-dimensional sample onto a single image. For this reason, FLFM is well-suited to sparse and rapidly evolving biological systems. To aid in the adoption of FLFM, we present OpenFLR, an open-source software framework for real-time volumetric reconstruction, three-dimensional particle tracking, and calcium image processing using FLFM. OpenFLR reconstruction is distributed as four interchangeable interfaces: a Python library, a command-line script, an interactive web application, and an ImageJ/micromanager plugin, so that the pipeline is accessible to both developers and bench biologists. Building on established Richardson-Lucy deconvolution, we use a hybrid experimental-computational PSF calibration strategy and a triangulation approach to tracking to extract particle positions in 3D directly from raw light field frames, bypassing reconstruction. We validate the complete pipeline on GCaMP6s recordings of freely behaving Hydra vulgaris, tracking sparse populations of neurons as they undergo large three-dimensional displacements.