Fast light-field 3D microscopy with out-of-distribution detection and adaptation through Conditional Normalizing Flows.

Autor:	Vizcaíno JP; Computational Imaging and Inverse Problems, Department of Informatics, School of Computation, Information and Technology, Technical University of Munich, Germany.; Munich Institute of Biomedical Engineering, Technical University of Munich, Germany., Symvoulidis P; Synthetic Neurobiology Group, Massachusetts Institute of Technology, USA., Wang Z; Synthetic Neurobiology Group, Massachusetts Institute of Technology, USA., Jelten J; Computational Imaging and Inverse Problems, Department of Informatics, School of Computation, Information and Technology, Technical University of Munich, Germany.; Munich Institute of Biomedical Engineering, Technical University of Munich, Germany., Favaro P; Computer Vision Group, University of Bern, Switzerland., Boyden ES; Synthetic Neurobiology Group, Massachusetts Institute of Technology, USA., Lasser T; Computational Imaging and Inverse Problems, Department of Informatics, School of Computation, Information and Technology, Technical University of Munich, Germany.; Munich Institute of Biomedical Engineering, Technical University of Munich, Germany.
Jazyk:	angličtina
Zdroj:	ArXiv [ArXiv] 2023 Jun 14. Date of Electronic Publication: 2023 Jun 14.
Abstrakt:	Real-time 3D fluorescence microscopy is crucial for the spatiotemporal analysis of live organisms, such as neural activity monitoring. The eXtended field-of-view light field microscope (XLFM), also known as Fourier light field microscope, is a straightforward, single snapshot solution to achieve this. The XLFM acquires spatial-angular information in a single camera exposure. In a subsequent step, a 3D volume can be algorithmically reconstructed, making it exceptionally well-suited for real-time 3D acquisition and potential analysis. Unfortunately, traditional reconstruction methods (like deconvolution) require lengthy processing times (0.0220 Hz), hampering the speed advantages of the XLFM. Neural network architectures can overcome the speed constraints at the expense of lacking certainty metrics, which renders them untrustworthy for the biomedical realm. This work proposes a novel architecture to perform fast 3D reconstructions of live immobilized zebrafish neural activity based on a conditional normalizing flow. It reconstructs volumes at 8 Hz spanning 512 × 512 × 96 voxels, and it can be trained in under two hours due to the small dataset requirements (10 image-volume pairs). Furthermore, normalizing flows allow for exact Likelihood computation, enabling distribution monitoring, followed by out-of-distribution detection and retraining of the system when a novel sample is detected. We evaluate the proposed method on a cross-validation approach involving multiple in-distribution samples (genetically identical zebrafish) and various out-of-distribution ones. Competing Interests: Disclosures. The authors declare no conflicts of interest.
Databáze:	MEDLINE
Externí odkaz:	Zobrazit plný text záznamu