Perceptual colorization of the peripheral retinotopic visual field using adversarially-optimized neural networks

Autor: Cohen Duwek, Hadar, Showgan, Yahia, Ezra Tsur, Elishai
Rok vydání: 2023
Předmět:
Zdroj: Proceedings of the Annual Meeting of the Cognitive Science Society, vol 45, iss 45
Popis: There is an apparent discrepancy between visual perception, which is colorful, complete, and in high resolution, and the saccadic, and spatially heterogeneous retinal input data. In this work, we computationally emulated foveated color maps and intensity channels as well as intra-saccadic motion data using a neuromorphic event camera. We used a convolutional neural network, U-Net, and adversarial optimization to demonstrate how retinal inputs can be used for the reconstruction of colorful images in high resolution. Our model may set the groundwork for the development of biologically plausible neural networks for computational vision perception.
Databáze: OpenAIRE