A Bio-inspired Synergistic Virtual Retina Model for Tone Mapping

Autor: Maria-Jose Escobar, Marco Benzi, Pierre Kornprobst
Přispěvatelé: Biologically plausible Integrative mOdels of the Visual system : towards synergIstic Solutions for visually-Impaired people and artificial visiON (BIOVISION), Inria Sophia Antipolis - Méditerranée (CRISAM), Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Electronics Department [Valparaiso] (UTFSM), Universidad Tecnica Federico Santa Maria [Valparaiso] (UTFSM)
Jazyk: angličtina
Rok vydání: 2017
Předmět:
retina
Computer science
ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION
Adaptation (eye)
HDR
02 engineering and technology
Tone mapping
Color management
Luminance
law.invention
03 medical and health sciences
Computational photography
0302 clinical medicine
Operator (computer programming)
law
0202 electrical engineering
electronic engineering
information engineering
contrast gain control
Computer vision
photoreceptor adaptation
Computational neuroscience
business.industry
[INFO.INFO-CV]Computer Science [cs]/Computer Vision and Pattern Recognition [cs.CV]
020207 software engineering
User control
[INFO.INFO-TI]Computer Science [cs]/Image Processing [eess.IV]
Signal Processing
synergistic model
Computer Vision and Pattern Recognition
Artificial intelligence
business
[SPI.SIGNAL]Engineering Sciences [physics]/Signal and Image processing
030217 neurology & neurosurgery
Software
Zdroj: Computer Vision and Image Understanding
Computer Vision and Image Understanding, Elsevier, 2017, pp.1-27. ⟨10.1016/j.cviu.2017.11.013⟩
Computer Vision and Image Understanding, 2017, pp.1-27. ⟨10.1016/j.cviu.2017.11.013⟩
ISSN: 1077-3142
1090-235X
Popis: International audience; Real-world radiance values span several orders of magnitudes which have to be processed by artificial systems in order to capture visual scenes with a high visual sensitivity. Interestingly, it has been found that similar processing happens in biological systems, starting at the retina level. So our motivation in this paper is to develop a new video tone mapping operator (TMO) based on a synergistic model of the retina. We start from the so-called Virtual Retina model, which has been developed in computational neuroscience. We show how to enrich this model with new features to use it as a TMO, such as color management, luminance adaptation at photoreceptor level and readout from a heterogeneous population activity. Our method works for video but can also be applied to static images (by repeating images in time). It has been carefully evaluated on standard benchmarks in the static case, giving comparable results to the state-of-the-art using default parameters, while offering user control for finer tuning. Results on HDR videos are also promising, specifically w.r.t. temporal luminance coherency. As a whole, this paper shows a promising way to address computational photography challenges by exploiting the current research in neuroscience about retina processing.
Databáze: OpenAIRE
Externí odkaz: