Snapshot Compressive ToF+Spectral Imaging via Optimized Color-Coded Apertures
| Autor: | Juan F. Florez-Ospina, Gonzalo R. Arce, Daniel L. Lau, Hoover Fabián Rueda-Chacón |
|---|---|
| Rok vydání: | 2020 |
| Předmět: |
medicine.medical_specialty
Aperture Computer science Multispectral image ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION 02 engineering and technology Iterative reconstruction law.invention Optical imaging Artificial Intelligence law 0202 electrical engineering electronic engineering information engineering medicine Computer vision Image sensor Image resolution Pixel business.industry Applied Mathematics Spectral imaging Lens (optics) Computational Theory and Mathematics RGB color model 020201 artificial intelligence & image processing Computer Vision and Pattern Recognition Artificial intelligence business Software |
| Zdroj: | IEEE Transactions on Pattern Analysis and Machine Intelligence. 42:2346-2360 |
| ISSN: | 1939-3539 0162-8828 |
| Popis: | Compressive multispectral imaging systems comprise a new generation of spectral imagers that capture coded projections of a scene where spectral data cubes are reconstructed computationally. Separately, time-of-flight (ToF) cameras obtain 2D range images where each pixel records the distance from the camera sensor to the target surface. The demand for these imaging modalities is rapidly increasing, and thus, there is strong interest in developing new image sensors that can simultaneously acquire multispectral-color-and-depth imagery (MS+D) using a single aperture. Work in this path has been mainly developed via RGB+D imaging. However, in RGB+D, the multispectral image is limited to three spectral channels, and the imaging system often relies on two image sensors. We recently proposed a compressive MS+D imaging device that used a digital-micromirror-device, requiring a bulky double imaging-and-relay path. To overcome the bulkiness and other difficulties of our previous imaging system, this work presents a more-compact MS+D imaging device with snapshot capabilities. It provides better spectral sensing, relying on a static color-coded-aperture (CCA) and a ToF sensor. To guarantee good quality in the recovery, we develop an optimization method for CCA based-on blue-noise-multitoning, solved via the direct-binary-search algorithm. A testbed-setup is reported along with simulated and real experiments that demonstrate the MS+D capabilities of the proposed system over static and dynamic scenes. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|