Monocular Depth Estimation from a Single Infrared Image
| Autor: | Daechan Han, Yukyung Choi |
|---|---|
| Jazyk: | angličtina |
| Rok vydání: | 2022 |
| Předmět: |
Computer Networks and Communications
Hardware and Architecture Control and Systems Engineering Computer Science::Computer Vision and Pattern Recognition Signal Processing ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION Electrical and Electronic Engineering monocular depth estimation self-supervised learning infrared image night vision pseudo-label local descriptor |
| Zdroj: | Electronics; Volume 11; Issue 11; Pages: 1729 |
| ISSN: | 2079-9292 |
| DOI: | 10.3390/electronics11111729 |
| Popis: | Thermal infrared imaging is attracting much attention due to its strength against illuminance variation. However, because of the spectral difference between thermal infrared images and RGB images, the existing research on self-supervised monocular depth estimation has performance limitations. Therefore, in this study, we propose a novel Self-Guided Framework using a Pseudolabel predicted from RGB images. Our proposed framework, which solves the problem of appearance matching loss in the existing framework, transfers the high accuracy of Pseudolabel to the thermal depth estimation network by comparing low- and high-level pixels. Furthermore, we propose Patch-NetVLAD Loss, which strengthens local detail and global context information in the depth map from thermal infrared imaging by comparing locally global patch-level descriptors. Finally, we introduce an Image Matching Loss to estimate a more accurate depth map in a thermal depth network by enhancing the performance of the Pseudolabel. We demonstrate that the proposed framework shows significant performance improvement even when applied to various depth networks in the KAIST Multispectral Dataset. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|