Unsupervised Occlusion-Aware Stereo Matching With Directed Disparity Smoothing
Autor: | Zejian Yuan, Ang Li, Chi Wanchao, Ling Yonggen, Shenghao Zhang, Chong Zhang |
---|---|
Rok vydání: | 2022 |
Předmět: |
Smoothness (probability theory)
Pixel Computer science business.industry Mechanical Engineering ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION Inference Object (computer science) GeneralLiterature_MISCELLANEOUS Backpropagation Computer Science Applications Automotive Engineering Occlusion Unsupervised learning Computer vision Artificial intelligence business Smoothing ComputingMethodologies_COMPUTERGRAPHICS |
Zdroj: | IEEE Transactions on Intelligent Transportation Systems. 23:7457-7468 |
ISSN: | 1558-0016 1524-9050 |
DOI: | 10.1109/tits.2021.3070403 |
Popis: | When handling occlusion in unsupervised stereo matching, existing methods tend to neglect the supportive role of occlusion and to perform inappropriate disparity smoothing around the occlusion. To address these problems, we propose an occlusion-aware stereo network that contains a specific module to first estimate occlusion as an additional depth cue. In the occlusion inference module, a pixel is classified with a three-category label based on whether an area is occluded by an object on the left, occluded by an object on the right, or unoccluded. After the occluders are detected, we introduce a directed disparity smoothing loss that allows valid disparity estimates to be propagated to fill the occluded region, while ambiguous matches in the occluded region do not affect other regions. Disparity and occlusion are trained alternately in an unsupervised manner with detached backpropagation to enable the directed smoothness. Experiments show that our method achieves 3-pixel threshold error rates of 6.51% and 5.69% on the KITTI 2015 and KITTI 2012 validation sets, state-of-the-art results among unsupervised learning networks at the time of submission. |
Databáze: | OpenAIRE |
Externí odkaz: |