Deep Single Image Deraining via Modeling Haze-Like Effect

Autor: Anton van den Hengel, Yinglong Wang, Bing Zeng, Jie Yang, Dehua Xie, Qinfeng Shi, Dong Gong
Rok vydání: 2021
Předmět:
Zdroj: IEEE Transactions on Multimedia. 23:2481-2492
ISSN: 1941-0077
1520-9210
Popis: Removing rain from images is of a great importance to various applications such as autonomous driving, drone piloting, and photo editing. Conventional methods rely on some heuristics to handcraft various priors to remove or separate rain from images. Recently, deep learning models are proposed to learn various end-to-end methods to complete this task. However, these methods might fail in obtaining satisfactory results in some real-world scenarios, especially when the captured images suffer from heavy rain that brings not only rain streaks but also a haze-like effect (caused by the accumulation of tiny raindrops). Different from most of the existing deep learning deraining methods that focus on handling rain streaks, we add a new variable to model the haze-like effect in a general model for rain, based on which a deep neural network is designed accordingly. Specifically, in our method, two branches are designed to handle rain streaks and the haze-like effect, respectively. The output of such branch structure is fed to an additional module to further enhance the performance. Three modules are trained jointly, leading to an end-to-end network, which supports a adjustment to the strength of removing the haze-like effect. Extensive experiments on several datasets show that our method outperforms several state-of-the-art methods in both objective assessment and visual quality.
Databáze: OpenAIRE
Externí odkaz: