Multi-focus images fusion via residual generative adversarial network

Autor: Xiaomin Yang, Qingyu Mao, Gwanggil Jeon, Kai Liu, Farhan Hussain, Rongzhu Zhang
Rok vydání: 2021
Předmět:
Zdroj: Multimedia Tools and Applications. 81:12305-12323
ISSN: 1573-7721
1380-7501
Popis: Recently, most existing learning-based fusion methods are not fully end-to-end, which still predict the decision map and recover the fused image by the refined decision map. However, in practice, these methods are hard to predict the decision map precisely. Inaccurate prediction further degrades the performance of fusing, resulting in edge blurring and artefacts. This paper proposes an end-to-end multi-focus image fusion model based on conditional generative adversarial network (MFFGAN). In MFFGAN, we introduce a pioneering use of the conditional generative adversarial network to the field of image fusion. Moreover, we introduce the simple and efficient relativistic discriminator to our network, so the network converges faster. More importantly, MFFGAN is fully trained in this adversarial relationship to produce visually perceptive images that contain rich texture information and avoid the post-processing phase. Considering the detailed information of source images, we introduce the widely used perceptual loss to improve fused image performance. Thanks to the element-wise fusion criterion, our model can conveniently and efficiently fuse multiple images. Additionally, extensive experimental results show that the proposed model achieves excellent performance in subjective and objective evaluations.
Databáze: OpenAIRE
Externí odkaz: