Noise Doesn't Lie: Towards Universal Detection of Deep Inpainting
| Autor: | Xingjun Ma, Qiuhong Ke, Zhiyuan Zong, Feng Xue, Rui Zhang, Haiqin Weng, Ang Li |
|---|---|
| Jazyk: | angličtina |
| Rok vydání: | 2021 |
| Předmět: |
FOS: Computer and information sciences
Test data generation Computer science business.industry Computer Vision and Pattern Recognition (cs.CV) Inpainting ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION Computer Science - Computer Vision and Pattern Recognition Pattern recognition Image (mathematics) Range (mathematics) Discriminative model Margin (machine learning) Benchmark (computing) Noise (video) Artificial intelligence business |
| Zdroj: | IJCAI |
| Popis: | Deep image inpainting aims to restore damaged or missing regions in an image with realistic contents. While having a wide range of applications such as object removal and image recovery, deep inpainting techniques also have the risk of being manipulated for image forgery. A promising countermeasure against such forgeries is deep inpainting detection, which aims to locate the inpainted regions in an image. In this paper, we make the first attempt towards universal detection of deep inpainting, where the detection network can generalize well when detecting different deep inpainting methods. To this end, we first propose a novel data generation approach to generate a universal training dataset, which imitates the noise discrepancies exist in real versus inpainted image contents to train universal detectors. We then design a Noise-Image Cross-fusion Network (NIX-Net) to effectively exploit the discriminative information contained in both the images and their noise patterns. We empirically show, on multiple benchmark datasets, that our approach outperforms existing detection methods by a large margin and generalize well to unseen deep inpainting techniques. Our universal training dataset can also significantly boost the generalizability of existing detection methods. Accepted by IJCAI 2021 |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|