Which is the Better Inpainted Image?Training Data Generation Without Any Manual Operations

Autor: Mariko Isogawa, Kosuke Sato, Dan Mikami, Daisuke Iwai, Hideaki Kimata, Kosuke Takahashi
Rok vydání: 2018
Předmět:
Zdroj: International Journal of Computer Vision. 127:1751-1766
ISSN: 1573-1405
0920-5691
DOI: 10.1007/s11263-018-1132-0
Popis: This paper proposes a learning-based quality evaluation framework for inpainted results that does not require any subjectively annotated training data. Image inpainting, which removes and restores unwanted regions in images, is widely acknowledged as a task whose results are quite difficult to evaluate objectively. Thus, existing learning-based image quality assessment (IQA) methods for inpainting require subjectively annotated data for training. However, subjective annotation requires huge cost and subjects’ judgment occasionally differs from person to person in accordance with the judgment criteria. To overcome these difficulties, the proposed framework generates and uses simulated failure results of inpainted images whose subjective qualities are controlled as the training data. We also propose a masking method for generating training data towards fully automated training data generation. These approaches make it possible to successfully estimate better inpainted images, even though the task is quite subjective. To demonstrate the effectiveness of our approach, we test our algorithm with various datasets and show it outperforms existing IQA methods for inpainting.
Databáze: OpenAIRE