Exemplar-Based Sketch Colorization with Cross-Domain Dense Semantic Correspondence

Autor: Jinrong Cui, Haowei Zhong, Hailong Liu, Yulu Fu
Jazyk: angličtina
Rok vydání: 2022
Předmět:
Zdroj: Mathematics, Vol 10, Iss 12, p 1988 (2022)
Druh dokumentu: article
ISSN: 2227-7390
DOI: 10.3390/math10121988
Popis: This paper aims to solve the task of coloring a sketch image given a ready-colored exemplar image. Conventional exemplar-based colorization methods tend to transfer styles from reference images to grayscale images by employing image analogy techniques or establishing semantic correspondences. However, their practical capabilities are limited when semantic correspondences are elusive. This is the case with coloring for sketches (where semantic correspondences are challenging to find) since it contains only edge information of the object and usually contains much noise. To address this, we present a framework for exemplar-based sketch colorization tasks that synthesizes colored images from sketch input and reference input in a distinct domain. Generally, we jointly proposed our domain alignment network, where the dense semantic correspondence can be established, with a simple but valuable adversarial strategy, that we term the structural and colorific conditions. Furthermore, we proposed to utilize a self-attention mechanism for style transfer from exemplar to sketch. It facilitates the establishment of dense semantic correspondence, which we term the spatially corresponding semantic transfer module. We demonstrate the effectiveness of our proposed method in several sketch-related translation tasks via quantitative and qualitative evaluation.
Databáze: Directory of Open Access Journals
Nepřihlášeným uživatelům se plný text nezobrazuje