Gluing Reference Patches Together for Face Super-Resolution

Autor: Ji-Soo Kim, Keunsoo Ko, Chang-Su Kim
Jazyk: angličtina
Rok vydání: 2021
Předmět:
Zdroj: IEEE Access, Vol 9, Pp 169321-169334 (2021)
Druh dokumentu: article
ISSN: 2169-3536
DOI: 10.1109/ACCESS.2021.3138442
Popis: Face super-resolution is a domain-specific super-resolution task to generate a high-resolution facial image from a low-resolution one. In this paper, we propose a novel face super-resolution network, called CollageNet, to super-resolve an input image by exploiting a reference image of an identical person at the patch level. First, we extract feature pyramids from input and reference images to exploit multi-scale information hierarchically. Next, we compute the patch-wise similarities between input and reference feature pyramids and select the $K$ most similar reference patches to each input patch. Then, we compose a collaged feature pyramid by gluing those selected patches together. Finally, we obtain a super-resolved image by blending the collaged feature pyramid and the input feature. Experimental results demonstrate that the proposed CollageNet yields state-of-the-art performances.
Databáze: Directory of Open Access Journals