Mask-based Style-Controlled Image Synthesis Using a Mask Style Encoder
| Autor: | Wataru Shimoda, Jaehyeong Cho, Keiji Yanai |
|---|---|
| Rok vydání: | 2021 |
| Předmět: |
Computer science
business.industry Feature extraction ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION Normalization (image processing) 020207 software engineering 02 engineering and technology Image segmentation 010501 environmental sciences Translation (geometry) Real image 01 natural sciences Pattern recognition (psychology) 0202 electrical engineering electronic engineering information engineering Segmentation Computer vision Artificial intelligence business Encoder 0105 earth and related environmental sciences |
| Zdroj: | ICPR |
| DOI: | 10.1109/icpr48806.2021.9412647 |
| Popis: | In recent years, the advances in Generative Adversarial Networks (GANs) have shown impressive results for image generation and translation tasks. In particular, the image-to-image translation is a method of learning mapping from a source domain to a target domain and synthesizing an image. Image-to-image translation can be applied to a variety of tasks, making it possible to quickly and easily synthesize realistic images from semantic segmentation masks. However, in the existing image-to-image translation method, there is a limitation on controlling the style of the translated image, and it is not easy to synthesize an image by controlling the style of each mask element in detail. Therefore, we propose an image synthesis method that controls the style of each element by improving the existing image-to-image translation method. In the proposed method, we implement a mask style encoder that extracts style features for each mask element. The extracted style features are concatenated to the semantic mask in the normalization layer, and used the style-controlled image synthesis of each mask element. In the experiments, we performed style-controlled images synthesis using the datasets consisting of semantic segmentation masks and real images. The results show that the proposed method has excellent performance for style-controlled images synthesis for each element. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|