TexControl: Sketch-Based Two-Stage Fashion Image Generation Using Diffusion Model

Autor:	Zhang, Yongming, Zhang, Tianyu, Xie, Haoran
Rok vydání:	2024
Předmět:	Computer Science - Computer Vision and Pattern Recognition Computer Science - Graphics
Druh dokumentu:	Working Paper
Popis:	Deep learning-based sketch-to-clothing image generation provides the initial designs and inspiration in the fashion design processes. However, clothing generation from freehand drawing is challenging due to the sparse and ambiguous information from the drawn sketches. The current generation models may have difficulty generating detailed texture information. In this work, we propose TexControl, a sketch-based fashion generation framework that uses a two-stage pipeline to generate the fashion image corresponding to the sketch input. First, we adopt ControlNet to generate the fashion image from sketch and keep the image outline stable. Then, we use an image-to-image method to optimize the detailed textures of the generated images and obtain the final results. The evaluation results show that TexControl can generate fashion images with high-quality texture as fine-grained image generation. Comment: 5 pages, 8 figures, accepted in NICOGRAPH International 2024
Databáze:	arXiv
Externí odkaz:	http://arxiv.org/abs/2405.04675 Zobrazit plný text záznamu View this record from Arxiv