Histogram-guided Video Colorization Structure with Spatial-Temporal Connection

Autor: Liu, Zheyuan, Mu, Pan, Xu, Hanning, Bai, Cong
Rok vydání: 2023
Předmět:
Druh dokumentu: Working Paper
Popis: Video colorization, aiming at obtaining colorful and plausible results from grayish frames, has aroused a lot of interest recently. Nevertheless, how to maintain temporal consistency while keeping the quality of colorized results remains challenging. To tackle the above problems, we present a Histogram-guided Video Colorization with Spatial-Temporal connection structure (named ST-HVC). To fully exploit the chroma and motion information, the joint flow and histogram module is tailored to integrate the histogram and flow features. To manage the blurred and artifact, we design a combination scheme attending to temporal detail and flow feature combination. We further recombine the histogram, flow and sharpness features via a U-shape network. Extensive comparisons are conducted with several state-of-the-art image and video-based methods, demonstrating that the developed method achieves excellent performance both quantitatively and qualitatively in two video datasets.
Comment: 6 pages; Accepted at IEEE ICME
Databáze: arXiv