Multi-Scheme Frame Rate Up-Conversion Using Space-Time Saliency

Autor: Ran Li, Yongfeng Lv, Zhenghui Liu
Jazyk: angličtina
Rok vydání: 2018
Předmět:
Zdroj: IEEE Access, Vol 6, Pp 1905-1915 (2018)
Druh dokumentu: article
ISSN: 2169-3536
48153117
DOI: 10.1109/ACCESS.2017.2780822
Popis: We propose a novel frame rate up-conversion algorithm, which adaptively selects multiple motion estimation (ME) schemes to generate absent frames according to the space-time saliency. We first use a space-time saliency classifier to determine which frames are most important to a human observer. Based on the varying saliency over time, we adopt high-cost ME scheme on high-salient frame but low-cost ME scheme on low-salient frame. Automatic switch of multiple ME schemes takes human visual attention into consideration, so that unnecessary computations cannot be invested into the frames of no interest. Experimental results show that our algorithm provides a better visual interpolation quality, while removing some redundant computations.
Databáze: Directory of Open Access Journals