Dataset and Network Structure: Towards Frames Selection for Fast Video Deblurring
Autor: | Shan Cao, Shugong Xu, Runze Ma, Abdelwahed Nahli, Zhiwei Jia |
---|---|
Jazyk: | angličtina |
Rok vydání: | 2021 |
Předmět: |
Deblurring
Speedup General Computer Science Computer science ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION Inference 02 engineering and technology 010501 environmental sciences 01 natural sciences Data degradation video frames classification 0202 electrical engineering electronic engineering information engineering Code (cryptography) General Materials Science Computer vision inference run-time Image restoration 0105 earth and related environmental sciences business.industry two stages training Deep learning Frame (networking) General Engineering deep learning Video deblurring image deblurring TK1-9971 020201 artificial intelligence & image processing Artificial intelligence Electrical engineering. Electronics. Nuclear engineering business |
Zdroj: | IEEE Access, Vol 9, Pp 61369-61382 (2021) |
ISSN: | 2169-3536 |
Popis: | Beyond the underlaying unrealistic presumptions in the existing video deblurring datasets and algorithms which presume that a naturally blurred video is fully blurred. In this work, we define a more realistic video frames averaging-based data degradation model by referring to a naturally blurred video as a partially blurred frames sequence, and use it to build REBVIDS, as a novel video deblurring dataset to close the gap between naturally blurred and synthetically blurred video training data, and to address most shortcomings of the existing datasets. We also present DeblurNet, a two phases training-based deep learning model for video deblurring, it consists of two main sub-modules; a Frame Selection Module and a Frame Deblurring Module. Compared to the recent learning-based approaches, its sub-modules have simpler network structures, with smaller number of training parameters, are easier to train and with faster inference. As naturally blurred videos are only partially blurred, the Frame Selection Module is in charge of selecting the blurred frames in a video sequence and forwarding them to the Frame Deblurring Module input, the Frame Deblurring Module in its turn will get them restored and recombine them according to the original order in a newly restored sequence beside their initially sharp neighbor frames. Extensive experimental results on several benchmarks demonstrate that DeblurNet performs favorably against the state-of-the-art, both quantitatively and qualitatively. DeblurNet proves its ability to trade between speed, computational cost and restoration quality. Besides its ability to restore video blurred frames with necessary edges and details, benefiting from its small size and its video frames selection integrated mechanism, it can speed up the inference phase by over ten times compared to existing approaches. This project dataset and code will be released soon and will be accessible through: https://github.com/nahliabdelwahed/Speed-up-video-deblurring |
Databáze: | OpenAIRE |
Externí odkaz: |