Reconstruction algorithm for lost frame of multiview videos based on deep learning multilayer perceptron regression

Autor: Hua-Wei Tseng, 曾華瑋
Rok vydání: 2018
Druh dokumentu: 學位論文 ; thesis
Popis: 106
Wireless Multimedia Sensor Network (WMSN) is important for environmental monitoring. When the sensors are used as cameras, the network can be regarded as a multiview videos which are transmitted wirelessly. When the video frames are lost during transmission, frame reconstruction method is needed in the decoder to estimate the missing pixels. In the proposed work, a reconstruction algorithm for lost frame of multiview videos in WMSN based on deep learning methods is presented. A novel pixel estimation algorithm is developed using Multilayer Perceptron Regression (MPR) with deep learning method. Furthermore, a modified inpainting method is proposed with the usage of the information from the optical flow algorithm with the neighboring available frames. Compared with the state-of-the-art method, the proposed MPR method with the traditional inpainting method increased the average Peak Signal-to-Noise Ratio (PSNR) by up to 5.62 dB. The combination of the proposed MPR method with the proposed inpainting method outperformed previous proposed combination by up to 8.32 dB on average, showing the significance of the proposed inpainting method.
Databáze: Networked Digital Library of Theses & Dissertations