TSAN: Synthesized View Quality Enhancement via Two-Stream Attention Network for 3D-HEVC
| Autor: | Nam Ling, Jianjun Lei, Zhaoqing Pan, Wei-Jie Yu, Sam Kwong |
|---|---|
| Rok vydání: | 2022 |
| Předmět: |
business.industry
Computer science Feature extraction computer.software_genre Image-based modeling and rendering Convolutional neural network View synthesis Visualization Information extraction Encoding (memory) Media Technology Computer vision Artificial intelligence Electrical and Electronic Engineering business computer Block (data storage) |
| Zdroj: | IEEE Transactions on Circuits and Systems for Video Technology. 32:345-358 |
| ISSN: | 1558-2205 1051-8215 |
| Popis: | In three-dimensional video system, the texture and depth videos are jointly encoded, and then the Depth Image Based Rendering (DIBR) is utilized to realize view synthesis. However, the compression distortion of texture and depth videos, as well as the disocclusion problem in DIBR degrade the visual quality of the synthesized view. To address this problem, a Two-stream Attention Network (TSAN)-based synthesized view quality enhancement method is proposed for 3D-High Efficiency Video Coding (3D-HEVC) in this paper. First, the shortcomings of the view synthesis technique and traditional convolutional neural networks are analyzed. Then, based on these analyses, a TSAN with two information extraction streams is proposed for enhancing the quality of the synthesized view, in which the global information extraction stream learns the contextual information, and the local information extraction stream extracts the texture information from the rendered image. Third, a Multi-Scale Residual Attention Block (MSRAB) is proposed, which can efficiently detect features in different scales, and adaptively refine features by considering interdependencies among spatial dimensions. Extensive experimental results show that the proposed synthesized view quality enhancement method achieves significantly better performance than the state-of-the-art methods. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|