Adaptive image warping for hole prevention in 3D view synthesis
| Autor: | Lutz Goldmann, Sebastian Knorr, Thomas Sikora, Nils Plath |
|---|---|
| Rok vydání: | 2013 |
| Předmět: |
Video post-processing
Computer science business.industry ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION 2D to 3D conversion Stereoscopy Image processing Image-based modeling and rendering Computer Graphics and Computer-Aided Design Rendering (computer graphics) law.invention View synthesis Image-based lighting Depth map law Video tracking Computer vision Artificial intelligence Image warping Multiview Video Coding business Software ComputingMethodologies_COMPUTERGRAPHICS |
| Zdroj: | IEEE transactions on image processing : a publication of the IEEE Signal Processing Society. 22(9) |
| ISSN: | 1941-0042 |
| Popis: | Increasing popularity of 3D videos calls for new methods to ease the conversion process of existing monocular video to stereoscopic or multi-view video. A popular way to convert video is given by depth image-based rendering methods, in which a depth map that is associated with an image frame is used to generate a virtual view. Because of the lack of knowledge about the 3D structure of a scene and its corresponding texture, the conversion of 2D video, inevitably, however, leads to holes in the resulting 3D image as a result of newly-exposed areas. The conversion process can be altered such that no holes become visible in the resulting 3D view by superimposing a regular grid over the depth map and deforming it. In this paper, an adaptive image warping approach as an improvement to the regular approach is proposed. The new algorithm exploits the smoothness of a typical depth map to reduce the complexity of the underlying optimization problem that is necessary to find the deformation, which is required to prevent holes. This is achieved by splitting a depth map into blocks of homogeneous depth using quadtrees and running the optimization on the resulting adaptive grid. The results show that this approach leads to a considerable reduction of the computational complexity while maintaining the visual quality of the synthesized views. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|