Accurate Human Body Reconstruction for Volumetric Video

Autor: Decai Chen, Markus Worchel, Ingo Feldmann, Oliver Schreer, Peter Eisert
Rok vydání: 2022
Předmět:
DOI: 10.48550/arxiv.2202.13118
Popis: In this work, we enhance a professional end-to-end volumetric video production pipeline to achieve high-fidelity human body reconstruction using only passive cameras. While current volumetric video approaches estimate depth maps using traditional stereo matching techniques, we introduce and optimize deep learning-based multi-view stereo networks for depth map estimation in the context of professional volumetric video reconstruction. Furthermore, we propose a novel depth map post-processing approach including filtering and fusion, by taking into account photometric confidence, cross-view geometric consistency, foreground masks as well as camera viewing frustums. We show that our method can generate high levels of geometric detail for reconstructed human bodies.
Comment: 2021 International Conference on 3D Immersion (IC3D)
Databáze: OpenAIRE