Temporally coherent general dynamic scene reconstruction
| Autor: | Marco Volino, Adrian Hilton, Armin Mustafa, Hansung Kim, Jean-Yves Guillemaut |
|---|---|
| Jazyk: | angličtina |
| Rok vydání: | 2020 |
| Předmět: |
FOS: Computer and information sciences
Computer science business.industry Computer Vision and Pattern Recognition (cs.CV) Computer Science - Computer Vision and Pattern Recognition ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION 020207 software engineering Strong prior 02 engineering and technology Virtual reality Shape constraint Rendering (computer graphics) Artificial Intelligence Computer Science::Computer Vision and Pattern Recognition 0202 electrical engineering electronic engineering information engineering 020201 artificial intelligence & image processing Segmentation Computer vision Computer Vision and Pattern Recognition Artificial intelligence Shape reconstruction business Software ComputingMethodologies_COMPUTERGRAPHICS |
| Popis: | Existing techniques for dynamic scene reconstruction from multiple wide-baseline cameras primarily focus on reconstruction in controlled environments, with fixed calibrated cameras and strong prior constraints. This paper introduces a general approach to obtain a 4D representation of complex dynamic scenes from multi-view wide-baseline static or moving cameras without prior knowledge of the scene structure, appearance, or illumination. Contributions of the work are: An automatic method for initial coarse reconstruction to initialize joint estimation; Sparse-to-dense temporal correspondence integrated with joint multi-view segmentation and reconstruction to introduce temporal coherence; and a general robust approach for joint segmentation refinement and dense reconstruction of dynamic scenes by introducing shape constraint. Comparison with state-of-the-art approaches on a variety of complex indoor and outdoor scenes, demonstrates improved accuracy in both multi-view segmentation and dense reconstruction. This paper demonstrates unsupervised reconstruction of complete temporally coherent 4D scene models with improved non-rigid object segmentation and shape reconstruction and its application to free-viewpoint rendering and virtual reality. Submitted to IJCV 2019. arXiv admin note: substantial text overlap with arXiv:1603.03381 |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|