FullFusion: A Framework for Semantic Reconstruction of Dynamic Scenes
Autor: | Barry Lennox, Mikel Luján, Mihai Bujanca |
---|---|
Rok vydání: | 2019 |
Předmět: |
0209 industrial biotechnology
business.industry Computer science 020207 software engineering Mobile robot 02 engineering and technology Image segmentation Iterative reconstruction Simultaneous localization and mapping Semantics 020901 industrial engineering & automation Human–computer interaction 0202 electrical engineering electronic engineering information engineering Robot Segmentation Artificial intelligence business Pose |
Zdroj: | ICCV Workshops |
DOI: | 10.1109/iccvw.2019.00272 |
Popis: | Assuming that scenes are static is common in SLAM research. However, the world is complex, dynamic, and features interactive agents. Mobile robots operating in a variety of environments in real-life scenarios require an advanced level of understanding of their surroundings. Therefore, it is crucial to find effective ways of representing the world in its dynamic complexity, beyond the geometry of static scene elements. We present a framework that enables incremental reconstruction of semantically-annotated 3D models in dynamic settings using commodity RGB-D sensors. Our method is the first to perform semantic reconstruction of non-rigidly deforming objects along with a static background. FullFusion is a step towards enabling robots to have a deeper and richer understanding of their surroundings, and can facilitate the study of interaction and scene dynamics. To showcase the potential of FullFusion, we provide a quantitative and qualitative evaluation on a baseline implementation which employs specific reconstruction and segmentation pipelines. It is, however, important to highlight that the modular design of the framework allows us to easily replace any of the components with new or existing counterparts. |
Databáze: | OpenAIRE |
Externí odkaz: |