3D Perception and Augmented Reality Developments in Underwater Robotics for Ocean Sciences

Autor: Lorenzo Brignone, Aurélien Arnaubec, Jan Opderbecke, Claire Dune, Matheus Laranjeira
Přispěvatelé: Département Systèmes Sous-Marins - IFREMER, Institut Français de Recherche pour l'Exploitation de la Mer (IFREMER), Laboratoire Conception des Systèmes Mécaniques et Robotiques - EA 7398 (COSMER), Université de Toulon (UTLN), Université de Toulon -IUT de Toulon (UTLN)
Rok vydání: 2020
Předmět:
Computer science
media_common.quotation_subject
Terrain
02 engineering and technology
Virtual reality
Underwater robotics
Remotely operated underwater vehicle
01 natural sciences
[SPI.AUTO]Engineering Sciences [physics]/Automatic
Underwater augmented reality
Human–computer interaction
[INFO.INFO-AU]Computer Science [cs]/Automatic Control Engineering
Perception
0202 electrical engineering
electronic engineering
information engineering

[INFO.INFO-RB]Computer Science [cs]/Robotics [cs.RO]
14. Life underwater
ComputingMilieux_MISCELLANEOUS
media_common
3D visual terrain model
business.industry
010401 analytical chemistry
Robotics
General Medicine
Mixed reality
0104 chemical sciences
Operator assistance
13. Climate action
020201 artificial intelligence & image processing
Augmented reality
Artificial intelligence
business
[SPI.SIGNAL]Engineering Sciences [physics]/Signal and Image processing
Zdroj: Current Robotics Reports
Current Robotics Reports, 2020, 1 (3), pp.123-130. ⟨10.1007/s43154-020-00014-5⟩
Current Robotics Reports (2662-4087) (Springer Science and Business Media LLC), 2020, Vol. 1, P. 123-130
ISSN: 2662-4087
DOI: 10.1007/s43154-020-00014-5
Popis: Purpose of Review This paper addresses the benefits and challenges of mixed reality (MR) for the exploration of deep-sea environments with remotely operated vehicles. The approach is twofold: virtual reality (VR) let the scientist explore the environment via a visual 3D model, overcoming limitations of local perception. Augmented reality (AR) concepts are designed in order to improve environment perception and interaction. Recent Findings The key to such concepts is the implementation of 3D visual geo-referenced terrain models from the imaging feedback gathered by the vehicle exploring its unknown surroundings. Image processing, underwater vehicle navigation, and user-friendly displays for robotic intervention are addressed in an integrated concept. A broad development programme carried out at the French Institute for Ocean Science, IFREMER, is described and illustrates technical topics and use cases. Summary 3D perception derived from camera vision is shown to enable AR concepts that will significantly improve remote exploration and intervention in unknown natural environments. Cumulative geo-referenced 3D model building is in the process of being taken to reliable functioning in real-world underwater applications, accomplishing a milestone change in the capacity to view and understand the obscure and inaccessible deep-sea world.
Databáze: OpenAIRE