Multi-Camera Visual-Inertial Navigation with Online Intrinsic and Extrinsic Calibration
| Autor: | Guoquan Huang, Patrick Geneva, Kevin Eckenhoff, Jesse Bloecker |
|---|---|
| Rok vydání: | 2019 |
| Předmět: |
0209 industrial biotechnology
Inertial frame of reference Computer science Calibration (statistics) business.industry ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION State vector Navigation system 02 engineering and technology Kalman filter Intrinsics 020901 industrial engineering & automation Inertial measurement unit 0202 electrical engineering electronic engineering information engineering 020201 artificial intelligence & image processing Computer vision Artificial intelligence business Inertial navigation system Interpolation |
| Zdroj: | ICRA |
| DOI: | 10.1109/icra.2019.8793886 |
| Popis: | This paper presents a general multi-camera visual-inertial navigation system (mc-VINS) with online instrinsic and extrinsic calibration, which is able to utilize all the information from an arbitrary number of asynchronous cameras. In particular, within the standard multi-state constraint Kalman Filter (MSCKF) framework, we only clone the IMU poses related to a single “base camera” (rather than all cameras) in the state vector, while the IMU poses corresponding to all other camera images are represented via an interpolation of the poses bounding the measuring time. By doing so, we can fuse all observations from all cameras with inertial measurements while allowing for efficient, tightly-coupled state estimation through parallelization and asynchrony. Moreover, we perform online sensor calibration of each camera’s intrinsics as well as the spatial (transformation) and temporal (time offset) extrinsic parameters between all involved sensors (cameras and IMU), thus enabling high-fidelity localization. We validate the proposed mc-VINS algorithm in various real-world experiments with different sensor configurations, showing the ability to offer real-time high-precision localization and calibration results. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|