Partially fake it till you make it: mixing real and fake thermal images for improved object detection
| Autor: | Francesco Bongini, Alberto Del Bimbo, Lorenzo Berlincioni, Marco Bertini |
|---|---|
| Jazyk: | angličtina |
| Rok vydání: | 2021 |
| Předmět: |
FOS: Computer and information sciences
computer graphics domain adaptation pedestrian detection thermal videos ADAS GAN Computer science business.industry Pedestrian detection Computer Vision and Pattern Recognition (cs.CV) Detector Computer Science - Computer Vision and Pattern Recognition Context (language use) Object detection Computer graphics Generative model Compositing Computer vision State (computer science) Artificial intelligence business |
| Zdroj: | ACM Multimedia |
| Popis: | In this paper we propose a novel data augmentation approach for visual content domains that have scarce training datasets, compositing synthetic 3D objects within real scenes. We show the performance of the proposed system in the context of object detection in thermal videos, a domain where i) training datasets are very limited compared to visible spectrum datasets and ii) creating full realistic synthetic scenes is extremely cumbersome and expensive due to the difficulty in modeling the thermal properties of the materials of the scene. We compare different augmentation strategies, including state of the art approaches obtained through RL techniques, the injection of simulated data and the employment of a generative model, and study how to best combine our proposed augmentation with these other techniques. Experimental results demonstrate the effectiveness of our approach, and our single-modality detector achieves state-of-the-art results on the FLIR ADAS dataset. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|