EAGAN: Event‐based attention generative adversarial networks for optical flow and depth estimation

Autor: Xiuhong Lin, Chenhui Yang, Xuesheng Bian, Weiquan Liu, Cheng Wang
Jazyk: angličtina
Rok vydání: 2022
Předmět:
Zdroj: IET Computer Vision, Vol 16, Iss 7, Pp 581-595 (2022)
Druh dokumentu: article
ISSN: 1751-9640
1751-9632
DOI: 10.1049/cvi2.12115
Popis: Abstract Event camera is a new vision sensor that produces independent asynchronous responses to each pixel's change of illumination intensity. The unique principle of event camera has many advantages over traditional cameras, such as low latency, high temporal resolution, and high dynamic range (HDR). These advantages make event camera ideal for dealing with high speed, HDR visual tasks, especially in automatic driving scenes. In this study, we propose an image generation network named Event‐based attention generative adversarial networks (EAGAN), which simultaneously deals with optical flow and depth estimation of monocular event camera data. In addition to the innovative network architecture and loss function suitable for depth estimation, we are also the first to process incomplete training data to obtain more dense and uniform prediction results. Experiments on the multi‐vehicle stereo event camera dataset show that our EAGAN is competitive on the depth estimation task and achieves the state‐of‐the‐art effect in the optical flow estimation task.
Databáze: Directory of Open Access Journals
Externí odkaz: