Convolutional Three-Stream Network Fusion for Driver Fatigue Detection from Infrared Videos
| Autor: | Kim-Hui Yap, Lap-Pui Chau, Xiaoxi Ma, Guiju Ping |
|---|---|
| Rok vydání: | 2019 |
| Předmět: |
050210 logistics & transportation
Fusion Network architecture business.industry Infrared Computer science 05 social sciences Feature extraction ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION 02 engineering and technology Image (mathematics) 0502 economics and business Stream network 0202 electrical engineering electronic engineering information engineering 020201 artificial intelligence & image processing Computer vision Artificial intelligence business Spatial analysis |
| Zdroj: | ISCAS |
| DOI: | 10.1109/iscas.2019.8702447 |
| Popis: | We propose a convolutional three-stream network architecture for driver fatigue detection from infrared videos that are available both in the daytime and in the night time. Specifically, the convolutional three-stream network architecture incorporates current-infrared-frame-based spatial information, optical-flows-based short-term temporal information of two consecutive infrared frames and optical flow-motion history image-based (OF-MHI-based) temporal information within the infrared video sequence. And then these three networks are fused at the last convolutional layer by 3D CNN. Besides, an estimation method to evaluate the current driver fatigue level is proposed based on the fatigue detection results from previous frames, which helps to generate alerts properly in real-life driving applications. We show that the proposed method achieves state-of-the-art performance, 94.68% accuracy, in our driver behavior dataset using the infrared data. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|