Violent crowd flow detection from surveillance cameras using deep transfer learning-gated recurrent unit

Autor: Elly Matul Imah, Riskyana Dewi Intan Puspitasari
Jazyk: angličtina
Rok vydání: 2024
Předmět:
Zdroj: ETRI Journal, Vol 46, Iss 4, Pp 671-682 (2024)
Druh dokumentu: article
ISSN: 2023-0222
1225-6463
2233-7326
DOI: 10.4218/etrij.2023-0222
Popis: Violence can be committed anywhere, even in crowded places. It is hence necessary to monitor human activities for public safety. Surveillance cameras can monitor surrounding activities but require human assistance to continuously monitor every incident. Automatic violence detection is needed for early warning and fast response. However, such automation is still challenging because of low video resolution and blind spots. This paper uses ResNet50v2 and the gated recurrent unit (GRU) algorithm to detect violence in the Movies, Hockey, and Crowd video datasets. Spatial features were extracted from each frame sequence of the video using a pretrained model from ResNet50V2, which was then classified using the optimal trained model on the GRU architecture. The experimental results were then compared with wavelet feature extraction methods and classification models, such as the convolutional neural network and long short-term memory. The results show that the proposed combination of ResNet50V2 and GRU is robust and delivers the best performance in terms of accuracy, recall, precision, and F1-score. The use of ResNet50V2 for feature extraction can improve model performance.
Databáze: Directory of Open Access Journals