A novel feature extractor for human action recognition in visual question answering
| Autor: | Francisco H. S. Silva, Pedro Pedrosa Rebouças Filho, Aloisio Vieira Lira Neto, Gabriel Bandeira Holanda, Paulo A. L. Rego, Victor Hugo C. de Albuquerque, J. Wellington M. de Souza, Gabriel M. Bezerra |
|---|---|
| Rok vydání: | 2021 |
| Předmět: |
Computer science
business.industry Pattern recognition Frame rate Extractor Task (project management) Naive Bayes classifier Artificial Intelligence Signal Processing Feature (machine learning) Question answering Computer Vision and Pattern Recognition Artificial intelligence business Pose Software Complement (set theory) |
| Zdroj: | Pattern Recognition Letters. 147:41-47 |
| ISSN: | 0167-8655 |
| DOI: | 10.1016/j.patrec.2021.04.002 |
| Popis: | Recognizing and classifying human actions in video clips is a powerful technology for surveillance applications. However, most of the state-of-the-art approaches for this task lack the possibility of being implemented in real-time applications without causing a critical delay. Thus, we propose a fast method to human action recognition for visual question answering, based on a novel feature extractor developed by us, 2D pose estimation, and machine learning techniques. Our extractor obtains features based on distances, angles, and positions of detected anatomical keypoints. We used the UCF101 dataset that corresponds to 13,320 videos with realistic human actions, collected from YouTube, for our work evaluation. The proposed feature extractor, combined with the Complement Naive Bayes classifier, reached a mean Average Precision ( m A P ) of 62.03 % and processed 5.26 frames per second, proving to be faster than most methods while achieving a decent m A P . |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|
Full Text from ScienceDirect