An efficient human action recognition framework with pose-based spatiotemporal features

Autor: Saeid Agahian, Farhood Negin, Cemal Köse
Jazyk: angličtina
Rok vydání: 2020
Předmět:
Zdroj: Engineering Science and Technology, an International Journal, Vol 23, Iss 1, Pp 196-203 (2020)
Druh dokumentu: article
ISSN: 2215-0986
DOI: 10.1016/j.jestch.2019.04.014
Popis: In the past two decades, human action recognition has been among the most challenging tasks in the field of computer vision. Recently, extracting accurate and cost-efficient skeleton information became available thanks to the cutting edge deep learning algorithms and low-cost depth sensors. In this paper, we propose a novel framework to recognize human actions using 3D skeleton information. The main components of the framework are pose representation and encoding. Assuming that human actions can be represented by spatiotemporal poses, we define a pose descriptor consisting of three elements. The first element contains the normalized coordinates of the raw skeleton joints information. The second element contains the temporal displacement information relative to a predefined temporal offset and the third element keeps the displacement information pertinent to the previous timestamp in the temporal resolution. The final descriptor of the whole sequence is the concatenation of frame-wise descriptors. To avoid the problems regarding high dimensionality, Principal Component Analysis (PCA) is applied on the descriptors. The resulted descriptors are encoded with Fisher Vector (FV) representation before they get trained with an Extreme Learning Machine (ELM).The performance of the proposed framework is evaluated by three public benchmark datasets. The proposed method achieved competitive results compared to the other methods in the literature. Keywords: Skeleton-based, 3D action recognition, Extreme learning machines, RGB-D
Databáze: Directory of Open Access Journals