Global Co-Occurrence Feature and Local Spatial Feature Learning for Skeleton-Based Action Recognition

Autor: Jun Xie, Wentian Xin, Ruyi Liu, Qiguang Miao, Lijie Sheng, Liang Zhang, Xuesong Gao
Jazyk: angličtina
Rok vydání: 2020
Předmět:
Zdroj: Entropy, Vol 22, Iss 10, p 1135 (2020)
Druh dokumentu: article
ISSN: 1099-4300
DOI: 10.3390/e22101135
Popis: Recent progress on skeleton-based action recognition has been substantial, benefiting mostly from the explosive development of Graph Convolutional Networks (GCN). However, prevailing GCN-based methods may not effectively capture the global co-occurrence features among joints and the local spatial structure features composed of adjacent bones. They also ignore the effect of channels unrelated to action recognition on model performance. Accordingly, to address these issues, we propose a Global Co-occurrence feature and Local Spatial feature learning model (GCLS) consisting of two branches. The first branch, based on the Vertex Attention Mechanism branch (VAM-branch), captures the global co-occurrence feature of actions effectively; the second, based on the Cross-kernel Feature Fusion branch (CFF-branch), extracts local spatial structure features composed of adjacent bones and restrains the channels unrelated to action recognition. Extensive experiments on two large-scale datasets, NTU-RGB+D and Kinetics, demonstrate that GCLS achieves the best performance when compared to the mainstream approaches.
Databáze: Directory of Open Access Journals
Nepřihlášeným uživatelům se plný text nezobrazuje