Fine-grained action recognition using dynamic kernels
Autor: | Krishna Mohan C, Sravani Yenduri, Vishnu Chalavadi, Nazil Perveen |
---|---|
Rok vydání: | 2022 |
Předmět: |
Similarity (geometry)
Matching (graph theory) Computer science business.industry Feature vector Motion (geometry) Pattern recognition Interval (mathematics) Covariance Mixture model Artificial Intelligence Kernel (statistics) Signal Processing Computer Vision and Pattern Recognition Artificial intelligence business Software |
Zdroj: | Pattern Recognition. 122:108282 |
ISSN: | 0031-3203 |
DOI: | 10.1016/j.patcog.2021.108282 |
Popis: | Fine-grained action recognition involves comparison of similar actions of variable-length size consisting of subtle interactions between human and specific objects. Hence, we propose a dynamic kernel-based approach to handle the variable-length patterns for effective recognition of fine-grained actions. Initially, we extract local spatio-temporal features for each video to capture appearance and motion information effectively. An action-independent Gaussian mixture model (AIGMM) is trained on the extracted features of all fine-grained actions to analyze spatio-temporal information and preserve the local similarities among fine-grained actions. Then, the statistics of AIGMM, namely, mean, covariance, and posteriors are used to build the kernels for finding the similarity between any two fine-grained actions by mapping statistics to kernel feature space. We demonstrate the effectiveness of proposed approach using three dynamic kernels i.e., GMM mean interval kernel, supervector kernel, intermediate matching kernel on four varieties of fine-grained action datasets, namely, MERL, JIGSAWS, KSCGR, and MPII cooking2 |
Databáze: | OpenAIRE |
Externí odkaz: |