Video-based social behavior recognition based on kernel relevance analysis
| Autor: | Andrés Marino Álvarez-Meza, Germán Castellanos-Domínguez, Jorge L. Fernández-Ramírez, Álvaro-Ángel Orozco-Gutierrez, Eduardo M. Pereira |
|---|---|
| Rok vydání: | 2019 |
| Předmět: |
Scheme (programming language)
Measure (data warehouse) Computer science business.industry 020207 software engineering 02 engineering and technology Extension (predicate logic) Human behavior Machine learning computer.software_genre Computer Graphics and Computer-Aided Design Task (project management) Set (abstract data type) Computer graphics Kernel (statistics) 0202 electrical engineering electronic engineering information engineering 020201 artificial intelligence & image processing Computer Vision and Pattern Recognition Artificial intelligence business computer Software computer.programming_language |
| Zdroj: | The Visual Computer. 36:1535-1547 |
| ISSN: | 1432-2315 0178-2789 |
| DOI: | 10.1007/s00371-019-01754-y |
| Popis: | This paper presents a kernel-based relevance analysis for video data to support social behavior recognition. Our approach, termed KRAV, is twofold: (i) A feature ranking based on centered kernel alignment (CKA) is carried out to match social semantic features with the output labels (individual and group behaviors). The employed method is an extension of the conventional CKA to mitigate the imbalance effect of unusual human behaviors. (ii) A classification stage to perform the behavior prediction. For concrete testing, the Israel Institute of Technology social behavior database is employed to assess the KRAV under a tenfold cross-validation scheme. Attained results show that the proposed approach for the individual recognition task obtains 0.5925 $$F_1$$ measure using 50 relevant features. Likewise, for the group recognition task obtains 0.8094 $$F_1$$ measure using 12 relevant features, which in both cases outperforms state-of-the-art results concerning the classification performance and number of employed features. Also, our video-based approach would assist further social behavior analysis from the set of features selected regarding the recognition of individual profiles and group behaviors. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|
Full text from SpringerLink