Human skeleton behavior recognition model based on multi-object pose estimation with spatiotemporal semantics

Autor: Jiaji Liu, Xiaofang Mu, Zhenyu Liu, Hao Li
Rok vydání: 2023
Předmět:
Zdroj: Machine Vision and Applications. 34
ISSN: 1432-1769
0932-8092
Popis: Multi-object pose estimation in surveillance scenes is challenging and inaccurate due to object motion blur and pose occlusion in video data. Targeting at the temporal dependence and coherence among video frames, this paper reconstructs a multi-object pose estimation model that integrates spatiotemporal semantics for different scales and poses of video multi-objects. The model firstly, with an end-to-end detection framework, detects multiple targets in the video. Secondly, it enhances the positioning of key points of human body using the temporal cues among video frames and designs modular components to enrich the pose information, effectively refining the pose estimation. Finally, the improved human skeleton behavior recognition model based on pose estimation is employed to recognize the classroom behaviors of students oriented to video streams. Comparison with multiple classifiers through experiments reveals that the human skeleton behavior recognition model for multi-object pose estimation combined with spatiotemporal semantics exhibits an effectively improved accuracy.
Databáze: OpenAIRE
Externí odkaz: