HaGRIDv2: 1M Images for Static and Dynamic Hand Gesture Recognition

Autor:	Nuzhdin, Anton, Nagaev, Alexander, Sautin, Alexander, Kapitanov, Alexander, Kvanchiani, Karina
Rok vydání:	2024
Předmět:	Computer Science - Computer Vision and Pattern Recognition
Druh dokumentu:	Working Paper
Popis:	This paper proposes the second version of the widespread Hand Gesture Recognition dataset HaGRID -- HaGRIDv2. We cover 15 new gestures with conversation and control functions, including two-handed ones. Building on the foundational concepts proposed by HaGRID's authors, we implemented the dynamic gesture recognition algorithm and further enhanced it by adding three new groups of manipulation gestures. The ``no gesture" class was diversified by adding samples of natural hand movements, which allowed us to minimize false positives by 6 times. Combining extra samples with HaGRID, the received version outperforms the original in pre-training models for gesture-related tasks. Besides, we achieved the best generalization ability among gesture and hand detection datasets. In addition, the second version enhances the quality of the gestures generated by the diffusion model. HaGRIDv2, pre-trained models, and a dynamic gesture recognition algorithm are publicly available. Comment: hand gesture recognition, dataset, hgr system, large-scale database
Databáze:	arXiv
Externí odkaz:	http://arxiv.org/abs/2412.01508 Zobrazit plný text záznamu View this record from Arxiv