Diver’s hand gesture recognition and segmentation for human–robot interaction on AUV

Autor: Yu Jiang, Fenglin Wei, Minghao Zhao, Hong Qi, Chong Wang, Kai Wang
Rok vydání: 2021
Předmět:
Zdroj: Signal, Image and Video Processing. 15:1899-1906
ISSN: 1863-1711
1863-1703
Popis: For the interaction between marine robots and divers in the underwater environment, a method of diver’s gesture recognition and segmentation is proposed. This method first uses the progressive growing training method to optimize the generative adversarial networks, generating high-resolution images with complex content. Then, we use the generative adversarial network model as a data augmentation method and generate high-resolution images. We make the masks of gestures in the new dataset and use the mask R-CNN algorithm for gesture recognition and gesture segmentation. The experimental results show that the generating data improves the accuracy of several object recognition algorithms but cannot completely replace the original data and the mean average precision of gesture recognition is 0.85. The visualization shows the validity and weakness of segmentation.
Databáze: OpenAIRE