Using Deep Learning Technology to Realize the Automatic Control Program of Robot Arm Based on Hand Gesture Recognition

Autor:	Li-Wu Huang, Shang-Liang Chen
Rok vydání:	2021
Předmět:	Automatic control Mechanics of Materials Computer science Gesture recognition business.industry Mechanical Engineering Deep learning Computer vision Artificial intelligence Electrical and Electronic Engineering business Robotic arm Civil and Structural Engineering
Zdroj:	International Journal of Engineering and Technology Innovation. 11:241-250
ISSN:	2226-809X 2223-5329
DOI:	10.46604/ijeti.2021.7342
Popis:	In this study, the robot arm control, computer vision, and deep learning technologies are combined to realize an automatic control program. There are three functional modules in this program, i.e., the hand gesture recognition module, the robot arm control module, and the communication module. The hand gesture recognition module records the user’s hand gesture images to recognize the gestures’ features using the YOLOv4 algorithm. The recognition results are transmitted to the robot arm control module by the communication module. Finally, the received hand gesture commands are analyzed and executed by the robot arm control module. With the proposed program, engineers can interact with the robot arm through hand gestures, teach the robot arm to record the trajectory by simple hand movements, and call different scripts to satisfy robot motion requirements in the actual production environment.
Databáze:	OpenAIRE
Externí odkaz:	https://explore.openaire.eu/search/publication?articleId=doi_________::d834da8f534d034ba65d7f75fd4df730 https://doi.org/10.46604/ijeti.2021.7342 Zobrazit plný text záznamu