A Real-Time Hand Gesture Recognition System and its Application in Manipulating Household Appliances
| Autor: | Sung-yang Tsai, 蔡嵩陽 |
|---|---|
| Rok vydání: | 2011 |
| Druh dokumentu: | 學位論文 ; thesis |
| Popis: | 99 Recently, in the field of human computer interaction, hand gesture recognition researches have attracted many researchers from many different kinds of domains. The applications of hand gesture recognition vary from game control, robot arm operation, robot control, household appliance control, etc. Due to its convenience and intuitiveness, the hand-gesture-based controller has the potential of replacing a traditional remote control. This thesis presents a real-time image-based hand gesture recognition system. The proposed hand gesture recognition system is applied in household appliances control. The implementation of the proposed hand gesture recognition system is as follows. First of all, we locate the arm region from an image captured by a web camera via several image preprocessing operators and the use of skin information. We then use an arm-cutting algorithm to cut out the hand from the arm region. The hand shape is then represented by two kinds of features. The first kind of features is the so-called “distance curve” or “signature” which is a 1-D functional representation of the hand shape. It is formed by plotting the distance from every point on the hand boundary to its center of mass. The second kind of features is the frequency domain parameters of the distance curve transformed by FFT. Finally, the KNN incorporated with a decision tree is adopted to recognize 11 hand gestures based on these two kinds of features. A combination of 11 hand gestures and 2 waving motions will be used as commands to control several household appliances. The recognized commands are wirelessly transmitted to an environment control unit which can translate the received commands to infrared signals and the signals are then pointed to the household appliance to be controlled. Our system has been successfully tested with a TV, a radio and a fan. Eight subjects were invited to test the proposed hand gesture recognition system. In the experiments, users can either use their right hands or left hands without the need of wearing any accessory such as a hand glove. In addition, there is no restriction on wearing long or short sleeves. The first experiment analyzed the successful recognition rate of the 11 hand gestures and the recognition result came out with 91% successful rate. In second experiment, we test the time performance of the proposed system by testing some scenarios for controlling three household appliances. The performance was tested based on the time interval which a subject took to finish a sequence of commands according to each designed scenario. The results showed that the time performance was acceptable. To make our system small and portable, we implement the proposed system on a DSP platform. The DSP-based system could achieve as similar performance as the PC-based system under an appropriate lighting condition. |
| Databáze: | Networked Digital Library of Theses & Dissertations |
| Externí odkaz: |
|