In-Air Continuous Writing Using UWB Impulse Radar Sensors
Autor: | Sung Ho Cho, Seong Kyu Leem, Faheem Khan |
---|---|
Jazyk: | angličtina |
Rok vydání: | 2020 |
Předmět: |
alphabet writing
General Computer Science business.industry Computer science gesture recognition in-air writing General Engineering impulse radio ultra-wideband Convolutional neural network law.invention Extended Kalman filter Character (mathematics) law Position (vector) Gesture recognition pattern analysis Trajectory General Materials Science Computer vision Artificial intelligence lcsh:Electrical engineering. Electronics. Nuclear engineering Radar business lcsh:TK1-9971 Energy (signal processing) |
Zdroj: | IEEE Access, Vol 8, Pp 99302-99311 (2020) |
ISSN: | 2169-3536 |
Popis: | We developed an impulse radio ultra-wideband (IR-UWB) radar-based system that can recognize alphanumeric characters in midair without the need for any handheld device. The hardware consists of four IR-UWB radar sensors set up with a rectangular geometry. Writing a single character in midair results in artifacts that make some characters look similar on a position trajectory-based (x, y) plane, which makes them difficult to classify. Thus, we developed an algorithm that transforms 2D coordinate image data into trigonometric ratios (i.e., tangents) and plots them against the time axis to obtain unique images for training a convolutional neural network. An extended Kalman filter is used to obtain the 2D trajectories of hand motions. To evaluate our proposed method, we first applied it to characters that may be written in midair very simply without creating artifacts and compared its performance with that of a state-of-the-art digit classification algorithm. Then, we considered combining characters written midair with and without artifacts. After the individual character recognition, we combined the characters into words. We defined a specific marker based on an energy threshold to detect the start and end of a character for midair writing. The energy level was found to change drastically when the hand is pulled in and out of the radar plane. The proposed method was found to outperform the current state of the art at character classification when artifacts are present in the images. |
Databáze: | OpenAIRE |
Externí odkaz: |