SmartSO: Chinese Character and Stroke Order Recognition With Smartwatch
| Autor: | Qian Zhang, Hongliang Bi, Zhaoyuan Fu, Zeyu Li, Yanjiao Chen, Jian Zhang, Yunzhe Li |
|---|---|
| Rok vydání: | 2021 |
| Předmět: |
Computer Networks and Communications
Character (computing) Computer science Speech recognition Stroke order ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION 020206 networking & telecommunications 02 engineering and technology Motion (physics) Smartwatch ComputingMethodologies_PATTERNRECOGNITION Handwriting Robustness (computer science) Handwriting recognition 0202 electrical engineering electronic engineering information engineering Electrical and Electronic Engineering Chinese characters Software ComputingMethodologies_COMPUTERGRAPHICS |
| Zdroj: | IEEE Transactions on Mobile Computing. 20:2490-2504 |
| ISSN: | 2161-9875 1536-1233 |
| DOI: | 10.1109/tmc.2020.2980842 |
| Popis: | Following the correct stroke order while writing Chinese characters composed of strokes plays an important role in handwriting efficiency and quality, especially for early education. Most existing systems use image processing techniques for character and stroke order recognition, which is sensitive to lighting conditions. In this paper, we present the design, implementation and evaluation of SmartSO , which utilizes the inertial sensors of an off-the-shelf smartwatch for Chinese character and stroke order recognition. SmartSo first identifies the Chinese character written by the user, based on which SmartSo decides whether the stroke order is written correctly to help improve users' writing behavior. The biggest challenge for stroke order recognition is that some Chinese characters have repeated strokes (strokes of the same type), e.g., ‘本’ with two same horizontal strokes, and it is challenging to differentiate the writing order of such strokes given only the detected stroke composition (number and type of strokes). To mitigate this problem, we further analyze the hand movement between two adjacent strokes (referred to as direction motion) and propose a novel algorithm to recognize stroke order based on direction motion information. Finally, we build a fully functional prototype of SmartSO , and extensive experiments confirm its effectiveness and robustness. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|