Font Generation and Keypoint Ranking for Stroke Order of Chinese Characters by Deep Neural Networks

Autor: Tzu-Ting Huang, Hao-Ting Li, Ming-Xiu Jiang, Chen-Kuo Chiang
Rok vydání: 2021
Předmět:
Zdroj: SN Computer Science. 2
ISSN: 2661-8907
2662-995X
DOI: 10.1007/s42979-021-00717-2
Popis: Determining the stroke order of a Chinese character image is challenging, because there is no explicit representation for image to sequence learning. This paper investigates the approach in Chinese character generation given just a few image samples of a specific font. Then, keypoint extraction for stroke decomposition and learning to rank method are proposed for obtaining stroke order. Since the same character can appear in multiple fonts, different font of Chinese character has distinct keypoints. Thus, it brings difficulties in acquiring stroke order. Generative Adversarial Networks (GANs) is introduced to generate lots of Chinese character images with different fonts for training and testing the proposed method. The keypoint ranking model based on stroke extraction combining font transfer based on GANs is proposed to complete this task. Compared to other methods, our method can be accomplished without human annotation as initial hints in prediction stage. The experimental results demonstrate the effectiveness of our method that achieved 0.9667 NDCG in average and up to 29.53% samples are higher than 0.98 NDCG.
Databáze: OpenAIRE