pp. 1187-1198
S&M2526 Research Paper of Special Issue https://doi.org/10.18494/SAM.2021.2991 Published in advance: January 25, 2021 Published: April 6, 2021 Robust Recognition of Chinese Text from Cellphone-acquired Low-quality Identity Card Images Using Convolutional Recurrent Neural Network [PDF] Jianmei Wang, Ruize Wu, and Shaoming Zhang (Received July 23, 2020; Accepted January 6, 2021) Keywords: Chinese text recognition, synthetic data, convolutional recurrent neural network, conditional generative adversarial network, DenseNet
An automatic reading of text from an identity (ID) card image has a wide range of social uses. In this paper, we propose a novel method for Chinese text recognition from ID card images taken by cellphone cameras. The paper has two main contributions: (1) A synthetic data engine based on a conditional adversarial generative network is designed to generate million-level synthetic ID card text line images, which can not only retain the inherent template pattern of ID card images but also preserve the diversity of synthetic data. (2) An improved convolutional recurrent neural network (CRNN) is presented to increase Chinese text recognition accuracy, in which DenseNet substitutes VGGNet architecture to extract more sophisticated spatial features. The proposed method is evaluated with more than 7000 real ID card text line images. The experimental results demonstrate that the improved CRNN model trained only on the synthetic dataset can increase the recognition accuracy of Chinese text in cellphone-acquired low-quality images. Specifically, compared with the original CRNN, the average character recognition accuracy (CRA) is increased from 96.87 to 98.57% and the line recognition accuracy (LRA) is increased from 65.92 to 90.10%.
Corresponding author: Shaoming ZhangThis work is licensed under a Creative Commons Attribution 4.0 International License. Cite this article Jianmei Wang, Ruize Wu, and Shaoming Zhang, Robust Recognition of Chinese Text from Cellphone-acquired Low-quality Identity Card Images Using Convolutional Recurrent Neural Network, Sens. Mater., Vol. 33, No. 4, 2021, p. 1187-1198. |