Deep Learning and Large Language Models for Offline Recognition of Latin Handwritten Kazakh Text

Abstract

This article investigates offline recognition of handwritten Kazakh text in the Latin script using a convolutional recurrent neural network. The relevance of the study is determined by the transition of the Kazakh language to the Latin alphabet and the need to automate the processing of handwritten documents. The proposed model consists of a convolutional neural network feature extractor, two bidirectional long short-term memory layers, and a Connectionist Temporal Classification decoder. The convolutional layers extract visual features from word images, the bidirectional recurrent layers model the sequential relationships between characters, and CTC enables end-to-end training without explicit character-level segmentation. A specialized dataset named KazEsim, containing 20,000 handwritten Kazakh name images, was created and divided into writer-independent training, validation, and test subsets. Experimental results showed a character accuracy rate of 96.5% and a word accuracy rate of 92.3%. Compared with a conventional CNN baseline, the proposed CRNN model improved character accuracy by 6.1 percentage points and word accuracy by 9.2 percentage points. The proposed model also outperformed the fine-tuned TrOCR-small comparative baseline while requiring fewer parameters and lower inference latency. These findings demonstrate the effectiveness of CNN–BiLSTM–CTC sequence modeling for offline recognition of handwritten Kazakh words in the Latin script.