Chinese historical documents preserve valuable cultural heritage, but many collections remain accessible only as scanned page images, preventing full-text retrieval, collation, and computational analysis. Optical character recognition (OCR) can bridge this gap, but accurate transcription remains challenging because historical documents often contain complex layouts, rare characters, and nontrivial reading orders. We propose TongGuOCR, a layout-aware and token-augmented multimodal large language model (MLLM) for OCR of Chinese historical documents. First, a Layout-Aware Preprocessing module constructs and refines locally coherent recognition blocks to preserve local context while reducing interference across regions. Second, a Token-Augmented Recognition module augments the transcription target at two complementary levels: character-level vocabulary expansion gives each rare glyph a direct one-token representation and shortens its decoding path, while line-to-line transition modeling injects discrete spatial displacement tokens that guide the decoder along complex reading paths without requiring precise coordinates. Experiments on two Chinese historical document OCR benchmarks show that TongGuOCR outperforms representative traditional task-specific OCR models, general-purpose MLLMs, and OCR-oriented MLLMs. On the more challenging M5HisDoc benchmark, TongGuOCR achieves 93.76 AR and reduces NED from 10.43 to 6.15 and RO-ED from 7.53 to 3.49 relative to the best competing score for each metric. An online demo is available at https://jzzh2004.github.io/TongGuOCR.
Zhongheng Zhou, Yi Sun, Huiguo He et al.· 0 citations
With the rapid development of social media and online interactive platforms, online public opinion has become a vital information source for public emotional expression, social risk perception, and decision support. However, public opinion texts are typically characterized by short length, obscure semantics, complex emotional expressions, and strong context dependence, making it difficult for traditional lexicon-based or shallow neural network methods to achieve stable and robust performance in sentiment discrimination tasks. To address these issues, this paper proposes BERT-BiLSTM-MHSA-Capsule (BBMC), hereafter referred to as BBMC, an online public opinion sentiment analysis model based on multi-level semantic feature fusion. The model first utilizes the pretrained language model BERT to extract dynamic semantic representations with context-aware capabilities; subsequently, a Bidirectional Long Short-Term Memory (BiLSTM) network is employed to model the bidirectional temporal dependencies within the texts, while a Multi-Head Self-Attention (MHSA) mechanism is introduced to achieve adaptive focusing on key emotional information. Building upon this, a three-layer cascaded capsule network is constructed to achieve structured modeling of high-order emotional attributes through vector neurons and dynamic routing mechanisms, effectively mitigating the loss of spatial feature information caused by traditional pooling and fully connected structures. Experimental results on a manually annotated online public opinion dataset show that BBMC achieves better performance than the evaluated baseline models in terms of accuracy, recall, and F1-score. These results indicate the empirical effectiveness of the proposed task-oriented feature-integration strategy and capsule-based classification head for online public opinion sentiment analysis.
Jian Zhao, Yi Sun, Dawei Xu et al.· Applied Sciences· 0 citations