It is demonstrated that coupling LLM-generated annotations with ordered label correction offers an effective means of addressing the joint effects of missing and noisy labels, providing a promising approach to financial text classification when expert annotations are scarce.
Abstract
Multi-label classification of financial news is frequently affected by incomplete and noisy annotations, while obtaining expert-curated labels at scale is prohibitively expensive. This study proposes a weakly supervised classification framework that combines large language model (LLM) zero-shot annotation with a serial label-correction strategy. The framework first uses an LLM to generate initial weak labels and then refines them through a two-stage Correct→Clean procedure that recovers missing labels via centrality-weighted graph propagation before suppressing label noise. Systematic experiments on a financial subset of Reuters-21578 show that, under an extreme mixed-corruption setting with 80% missing labels and 15% noise labels, Correct→Clean increases the Micro-F1 from 0 to 0.6748. In an end-to-end evaluation, the proposed framework achieves a Micro-F1 of 0.8882 with reduced-dimensional features, recovering 88.69% of the performance gap to fully supervised learning. Additional experiments on the RCV1 Topics and AAPD datasets confirm that the advantage of Correct→Clean is consistently reproduced across domains and dataset sizes. These findings demonstrate that coupling LLM-generated annotations with ordered label correction offers an effective means of addressing the joint effects of missing and noisy labels, providing a promising approach to financial text classification when expert annotations are scarce.
This paper proposes a novel Partial label-based Self-training framework (PaSta) that leverages partial label learning technique to overcome the limitations of existing methods and designs a partial label-based classification model with two well-crafted loss functions to guide the model learning at both label and repres...
Yu-Jing Liu, Yi-Xin Liu, Yu Zheng et al.· 0 citations
This work proposes distilling the model into a probabilistic classifier, enabling lightweight deployment without repeated LLM calls, and demonstrates that LSR improves macro-F1 scores by an average of 7.0% compared to standard zero-shot classification baselines.
Nathan Vandemoortele, Bram Steenwinckel, F. Ongenae et al.· Discover Computing· 0 citations
Large language models are increasingly used to annotate datasets for training smaller, task-specialized models such as named entity recognition. While this method yields effective models, it assumes that the synthetic dataset is correctly annotated. In this work, we find that (i) current fine-tuning processes simply ig...
Elena Merdjanovska, Jonas Golde, Alan Akbik· 0 citations
This paper proposes an alignment-aware multi-granularity tagging framework. First, this method uses a cross-lingual pre-trained model to encode source and target language contexts jointly while explicitly modeling-level bilingual correspondences via a learnable soft alignment layer. Second, a gated local enhancement mo...
Bi-Juan Wang, Lingli Zhu, Hongli Wen· International Journal of Inf...· 0 citations
This work proposes a class coverage-aware noise correction method for crowdsourced labels via elimination-based inference (COVER-EL), and provides a probably approximately correct (PAC)-style bound that gives a high-probability guarantee on the overall error after correction.
Bi Wang, Yan-Ting Yang, Xuelian Li· IEEE Transactions on Neural...· 0 citations
Semi-supervised semantic segmentation has long turned on one question, which pseudo-labels to trust, and a generation of selection rules, dynamic thresholds, per-class curricula, soft confidence weights, answered it for the noisy, under-confident ResNet teachers of their day. Self-supervised foundation encoders change...
Ebenezer Tarubinga· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.