Skip to content
Open access

Zero-Shot Annotation by Large Language Model with Serial Correction of Mixed Label Corruption for Weakly Supervised Financial News Classification

Sep 2026 · Information · 0 citations

TL;DR

It is demonstrated that coupling LLM-generated annotations with ordered label correction offers an effective means of addressing the joint effects of missing and noisy labels, providing a promising approach to financial text classification when expert annotations are scarce.

Abstract

Multi-label classification of financial news is frequently affected by incomplete and noisy annotations, while obtaining expert-curated labels at scale is prohibitively expensive. This study proposes a weakly supervised classification framework that combines large language model (LLM) zero-shot annotation with a serial label-correction strategy. The framework first uses an LLM to generate initial weak labels and then refines them through a two-stage Correct→Clean procedure that recovers missing labels via centrality-weighted graph propagation before suppressing label noise. Systematic experiments on a financial subset of Reuters-21578 show that, under an extreme mixed-corruption setting with 80% missing labels and 15% noise labels, Correct→Clean increases the Micro-F1 from 0 to 0.6748. In an end-to-end evaluation, the proposed framework achieves a Micro-F1 of 0.8882 with reduced-dimensional features, recovering 88.69% of the performance gap to fully supervised learning. Additional experiments on the RCV1 Topics and AAPD datasets confirm that the advantage of Correct→Clean is consistently reproduced across domains and dataset sizes. These findings demonstrate that coupling LLM-generated annotations with ordered label correction offers an effective means of addressing the joint effects of missing and noisy labels, providing a promising approach to financial text classification when expert annotations are scarce.

Read PDF

Similar papers

Preprint Aug 2026

PaSta: Noisy Node Classification with Partial Label Learning

This paper proposes a novel Partial label-based Self-training framework (PaSta) that leverages partial label learning technique to overcome the limitations of existing methods and designs a partial label-based classification model with two well-crafted loss functions to guide the model learning at both label and repres...

Yu-Jing Liu, Yi-Xin Liu, Yu Zheng et al. · 0 citations
Open access Aug 2026

Label space reduction for transductive zero-shot classification with large language models

This work proposes distilling the model into a probabilistic classifier, enabling lightweight deployment without repeated LLM calls, and demonstrates that LSR improves macro-F1 scores by an average of 7.0% compared to standard zero-shot classification baselines.

Nathan Vandemoortele, Bram Steenwinckel, F. Ongenae et al. · 0 citations
#natural language process... Preprint Aug 2026

Error-Type-Aware Loss Reweighting for Robust Named Entity Recognition with Noisy LLM Labels

Large language models are increasingly used to annotate datasets for training smaller, task-specialized models such as named entity recognition. While this method yields effective models, it assumes that the synthetic dataset is correctly annotated. In this work, we find that (i) current fine-tuning processes simply ig...

Elena Merdjanovska, Jonas Golde, Alan Akbik · 0 citations
Open access Aug 2026

Improved Sequence Labeling Algorithms and Their Applications for Translation Error Detection

This paper proposes an alignment-aware multi-granularity tagging framework. First, this method uses a cross-lingual pre-trained model to encode source and target language contexts jointly while explicitly modeling-level bilingual correspondences via a learnable soft alignment layer. Second, a gated local enhancement mo...

Bi-Juan Wang, Lingli Zhu, Hongli Wen · 0 citations
Aug 2026

COVER-EL: Class cOVERage-Aware Noise Correction for Crowdsourced Labels via Elimination-Based Inference.

This work proposes a class coverage-aware noise correction method for crowdsourced labels via elimination-based inference (COVER-EL), and provides a probably approximately correct (PAC)-style bound that gives a high-probability guarantee on the overall error after correction.

Bi Wang, Yan-Ting Yang, Xuelian Li · 0 citations
Preprint Aug 2026

CW-BASS v2: Saturation-Aware Pseudo-Label Selection for Semi-Supervised Segmentation under Foundation-Model Teachers

Semi-supervised semantic segmentation has long turned on one question, which pseudo-labels to trust, and a generation of selection rules, dynamic thresholds, per-class curricula, soft confidence weights, answered it for the noisy, under-confident ResNet teachers of their day. Self-supervised foundation encoders change...

Ebenezer Tarubinga · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.