Skip to content

CoVer: Conflict-Aware Claim Verification

Sep 2026 · 0 citations · 49 references
Computer Science

Abstract

Social media fact-checking has long been challenged by evidence-level and aggregation-level conflicts, where erroneous evidence mimics authoritative news sources. To capture this challenge and support conflict verification tasks, we present ContraNote, a large-scale real-world dataset curated from X's Community Notes system. It includes 33,686 posts for evaluating evidence-level conflict resolution, and 54,474 instances for evaluating aggregation-level prioritization. Additionally, we propose CoVer, a factual adjudication framework with three-stage pipelines: evidence schema normalization, factual consensus and support verification. This prioritizes evidence over noise to prevent it from compromising the final verdict. Technical evaluations show that CoVer achieves strong performance compared with state-of-the-art baselines across ContraNote (86.0% Acc., 68.0% mac. F1, 64.5 bal. Acc. on Conflict; and 88.5% Acc., 88.5 mac. F1 and 89.2 bal. Acc. on Prioritization), CONFACT-HumC (88.4% Acc.) and CONFACT-ModC (89.4% Acc.).

View source

Similar papers

Review Open access Sep 2026

Beyond Reported Accuracy: A Verifiability-Focused, Multi-Axis Review of Content and Context Based Fake News Detection

This verifiability-focused review analyzes an enumerated, non-exhaustive corpus of 45 content- and context-based detection studies in which each reported headline metric is traced to its primary source and confirmed against it wherever the source is accessible, and derives a dependency-ordered research agenda and trans...

Long Dinh Tuan, L. N. An, Duong Dinh Thai · 0 citations
Preprint Aug 2026

EvoTrustRAG: Evolution-Aware Conflict Attribution and Evidence Handling for Reliable Retrieval-Augmented Generation

Retrieval-Augmented Generation (RAG) improves the factuality of large language models with external knowledge, yet conflicting evidence remains a fundamental challenge in dynamic and adversarial environments. Existing approaches often treat conflicts as static inconsistencies and select more reliable knowledge, overloo...

Xiao-Rui Nie, Hong-Wei Li, Shenghao Wu et al. · 1 citation
Open access 2026

EviGraphRAG: Constraint-Verified Retrieval-Augmented Question Answering over Event Knowledge Graphs

EviGraphRAG is proposed, a ranker-agnostic reliability layer that separates candidate ranking from exact verification and explicit abstention, and exact conjunction over represented event constraints and linked source-record connectivity can improve selective reliability, while parser quality and candidate retrieval re...

Yu-Teng Sun, Yang Su, Xu-An Wang · 0 citations
Preprint Aug 2026

How Robust Are Automated Fact-Checking Systems? A Cross-Benchmark Evaluation

On ClimateCheck claim-only and fine-tuned models outperform zero-shot LLM and top-performing AVeriTeC 2025 systems, highlighting that noisy evidence can degrade veracity prediction and replacing retrieved evidence with gold annotations improves veracity accuracy, confirming retrieval remains primary bottleneck.

Aida Usmanova, Z. Iklassov, Markus Leippold et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Multi-Channel Mitigation of Source-Trust Shortcuts in Fact-Checking RL Agents

Retrieval-augmented fact-checkers often receive a reliability label, such as HIGH or LOW trust, for each evidence source. These labels should adjust the model's confidence and its decision to search for more evidence, while the verdict should follow the evidence content. We introduce TrustSwap, a counterfactual test th...

Jian-Chang Su, Yi-Wei Yang, Wei Zhang · 0 citations
#artificial intelligence Preprint Aug 2026

Validity-Aware Jailbreak Evaluation for Large Language Models

This work proposes Sequential Epistemic and Action-Level Validation (SEAV), a verification-centric jailbreak evaluation framework that decomposes responses into ordered steps and evaluates both validity and correctness, and shows that enforcing correctness substantially reshapes measured robustness.

Qilong Wu, Sahil Wadhwa, Pranab Mohanty et al. · 0 citations

Related blog posts

Hugging Face Blog Oct 20, 2026

MPS in PyTorch 2.15

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.