Skip to content

Scientific Claim-Source Retrieval Revisited: A Comparative Study of Style Transfer and Re-Ranking

Jul 2026 · arXiv.org · Vol abs/2607.15875 · 0 citations · 32 references
Computer Science

TL;DR

This work presents a comparative study of scientific claim-source retrieval on the CheckThat!

Abstract

Scientific claims shared on social media are often difficult to verify and may contribute to the spread of misinformation. To address this challenge, automated fact verification systems require scientific claim-source retrieval, the task of identifying the source publication underlying a given claim. However, claims often differ substantially from their source publications in language, style, and specificity, making retrieval challenging. We present a comparative study of scientific claim-source retrieval on the CheckThat! 2026 benchmark across sparse and dense retrieval models. Our results show that translating claims into English outperforms both original and bilingual claim representations, while incorporating publication metadata provides additional retrieval gains by capturing indirect source references. In addition, we analyze four style transfer approaches and find that they improve retrieval performance for most models, although the optimal style depends on the underlying retrieval objective. Finally, we investigate similarity- and signal-based re-ranking approaches, introducing three novel re-ranking models based on attribution, entity overlap, and verification-based reasoning. Verification-based re-ranking yields additional gains beyond semantic similarity and achieves the best overall performance with an MRR@5 of 0.758.

View source

Similar papers

Review Aug 2026

Can Retrievers Find the Same Paper from Different Aspects? A Multi-Aspect Full-Paper Scientific Retrieval Benchmark

An expert-validated benchmark for multi-aspect, full-paper retrieval that evaluates whether retrievers can consistently recover the same paper from queries targeting its motivation, method, and experimental findings, and proposes MAPLE-Synth, a retrieval-based in-context learning pipeline that leverages OpenReview disc...

Yiyang Wei, Fang Guo, Qiji Zhou et al. · 0 citations
Open access Sep 2026

A Ranking Framework of Scientific Publications Using Temporal and Lexical Relevance and Citation Behavior

The results show that combining temporal, lexical relevance, and self-citation signals produces publication rankings that consistently differ from traditional citation- and recency-based methods while providing interpretable approach for examining multiple aspects of scientific publications.

A. Khatoon, Tehmina Amjad · 0 citations
Book Open access Sep 2026

Beyond the Blue Link: Empirical Evaluation of Generative Engine Optimization in Stochastic Retrieval Systems

This paper studies how authored hypertext structure affects machine-mediated attribution in generative retrieval systems. We formalize this as Answer Engine Optimization (AEO) and introduce Generative Share of Voice (gSoV), a probabilistic visibility metric for stochastic retrieval. Our core result comes from controlle...

Manan Mehta, Raghav Sharma, Vineeth Kalluru et al. · 0 citations
Review Aug 2026

Structure-aware retrieval methods for web table fragments in question-answering systems: a scientific analytical review

It is shown that dense and structure-aware whole-table methods dominate, whereas scalable retrieval of rows, cells, subtables, and multi-table evidence remains insufficiently developed, and further research should focus on multivector methods that preserve local table structure while maintaining acceptable computationa...

A. Khaled, Yuriy E. Gapanyuk, Gennady I. Afanasyev · 0 citations
Preprint Aug 2026

Understanding before verifying: Claim normalization for automated citation verification

Citation accuracy has been studied for decades because of its importance to research reliability. Content-level citation verification assesses the reliability of scholarly claims. Recent work adopts a two-stage retrieval-classification framework inherited from fact-checking. However, this design overlooks the complexit...

Yi-Fan He, Meng-Jia Wu, Si-Ming Deng et al. · 0 citations
Preprint Aug 2026

SciRet: A Compute-Aware Empirical Study of Retrieval and Reranking for Scientific RAG

We introduce SciRet, a compute-aware empirical study of retrieval-augmented generation for scientific question answering over CORD-19. Rather than proposing a new model, we evaluate a fixed scientific RAG pipeline across three corpus scales: 1,034 chunks (1K papers), 5,160 chunks (5K papers), and 15,480 chunks (15K pap...

Kaysarul Anas Apurba, Mahade Hasan, Rofiqul Alam Shehab et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.