This work presents a comparative study of scientific claim-source retrieval on the CheckThat!
Abstract
Scientific claims shared on social media are often difficult to verify and may contribute to the spread of misinformation. To address this challenge, automated fact verification systems require scientific claim-source retrieval, the task of identifying the source publication underlying a given claim. However, claims often differ substantially from their source publications in language, style, and specificity, making retrieval challenging. We present a comparative study of scientific claim-source retrieval on the CheckThat! 2026 benchmark across sparse and dense retrieval models. Our results show that translating claims into English outperforms both original and bilingual claim representations, while incorporating publication metadata provides additional retrieval gains by capturing indirect source references. In addition, we analyze four style transfer approaches and find that they improve retrieval performance for most models, although the optimal style depends on the underlying retrieval objective. Finally, we investigate similarity- and signal-based re-ranking approaches, introducing three novel re-ranking models based on attribution, entity overlap, and verification-based reasoning. Verification-based re-ranking yields additional gains beyond semantic similarity and achieves the best overall performance with an MRR@5 of 0.758.
An expert-validated benchmark for multi-aspect, full-paper retrieval that evaluates whether retrievers can consistently recover the same paper from queries targeting its motivation, method, and experimental findings, and proposes MAPLE-Synth, a retrieval-based in-context learning pipeline that leverages OpenReview disc...
Yiyang Wei, Fang Guo, Qiji Zhou et al.· 0 citations
The results show that combining temporal, lexical relevance, and self-citation signals produces publication rankings that consistently differ from traditional citation- and recency-based methods while providing interpretable approach for examining multiple aspects of scientific publications.
This paper studies how authored hypertext structure affects machine-mediated attribution in generative retrieval systems. We formalize this as Answer Engine Optimization (AEO) and introduce Generative Share of Voice (gSoV), a probabilistic visibility metric for stochastic retrieval. Our core result comes from controlle...
Manan Mehta, Raghav Sharma, Vineeth Kalluru et al.· Proceedings of the 37th ACM...· 0 citations
It is shown that dense and structure-aware whole-table methods dominate, whereas scalable retrieval of rows, cells, subtables, and multi-table evidence remains insufficiently developed, and further research should focus on multivector methods that preserve local table structure while maintaining acceptable computationa...
A. Khaled, Yuriy E. Gapanyuk, Gennady I. Afanasyev· Computational nanotechnology· 0 citations
Citation accuracy has been studied for decades because of its importance to research reliability. Content-level citation verification assesses the reliability of scholarly claims. Recent work adopts a two-stage retrieval-classification framework inherited from fact-checking. However, this design overlooks the complexit...
Yi-Fan He, Meng-Jia Wu, Si-Ming Deng et al.· 0 citations
We introduce SciRet, a compute-aware empirical study of retrieval-augmented generation for scientific question answering over CORD-19. Rather than proposing a new model, we evaluate a fixed scientific RAG pipeline across three corpus scales: 1,034 chunks (1K papers), 5,160 chunks (5K papers), and 15,480 chunks (15K pap...
Kaysarul Anas Apurba, Mahade Hasan, Rofiqul Alam Shehab et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.