Skip to content
Open access

The Media Bias Detector: A framework for annotating and analyzing the news

Sep 2026 · Science Advances · Vol 12 · 0 citations · 77 references
Medicine

TL;DR

The Media Bias Detector is introduced, a scalable computational framework that integrates large language models (LLMs) with near-real-time news scraping to extract structured annotations, including political lean, tone, topics, article type, and major events, across hundreds of articles per day.

Abstract

News organizations introduce bias into their coverage via the choices they make about which topics to cover (or ignore) and how to frame the issues they do decide to cover. Here, we introduce the Media Bias Detector, a scalable computational framework that integrates large language models (LLMs) with near-real-time news scraping to extract structured annotations, including political lean, tone, topics, article type, and major events, across hundreds of articles per day. We quantify these dimensions of coverage at the sentence level, the article level, and the publisher level, expanding the ways in which researchers can analyze selection and framing bias in the modern news landscape. We also release an interactive web platform for convenient exploration of these data and an accompanying dataset covering more than 140,000 articles published in 2024 by 10 prominent publishers. Last, we present some results derived from this dataset that illustrate how the MBD can uncover correlates of bias in news coverage.

Read PDF

Similar papers

Review Open access Aug 2026

A Comprehensive Survey of News Bias Detection Datasets

The quality, relevance, and annotation guidelines of the data have a key influence on the accuracy and effectiveness of models that could perform automatic bias detection.

Pooja B. Bhise, S. Govilkar, Sheetal B. Gawande · 0 citations
Open access Sep 2026

Unsupervised NLP for quantifying sentiment deviation and framing in global climate discourse

A scalable and unsupervised natural language processing (NLP) framework to measure sentiment changes and framing patterns in global climate discussions across major news outlets and reveals regional sentiment differences, outlet-level framing patterns, thematic trends, and notable shifts in response to major climate ev...

Aditya Vasudev K, Srisakthi Saravanan, A. Vinay · 0 citations

3 Linking Online News and Social Media

To combat query drift resulting from the large volume of text, either in the source news article itself or in social media utterances explicitly linked to it, a graph-based term selection method is shown to help improve both effectiveness andency.

Unknown authors · 0 citations
Preprint Sep 2026

Who Judges the Frame? Auditing Multimodal LLM Judges for News Framing Across Event-Level Perspectives

News coverage of major world events is shaped not only by what is reported, but also by how events are framed through text, images and their combination. At the same time, Large Language Models (LLMs), including multimodal LLMs, are increasingly used as scalable instruments for analysing framing, sentiment, ideological...

Antonela Tommasel, Markus Schedl · 0 citations
Preprint Aug 2026

Comment-level Topic Drift Analysis in the Reddit Corpus

We present a novel application of embedding-based dynamic topic modeling techniques to detect and quantify topic drift at the comment level in a massive corpus. By leveraging pretrained language models to generate contextualized semantic embeddings for short text, we analyzed 12.7 billion Reddit comments spanning 2006...

Steven Morse, Daniel Runfola, Trenton W. Ford · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.