The Media Bias Detector is introduced, a scalable computational framework that integrates large language models (LLMs) with near-real-time news scraping to extract structured annotations, including political lean, tone, topics, article type, and major events, across hundreds of articles per day.
Abstract
News organizations introduce bias into their coverage via the choices they make about which topics to cover (or ignore) and how to frame the issues they do decide to cover. Here, we introduce the Media Bias Detector, a scalable computational framework that integrates large language models (LLMs) with near-real-time news scraping to extract structured annotations, including political lean, tone, topics, article type, and major events, across hundreds of articles per day. We quantify these dimensions of coverage at the sentence level, the article level, and the publisher level, expanding the ways in which researchers can analyze selection and framing bias in the modern news landscape. We also release an interactive web platform for convenient exploration of these data and an accompanying dataset covering more than 140,000 articles published in 2024 by 10 prominent publishers. Last, we present some results derived from this dataset that illustrate how the MBD can uncover correlates of bias in news coverage.
The quality, relevance, and annotation guidelines of the data have a key influence on the accuracy and effectiveness of models that could perform automatic bias detection.
Pooja B. Bhise, S. Govilkar, Sheetal B. Gawande· International journal of com...· 0 citations
A scalable and unsupervised natural language processing (NLP) framework to measure sentiment changes and framing patterns in global climate discussions across major news outlets and reveals regional sentiment differences, outlet-level framing patterns, thematic trends, and notable shifts in response to major climate ev...
Aditya Vasudev K, Srisakthi Saravanan, A. Vinay· Frontiers in Climate· 0 citations
To combat query drift resulting from the large volume of text, either in the source news article itself or in social media utterances explicitly linked to it, a graph-based term selection method is shown to help improve both effectiveness andency.
News coverage of major world events is shaped not only by what is reported, but also by how events are framed through text, images and their combination. At the same time, Large Language Models (LLMs), including multimodal LLMs, are increasingly used as scalable instruments for analysing framing, sentiment, ideological...
This work formalizes news-corpus poisoning of probabilistic forecasters, a threat model distinct from prior RAG poisoning, which targets factual answers or opinion polarity rather than calibrated probabilities.
We present a novel application of embedding-based dynamic topic modeling techniques to detect and quantify topic drift at the comment level in a massive corpus. By leveraging pretrained language models to generate contextualized semantic embeddings for short text, we analyzed 12.7 billion Reddit comments spanning 2006...
Steven Morse, Daniel Runfola, Trenton W. Ford· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.