Skip to content

Category

natural language processing

3,231 papers

#artificial intelligence Preprint Aug 2026

When Do LLMs Actually Help? Evaluating LLMs as Data Quality Annotators

Testing an LLM on two e-commerce data quality tasks, entity matching and brand mislabeling, against rule based baselines and human verified ground truth, under both zero-shot and few-shot prompting suggests that the value of using an LLM over traditional methods depends heavily on the task.

Praphulla Lal Shrestha · 0 citations
#artificial intelligence Preprint Aug 2026

The Deontic Gap: Large Language Models and the Modal Language of Obligation

Modal auxiliaries such as must, should, and have to mark necessity and obligation within the contexts of speaker authority and interpersonal stance. We examine whether large language models (LLMs) reproduce contemporary human patterns of deontic modal usage. Across three primary corpora, an external benchmark, two controlled replications, and a naturalistic eleven-model replication, AI-generated text consistently underuses positive deontic modals (must, should, have to, had to) relative to contemporary humans. Historical comparison with the Google Books Ngram corpus (1920-2022), used as a heuristic calibration against the published-prose record, shows that AI modal frequencies fall within the range of formal published English, whereas contemporary human modal rates in informal digital contexts often exceed twentieth-century book baselines. Phrase-level decomposition shows that the AI-human modal gap is concentrated in constructions central to interpersonal stance (should, have to, had to), while AI matches or exceeds humans on need to in instructional and question-answering contexts but not in persuasive student writing, indicating that the modal profile is genre-conditional. The findings suggest that LLM modal usage reflects the formal written resources on which these models were trained, while underusing the modal constructions through which contemporary human writers mark immediate, interpersonal obligation.

D. Hart, Sarah Allred, Joseph Abbas et al. · 0 citations
#artificial intelligence Review Aug 2026

Language Models for Portuguese: A Systematic Mapping Study

A systematic mapping study of language models developed for Portuguese, providing a comprehensive overview of the current state of the field and analyzing the evolution and relationships among these models through a phylogenetic perspective.

J. Silva, Carlos Caetano, H. Maia et al. · 0 citations
#artificial intelligence Preprint Jun 2026

Temporal Multi-Signal Fusion for Token-Level Hallucination Detection

This paper treats hallucination as a temporally extended span and detects it by sequence labeling: each token is scored from a 33-dimensional feature stream that fuses text statistics, Natural Language Inference entailment, and language model surprisal, with no access to model internals.

Igor Itkin · 0 citations
#artificial intelligence Preprint Jun 2026

Same Facts, Different Updates: Inference Setup Shapes LLM Behavior in Medical Allocation

This work studies a medical example in which a model is asked to assign resource-allocation probabilities to two people given brief clinical context, and then sees the same scenario with a single extra sentence containing contrasting patient information, showing the context-dependent effect of patient information in a sensitive medical use case.

Spencer J. Gibson, Tyler Crosse, Magnus Saebo et al. · 0 citations
#artificial intelligence Preprint Jun 2026

Institutional Prestige as Geographic Bias in Large Language Models: Evidence from Three Factorial Experiments with Bootstrap Confidence Intervals

We investigate whether large language models (LLMs) systematically discriminate in candidate evaluations based on applicant name ethnicity and/or institutional prestige and geographic location. Three factorial experiments are reported (4,320 API calls, four LLMs, five professional domains). Study 1 (3x4 design) finds a statistically robust institution-tier gradient of +0.297 points on a 10-point scale (95% bootstrap CI: +0.175 to +0.422), while name-origin effects are negligible and non-significant (95% CI crosses zero). Study 2 (2x2 Prestige x Country design) breaks the prestige-geography confound: the prestige effect (+0.185; 95% CI: +0.093 to +0.275) exceeds the country-of-origin effect (+0.126; 95% CI: +0.037 to +0.218) by 1.5x. Study 3 (2x2 Journal x Institution design) reveals that journal prestige (Nature vs. a peripheral open-access journal) dominates institutional prestige by 5.7x: journal effect +1.937 (95% CI: +1.811 to +2.062) vs. institution effect +0.341 (95% CI: +0.184 to +0.504). A"rescue effect"is confirmed: publishing in Nature compensates for low institutional prestige more strongly for candidates from the University of Guayaquil (+2.127) than from MIT (+1.745). Results are quantified using the Neutrosophic Bias Index NBI; the I component reveals elevated evaluation inconsistency for low-prestige profiles, an epistemic disadvantage not captured by mean-only metrics. Code and data: https://github.com/mleyvaz/geo-bias-llm

Maikel Leyva-Vázquez, F. Smarandache · 0 citations
#artificial intelligence Preprint Jun 2026

StocksTalk: A Voice-Enabled Conversational Agent for Structured Query Generation over Web Data

Experimental results show that retrieval grounding, constrained query generation, and interactive verification substantially improve constraint extraction accuracy, SQL executability, logical consistency, and multi-turn stability compared to baseline LLM-based approaches.

Akshat Parmar, Vikranth Udandarao, Abhay Shakya et al. · 0 citations
#artificial intelligence Preprint Jun 2026

DeepTCM1.0: A Multi-Expert AI Agent for Deciphering Mechanisms of Chinese Herbal Formulae Based on General Large Language Models

The DeepTCM1.0 framework was applied to the mechanistic interpretation of Guizhi Decoction from the dual perspectives of classical traditional Chinese medicine theory and modern scientific research, enabling systematic and interpretable mechanistic analysis of TCM compound formulas.

Wenxin Duan, Hanwei Wang, Zhong Peng et al. · 0 citations
#artificial intelligence Preprint Jun 2026

Computational Orientalism: Measuring Structural Discourse Bias in Large Language Models Using the Middle East Cultural Sensitivity Score (MECSS)

The Middle East Cultural Sensitivity Score (MECSS) is introduced, a framework that turns Said's seven Orientalist operations into measurable dimensions, and the term "Said-washing" for a specific failure: a model that disclaims generalization, then reproduces the structure it disclaimed.

Maha Shahid · 0 citations

Fractional Decay KV-Cache: Ownership-Aware Memory Management for Improved Inference Relevancy in Dialog Systems

Fractional Decay KV-Cache is proposed, a novel algorithm that maintains a dual-channel scoring mechanism for each cached KV pair: a cumulative attention channel that tracks aggregate importance (akin to H2O), and a recency-weighted relevance channel governed by temporal decay and reinforcement-inspired updates.

Sukanta Ganguly · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Aug 27, 2026

Looking beyond natural sequences

A new machine-learning framework aims to improve the success rate of computational protein design while moving away from results that reproduce sequences found in nature.

MIT News · Artificial Intelligence Aug 20, 2026

Paving the way for greener ammonia production

New MIT research could lead to better materials for a fossil-fuel-free process for making the chemical that's essential to fertilizer and other products.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.