Skip to content

Category

artificial intelligence

20,463 papers

#artificial intelligence Preprint Open access Nov 2026

Aligning Language Models with General Preferences: An Empirical Study of Direct Nash Optimization

Direct Nash Optimization (DNO) aligns a language model to a general preference function by approximating the Nash equilibrium of a two-player preference game. Its practical variant, DNO-Prct, iterates on-policy sampling, LLM-based rating of the samples together with a teacher's gold response, large-margin preference-pa...

Austin Tsai, Saurav Nanda, Ganapathy Parthasarathy et al. · 0 citations
#artificial intelligence Preprint Nov 2026

Suppressing Misaligned Behaviors in Language Models, Durably

Undesired model behaviors can emerge or re-emerge at any stage of training. Once observed, how effectively can we suppress them? To study this question, we first construct two model organisms--language models deliberately trained to exhibit a specific misalignment--that differ in what triggers the behavior. The narrow-...

Luxi He, Peng-Cheng Jiang, Jifan Zhang et al. · 0 citations
#artificial intelligence Preprint Open access Nov 2026

Weight-space programming for auditing clinical decision networks

Machine learning models in radiotherapy are commissioned by testing them on cases with known answers, which may not reveal a shortcut that the test cases share with the training data. Frontier language models have recently been reported to read and write the raw weights of small neural networks, an ability called weigh...

Humza Nusrat, Omar Nusrat · 0 citations
#artificial intelligence Preprint Nov 2026

A simple adaptive accelerated optimistic dual averaging method for unconstrained convex optimization in $p$-norm geometry

Efficient preconditioning plays an important role in large-scale first-order optimization. In this paper, we propose an adaptive accelerated optimistic dual averaging ($\text{A}^2$ODA) method for unconstrained convex optimization that adopts low-cost preconditioning based on $p$-norm geometry for $p\in[2,\infty]$. The...

Bo-Wen Li, Dan-Qing Zhou, Chuan He · 0 citations
#artificial intelligence Preprint Open access Nov 2026

PyRUA-DataFarm: LLM Agent as a Cost-Efficient Teleoperator for Real-Ready Robot Data

Teleoperation remains the default way to collect robot demonstrations, but every episode costs robot and operator time, and every new task starts from scratch. We ask whether a coding agent can take over the teleoperator's job. In our DataFarm, the agent receives a data request and one calibration episode of the robot...

Kewei Zhang, Juncheng Ma, Guodong Lv et al. · 0 citations
#artificial intelligence Preprint Open access Nov 2026

HARP: Training-Free Dual-Profile Agentic Communication for LLM-Based Recommendation

In LLM-based recommendation, memory acts as a user-level agent in a memory-augmented backbone. Yet users and items remain asymmetric: only the user is given a structured profile; it enters a bandwidth-limited reranker prompt; and it is frozen after warmup. We recast LLM-based recommendation as an agentic-communication...

Zhen Tao, Xun Zhou, Xuhui Chen et al. · 0 citations
#artificial intelligence Preprint Open access Nov 2026

LoopVQ: Sub 1-bit KV Cache Quantization for Looped Transformers

Looped transformers are a parameter-efficient alternative to standard transformers for language modeling. By reapplying the same layers across multiple loop steps, recent looped language models match the performance of non-looped models several times their size. While this architecture effectively reduces parameter mem...

Minsoo Cheong, Sungjoo Yoo · 0 citations
#artificial intelligence Preprint Open access Nov 2026

Personas Are Not People: Identity as State, Not Attribute

Synthetic populations, large sets of simulated people, are increasingly used in place of real people to pretest surveys, simulate users and communities, and evaluate AI systems. Each simulated person is defined by a persona, a written profile of fixed traits, demographics, and attitudes that a language model is instruc...

Tamunotonye Harry, Yuanyuan Feng · 0 citations
#artificial intelligence Preprint Open access Nov 2026

False Reassurance in LLM Severe-Weather Guidance: A Replayable Evaluation Against Real NWS Alerts

An LLM assistant that cannot see official severe-weather alerts may tell users that conditions are calm while a warning is active. We call this false reassurance and measure it by replaying 117 frozen cases built from real U.S. National Weather Service (NWS) alerts (69 alert cases, 32 no-alert controls, 16 non-U.S. loc...

Kadharmoideen Fadurudeen · 0 citations
#artificial intelligence Preprint Open access Nov 2026

Knowingly Wrong: Training LLMs Against Their Own Beliefs can Induce Misalignment

Fine-tuning a large language model (LLM) on harmful data in a narrow domain, such as bad medical advice, can make it broadly misaligned. How realistic this risk is remains unclear, since models are very rarely fine-tuned on explicitly harmful data in practice. In this work, we show that fine-tuning on data the model be...

Ariana M. Villegas-Suarez, Guido Freire, Sohan Venkatesh et al. · 0 citations

From tech blogs

See all →
Hugging Face Blog Nov 10, 2026

Decision Models in Hugging Face

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.