Skip to content

Category

artificial intelligence

20,463 papers

#artificial intelligence Preprint Open access Nov 2026

Characterizing Recoverable Expert-Utilization Signatures in Fine-Tuned Mixture-of-Experts LLMs

As Mixture-of-Experts (MoE) large language models are increasingly deployed in distributed environments, from federated learning to edge-cloud systems, their architecture harbors an underexplored landscape of security vulnerabilities. Moving beyond textual analysis, we uncover structural memorization: a novel vulnerabi...

Fei Wang, Baochun Li, Bo Li · 0 citations
#artificial intelligence Preprint Open access Nov 2026

WebOverlay: High-Throughput Vision-Only Distillation for Extreme Aspect-Ratio Web Overlay Detection

Web overlays, such as cookie consent banners, newsletter prompts, and age gates, obstruct automated web crawlers and degrade downstream document representations. While proprietary multimodal Large Language Models (MLLMs) can accurately identify overlays, their latency and inference cost preclude web-scale ingestion. Co...

Jiannan Huang, Jerry Ding, Li Yu et al. · 0 citations
#artificial intelligence Preprint Open access Nov 2026

Dreams Are Cheaper Than Flights: Curated World-Model Data Improves Aerial Detection

Robot perception is increasingly data driven, yet field data is slow, costly, and sometimes disruptive to collect. Video world models offer a cheaper source: seeded with real frames, they extend a recorded scene into new footage with the deployment's sensor, altitude, and environment. We ask whether such synthetic data...

Rugved Katole, Vedant Patil, Jenna Kline et al. · 0 citations
#artificial intelligence Preprint Open access Nov 2026

Towards Understanding Score-Seeking in LLMs

Production large language models sometimes reward-hack, exploiting flaws in how tasks are scored rather than performing the tasks as intended, sometimes in highly sophisticated and adversarial ways. We investigate the motivations driving this behavior in GPT 5.6 Sol, GPT 5.5, and a checkpoint of OpenAI o3 without safet...

Aghyad Deeb, Ryan Greenblatt, Alex Mallen · 0 citations
#artificial intelligence Preprint Oct 2026

STAR: Steering Action Representations during Inference

Vision-language-action models (VLAs) map language instructions and visual observations to robot actions, showing strong capabilities across robotic manipulation tasks. However, in our probing experiment, we find that action representations near the action output do not fully preserve task-relevant visual grounding. Mot...

Guang-Yu Zhao, Yong-Chang Zhang, Hao-Xuan Ru et al. · 0 citations
#artificial intelligence Preprint Open access Nov 2026

Steering Vectors as a Training Signal in LLM Post-Training

Steering vectors (SVs) are residual-stream directions that shift the behavior of LLMs when added to hidden states at inference time. While prior work has mainly used SVs as post-hoc controls, we ask whether the same directions can also guide parameter updates during post-training. We study this question across supervis...

Tiejin Chen, Maunil Vyas, Huaiyuan Yao et al. · 0 citations
#artificial intelligence Preprint Open access Nov 2026

CAMEL: Cross-Architecture Masked Embedding Learning for Ultra-Lightweight Retinal Foundation Models

Recent progress in deep learning has substantially advanced automated grading of ophthalmologic pathologies, supported by large annotated datasets and improved representation learning. However, a significant gap remains between state-of-the-art performance and clinical scalability. In particular, foundation models have...

Andre Guarnier De Mitri, Giovani Decico Lucafo, Miller Matheus Lima Anacleto Rocha et al. · 0 citations
#artificial intelligence Preprint Open access Nov 2026

On the Origin and Evolution of Training-Inference Mismatch in LLM Reinforcement Learning

On-policy reinforcement learning for large language models assumes that training responses are sampled from the current policy. In practice, an inference engine samples the responses and a separate trainer computes the gradients, and the \textbf{training-inference mismatch} between the two makes the training data off-p...

Yu Li, Yufa Zhou, Tian Lan · 0 citations
#artificial intelligence Preprint Open access Nov 2026

Kernel-based Interpolatory Methods for Context Compression of Attention Mechanisms

The bottleneck of attention mechanisms, which are the fundamental building block of modern language models, is their quadratic complexity in terms of context size. There has thus been an increasing interest in the compression of the context, also called KV-cache compression. In this article, we consider the problem of...

Michel Fabrice Serret, Laura Grigori · 0 citations
#artificial intelligence Preprint Open access Nov 2026

A Theoretical Framework for Understanding and Building "Any-task inference" Capable Foundation Models

In this work, we provide a formal framework and mathematical definition for the subset of foundation models focused on enabling the property of "any-task inference" (ATI) (similar to zero-shot inference), rather than those designed for pre-training fine-tuning. To achieve this mathematical definition, we formalize the...

Matthew McDermott, Florent Pollet, Payal Chandak et al. · 0 citations
#artificial intelligence Preprint Open access Nov 2026

TSFLab: A Self-Improving Agent-Agnostic Workbench for Time Series Forecasting Research

As publications and products on time series forecasting (TSF) proliferate, researchers face a growing burden of analyzing existing work. First, not all publications release code. For instance, only about 20% of arXiv TSF papers have a code link in the surveyed period. Second, released code also requires manual maintena...

ChengAo Shen, Yanjun Zhao, Haoxin Liu et al. · 0 citations

From tech blogs

See all →
Hugging Face Blog Nov 10, 2026

Decision Models in Hugging Face

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.