Skip to content

Category

artificial intelligence

20,518 papers

#artificial intelligence Preprint Open access Oct 2026

Failure Is the Mother of Success: Recovering Supervision with Grounding Hindsight

When every rollout for a problem fails, GRPO receives neither a successful exemplar nor a nonzero group-relative advantage, so it learns nothing from exactly the problems it most needs to learn. The failed reasoning can nevertheless suggest what to try next. We present Replay-Selected Hindsight Distillation (RSHD), whi...

Sheldon Yu, Tong Yu, Nikki Lijing Kuang et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Deep Reinforcement Learning for HPC Job Scheduling: A Statistical Evaluation

Deep Reinforcement Learning (DRL) offers learned job selection for High-Performance Computing (HPC), but performance against heuristics alone does not establish value beyond action masking. Six DRL treatments are compared: Proximal Policy Optimization (PPO), Advantage Actor-Critic (A2C), and Deep Q-Network (DQN), each...

Justin M. Cheney, C. Nyirenda · 0 citations
#artificial intelligence Preprint Oct 2026

MSP: Modality Self-Play for Training Multimodal LLMs Without Paired Cross-Modal Data

Large multimodal models have achieved remarkable progress by scaling model capacity and training on massive paired multimodal data. However, this paradigm introduces a fundamental bottleneck: aligned multimodal datasets are expensive to curate, difficult to scale across diverse modality combinations, and increasingly c...

R. Moseley, Md Kaykobad Reza, Ameya Patil et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

StepSafe: Learning Timely Intervention with Context-Aware Safety Reasoning

Safety in agentic systems is inherently sequential: whether an action is safe depends on prior actions, tool outputs, information disclosures, and interactions among agents. Recent work has shifted agent safety guardrails from post-hoc trajectory-level assessment toward step-level action diagnosis and proactive risk pr...

Siyi Gu, Kunhan Gao, Chao Peter Yang et al. · 0 citations
#artificial intelligence Preprint Oct 2026

LEV: Thinking Fast and Deep with Looped Decision Models

Decision models answer typed questions about an input with one probability per option, computed in a single forward pass without generating text. Like the fast System 1 of dual-process theory, they answer at once, but their depth is fixed at training time, so they spend the same computation on easy and hard questions....

Dingjie Song, Zhiling Yan, Yuxuan Zhang et al. · 0 citations
#artificial intelligence Preprint Oct 2026

MAI-Gym: An Open All-in-One Platform for GUI Agent Evaluation and RL Training across Mobile and Computer Environments

Online reinforcement learning (RL) with verifiable rewards has driven rapid progress in mathematics, coding, and tool use, but scaling this success to GUI agents remains challenging due to the high cost of interactive environments and the scarcity of realistic training tasks. We introduce MAI-Gym, an open all-in-one pl...

Pan-Rong Tong, Qu-Yu Kong, Peng-Xiang Li et al. · 0 citations
#artificial intelligence Preprint Oct 2026

RAC: A Relational Agent Contract for Constraint-Governed Engineering Tasks

Engineering agents must produce artifacts that satisfy exact, coupled constraints. Existing solutions often require agents to make semantic decisions and also derive consequences such as precise geometry or timing from those decisions, leading to failures in constraint-governed engineering tasks. In this paper, we intr...

Kai-Yuan Zheng, Feng-Qing Jiang, Yichen Feng et al. · 0 citations
#artificial intelligence Preprint Oct 2026

SkillNEO: Non-Elitist Evolutionary Optimization of Agent Skills

Agent skills turn procedural knowledge into reusable artifacts, allowing LLM agents to accumulate and refine expertise through experience. Building on this, skill evolution iteratively improves skills using execution feedback. However, improvement may require several interdependent edits, so low-reward versions can sti...

En-Ze Ma, Chun-Yu Miao, Yan-Kai Chen et al. · 1 citation
#artificial intelligence Preprint Oct 2026

Defining and Generating Compositional Structure

Compositional structure is pervasive in nature and across scales: atoms combine into molecules, molecules into cells, and cells into organisms, while further compositional hierarchies appear within each level. More broadly, compositionality, the reuse and recombination of parts into novel structures, is a fundamental s...

Eric Elmoznino, Tejas Kasetty, B. A. Y. Arcas et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

A Multi-Tiered AI Accessibility Model (MAIAM): Proportionate Access and Capability Limits for Comprehensive Frontier AI Safety

Most debate about releasing capable AI systems treats the choice as binary: keep the model behind an API, or publish the weights. That framing runs together two separate decisions. One is how capable a system may become. The other is who may obtain a given capability, and on what terms. This paper is about the second d...

Chai K. Toh, Vasu Raj Jain · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Anticipatory Commonsense with Moving Objects: An ASP-Based Framework for Predictive Reasoning with Interacting Trajectories

We present a general declarative framework for anticipatory reasoning about interactive motion in complex dynamic environments. Our focus is on (explainable) anticipatory space-time mental model formation at a semantic level to heuristically guide low-level motion computation. Our method is hybrid, modular and elaborat...

Julius Monsen, Jakob Suchan, Mehul Bhatt · 0 citations
#artificial intelligence Preprint Oct 2026

Evolving Together, Failing Apart: The Skill-Policy Co-evolution Trap in Self-Improving Agents

Skill-policy co-evolution, in which an agent's policy model and its skill bank improve each other during training, is a promising paradigm for self-improving agents. Current evaluations score the co-evolved policy on the final bank it trained with (the delivered bank). After deployment, however, skills may be rewritten...

Yu-Jie Feng, Xiao-Bin Wang, Jin-Luan Yang et al. · 0 citations

From tech blogs

See all →
Hugging Face Blog Nov 10, 2026

Decision Models in Hugging Face

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.