Reinforcement learning agents optimize exactly the reward signal they are given, which can diverge sharply from an intended true objective when that signal is only a proxy for it; this failure mode is known as specification gaming. Existing evidence for this failure mode is largely observational, with comparatively few...
Personalization of Large Language Models (LLMs) is increasingly important for user-centric applications, yet prior methods mainly adapt dense LLMs, whose polysemantic neurons, each encoding multiple unrelated concepts, hinder localizing the components behind personalization, and thus understanding and controlling it. W...
Existing feature attribution methods that account for feature dependencies do not scale to high dimensions. We propose causal integrated gradients (CIG) and causal expected gradients (CEG), which extend integrated gradients to incorporate prior causal structure among input features while retaining its computational eff...
Joran Michiels, Anis Ismail, Maarten De Vos et al.· 0 citations
It is demonstrated that learning when to reveal and reconsider tokens can improve the accuracy-compute trade-off without updating the decoder backbone.
Ya-Shi Zhang, Jian Tang, Pierre-Andre Noel et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Supervised fine-tuning datasets remain overwhelmingly English-centric and commercially restricted, as their content is frequently generated by proprietary models whose terms of service forbid training competing systems. We introduce Multi-SFT, a commercially permissive collection of 502,818 instruction-response pairs a...
Daniela Baiamonte, Kamyar Zeinalipour, Elena Fano et al.· 0 citations
Streaming vision-language models (VLMs) must continuously integrate information from the past while remaining responsive to current observations and user queries. Existing memory mechanisms typically compress, retrieve, or cache historical observations and reintroduce them into the input context, forcing historical mem...
Zhuo-Ming Liu, Jin-Hong Lin, Lin Zhang et al.· 0 citations
Reconstructing what a person perceives from their brain activity is a stringent test of whether neural recordings carry meaningful information. Naturalistic speech offers a rich testbed for this challenge: it unfolds over multiple timescales, but fMRI's noisy, temporally smeared measurements make this structure hard to...
Corentin Caris, Louis Jalouzot, Nona Rajabi et al.· 0 citations
Which inputs drive a language model's financial forecast? We construct synthetic earnings announcements that independently reverse 20-day momentum, non-informational commentary tone, and whether fixed actual EPS beats a manipulated consensus. Six instruction/chat checkpoint conversions from four families (0.49-7.61B ba...
Self-evolving language models train on tasks they generate, so every round must decide which updated model the next round inherits. Current loops such as R-Zero, Agent0, and Skill Self-Play make this decision through the task, admitting tasks that look learnable and inheriting every resulting update. We identify a sele...
Hao-Yi Yang, Kshitij Mishra, Nils Lukas et al.· 0 citations
Learning from demonstration is an effective strategy for endowing robots with manipulation capabilities but requires training on datasets comprised of massive amounts of demonstrations. Existing demonstration collection approaches either require constant human involvement, for example, via teleoperation or are speciali...
An open midtraining recipe is presented that primes base models for agentic post-training, and its effectiveness on two Nemotron models of different sizes is shown, improving robustness across agent harnesses on both models.
Soumye Singhal, Joseph Jennings, Ka-Shun Shum et al.· 0 citations
Longitudinal electronic health records (EHRs) contain complementary diagnostic and laboratory information about patient health. However, irregularity, sparsity, heterogeneity, and incompleteness in documentation complicate EHR modeling. To address the problem, we introduce GraphBEAT (Graph-based Bucketized Event Aggreg...
L. Li-Han, Chris Varghese, Elizabeth Habermann et al.· 0 citations