Large Language Model (LLM) serving systems must balance latency and throughput while efficiently utilizing distributed GPU resources. This challenge arises because inference consists of two fundamentally different phases: prefill, which determines time-to-first-token (TTFT), and decode, which determines inter-token lat...
Best-of-N sampling is a simple inference-time scaling strategy for large language models, yet its behavior under incomplete reward models remains poorly understood. We study Best-of-N as a competition between the extreme reward tails of correct and incorrect responses. This view shows that success depends not only on t...
The competing-target test is introduced: a vector is compared with the vector built the same way for a competing target, and an equivalence test states when their difference is below a useful margin.
While causal discovery methods have matured for complete data, such algorithms for handling missing values remain limited. We establish general sufficient conditions under which causal graphs remain identifiable (i.e., uniquely determined from the available data distribution) under various missingness categories, inclu...
Matteo Ceriscioli, Shohei Shimizu, Mallika Gupta et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
The geometry of semantic embeddings is studied by studying the geometry of semantic embeddings to trace a clear failure mode: features that determine the neighbors of unseen prompts are an unreliable proxy for LLM selection.
Leonardo Torti, Emanuele Rimoldi, Tomer Galanti et al.· 0 citations
Can AI agents carry out research on open scientific problems? We introduce Into the Unknown, a benchmark that provides an agent with a science paper along with a research direction to pursue and tasks it to write a follow-up paper. We work with scientists at US Department of Energy (DOE) national laboratories, who each...
Seungone Kim, Jia-Yi Geng, Young-Jun Lee et al.· 4 citations· ⚡1
In-context learning (ICL) allows language models to adapt their behavior from instructions and demonstrations in a prompt, but accuracy alone does not reveal how contextual information controls their predictions. We study the acquisition and trainability of ICL with a controlled diagnostic that separates copying a near...
Minglai Yang, Xin-Yu Guo, Ren-Xiong Wang et al.· 0 citations
Generative retrieval (GR) has emerged as a strong candidate generator for sequential recommendation as language models and semantic-item identifiers have improved. However, GR is not a uniformly stronger replacement of dense retrieval (DR) in online retail candidate generation. We examine their differences on two Amazo...
Coordinators that act on what they infer about teammates are usually certified by the accuracy of those inferences. We argue that accuracy is the wrong certificate, for two reasons. First, the accuracy needed to act depends on what a wrong action costs, so the bar belongs to the deployment, not the module. Second, a mo...
Low-Rank Adaptation (LoRA) has made diffusion model personalization affordable and widely shareable, but it also creates moderation risks when harmful or problematic content is not faithfully disclosed. Hence, it is desired to develop a mechanism that, given a LoRA adapter, discovers the concept it was trained to gener...
Yupeng Qiu, Han Fang, Dhananjai Sharma et al.· 0 citations
Most symbolic regression methods optimize candidate equations, but improving an equation's fit does not establish whether its underlying scientific conjecture should be retained, revised, or rejected. A conjecture may admit multiple mathematical realizations, and similarly accurate equations may imply different explana...
Modern coding agents are fundamentally reshaping the role of human input for computational research: they write code, launch in silico experiments, analyze their results, and autonomously operate with ever-increasing time horizons. Despite these developments, fully autonomous research agents suffer from a limited ideat...
R. Lange, Luca Grillotti, Yutaro Yamada et al.· 3 citations