While reinforcement learning agents can achieve superhuman performance in many complex tasks, they typically do not become more computationally efficient as they improve. In contrast, humans gradually require less cognitive effort as they become more proficient at a task. If agents could reason about their compute as t...
Adrian Orenstein, Jiajing Chen, Gwyneth Anne Delos Santos et al.· 0 citations
Chain-of-thought (CoT) reasoning improves LLM accuracy on complex tasks, but CoTs are often unfaithful; that is, the model does not rely on the stated reasoning steps to produce its answer. Existing methods to improve faithfulness require human annotations. We propose LIFT, which automatically scores each reasoning ste...
Anand Swaroop, Maheep Chaudhary, Kevin Zhu et al.· 0 citations
LLM agents are increasingly proposed as substitutes for human participants in social research, usually on the strength of survey responses that match those of the humans they represent. We argue that such output-level alignment is not enough. Drawing on the behavioral sciences, we propose Latent Profiling, a framework...
James Mooney, Josef Woldense, Zheng Robert Jia et al.· 0 citations
Public service systems in many African regions suffer from delayed emergency response and spatial inequity, causing avoidable suffering. This paper introduces OPTIC-ER, a reinforcement learning (RL) framework for real-time, adaptive, and equitable emergency response. OPTIC-ER uses an attention-guided actor-critic archi...
Mary Tonwe· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
In this paper we try to answer the question "What constitutes Sudoku difficulty rating across different Sudoku websites?" Using two distinct methods that can both solve every Sudoku puzzle, I propose two new metrics to characterize Sudoku difficulty. The first method is based on converting a Sudoku puzzle into its corr...
Large language models can answer questions correctly and still hallucinate their citations. Most citation systems address this by retrieving documents at inference time. Retrieval adds latency and depends on external infrastructure. Retrieval noise can also affect the answer. We study whether LLMs can cite documents fr...
Yukun Huang, Sanxing Chen, Jian Pei et al.· 0 citations
Large-scale itinerary planning is a variant of the traveling salesman problem, aiming to determine an optimal path that maximizes the collected point-of-interest (POI) scores while minimizing travel time and cost, subject to travel duration constraints. This paper analyzes inter-component dependence in large-scale itin...
Ziyu Zhang, Peilan Xu, Yuetong Sun et al.· 0 citations
Large language model (LLM) agents have shown impressive reasoning capabilities in interactive decision-making tasks. These agents interact with environment through intermediate interfaces, such as predefined action spaces and interaction rules, which mediate the perception and action. However, mismatches often happen b...
Kaiming Liu, Xuanyu Lei, Ziyue Wang et al.· 0 citations
We introduce Physics, a benchmark for evaluating foundation models on advanced physics problem solving. It contains 1034 annotated, open-ended problems from PhD-qualifying exams across six core physics domains. Solving these problems requires applying domain-specific knowledge to physical setups and carrying out multi-...
Kaiyue Feng, Yilun Zhao, Yixin Liu et al.· 0 citations
The EU Artificial Intelligence Act (AIA) establishes different legal principles for different types of AI systems. While prior work has sought to clarify some of these principles, little attention has been paid to robustness and cybersecurity. This paper aims to fill this gap. We identify legal challenges and shortcomi...
Henrik Nolte, Miriam Rateike, Mich\`ele Finck· 0 citations
Why can neural networks struggle to learn optimal play in a game with a simple, efficient solution algorithm? Motivated by empirical difficulties with parity in impartial games, we use NIM to study a representational bottleneck and three ways around it. We show that a restricted model of shallow, fixed-scale quantised...
Argumentation is an important cognitive activity that involves the scrutiny of arguments and counterarguments. When given an argument, it is desirable that its premises entail its claim, and that the premises and claim are consistent, and when given a pair of arguments, it is desirable to check whether one argument sup...