Category
3,468 papers
Communication between two frozen large language models from different providers, with different tokenizers, accessed through their API endpoints is studied, finding that successful place value communication in some runs is rare.
The TREC Million LLM Track operationalizes a retrieval-based paradigm in which an assistant agent infers expertise dynamically by examining models'observable behavior, providing the first large-scale benchmark for expertise retrieval in agentic AI.
Supervised fine-tuning can teach language models undesired behaviours alongside desired ones. Inoculation prompting (IP) aims to limit unwanted generalisation by requesting the undesired behaviour during training and removing the request at inference. However, undesired behaviour can still appear under unrelated prompt...
Large Language Models (LLMs) have shown strong performance on tool-use agentic tasks when given a fixed tool schema. Yet a tool schema is not the action space of an agent; it is merely one interface representation of it. The same executable action can be exposed through many different, functionally equivalent tool defi...
Reach audiences
Advertise in front of researchers, engineers, and readers.
FullRespondent-LLM (FR-LLM), which fine-tunes two specialized LLMs: a marginal model for each item's response distribution and a respondent-level autoregressive model for dependencies across answers, yields complete questionnaires with realistic cross-item relationships while retaining strong item-level accuracy.
This paper introduces RSI-router, a routing framework that constructs subtask-level model assignments and model-specific skills through recursive self-improvement over accumulated experience and establishes a stronger performance--cost Pareto frontier than 9 routing methods.
Nudgeability offers a simple, post-training-free way to evaluate both sensitivity and targeting as endogenous self-reflection mechanisms mature as endogenous self-reflection mechanisms mature.
ControlScope compares continuing generated code, editing the next tool call's data arguments, and replacing the unfinished workflow from the same public execution state to evaluate one-time and repeated reviews across filesystem tasks, ALFWorld, and AppWorld.
PainterBench, a benchmark that ports the incomplete-drawing task to the agentic setting, is introduced and ViDrA-adapted, an automated scorer that predicts human creativity ratings of agent drawings, is presented.
This work presents SpecRead, a benchmark that isolates specification comprehension from generation ability, and is automatically scorable by deterministic checks, with gray-zone cases counted wrong under the conservative main scoring.
Time-series diagnostic systems rarely rely on retrieving relevant historical cases, and when they do, retrieval is evaluated only indirectly through downstream prediction. We introduce READ-Bench, a benchmark for historical-case retrieval across 12 diagnostic datasets, centered on multivariate time series, that defines...
Large language models (LLMs) are increasingly integrated into educational settings, yet educators lack robust, standards-aligned tools to evaluate their effectiveness in K-12 science contexts. Existing benchmarks predominantly assess general language or advanced scientific reasoning, leaving a critical gap in understan...
A Blog post by IBM Granite on Hugging Face
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Gemini 4 Carbon is our strongest model with state-of-the-art cybersecurity and long horizon capabilities.
A Blog post by Liquid AI on Hugging Face
Genie 4: our new world model unlocking unprecedented realism in real-time simulation.
Generative AI
We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.
