The results show that source deletion should be evaluated behaviorally at the level of the agent and its memory system, not only as a storage operation.
Ehsan Saleh, Roozbeh Nahavandi, Sama Salarian et al.· 0 citations
Metadata-conditioned generation is often framed as a data-to-text task in which additional input fields should improve grounding. Museum description generation challenges this assumption because catalogue records are heterogeneous, partially visual, and unevenly documented across geographic regions. We study how metada...
LLM-as-a-Judge evaluation is increasingly applied to multilingual tasks, yet prompting strategies such as Chain-of-Thought and Role Conditioning are recommended based solely on English benchmarks. Whether their effectiveness transfers across judge models and languages remains unknown: prompt-sensitivity studies are lar...
A. Mehrabi, Mohammad Aliannejadi, Clemencia Siro· 0 citations
Language models are compared on question-answering benchmarks that pose each question in one wording, and a reworded question can change which of two models scores higher. We ask whether giving the models tools makes such comparisons more stable. An accuracy gain cannot answer this, because tools change several steps b...
M. Modrzejewski, Tomasz Radzikowski· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Long-context models often use answer-bearing evidence less effectively when it appears away from a prompt boundary. We compare this position bias across Transformer, state-space, and hybrid Mamba architectures by moving one gold document through a fixed set of nine distractors. The evaluated Transformers show a beginni...
Aman Behera, Namit Solanki, Mehul Anand· 0 citations
Our previous analysis found that a model's native hashed N-gram table is where continual updates disturb the base least, but its writes needed backpropagation and changed the pretrained table. We present Delta N-gram, a forward-only write path into that table. The pretrained table T^0 is never modified. Evidence is wri...
Single-document LoRA adapters have been proposed as units of knowledge to be merged and retrieved; yet open-book scoring, with the document in the prompt, can credit a document's own adapter (its specialist) for reading that document as readily as for holding it. Training one adapter for each of 150 Wikipedia articles...
Martino M. L. Pulici, Cuong Xuan Chu, Evgeny Kharlamov et al.· 0 citations
Many language-model pipelines end in a closed-set decision, such as selecting a tool. Prompting a large language model for it is slow and order-sensitive. We ask how small an encoder for such decisions can be and whether it should read the options jointly or separately. In a three-seed study at 32 million parameters, p...
Six new safety datasets of sufficient size and difficulty are constructed and it is found that probe error follows two simple scaling laws, which allow safety researchers to determine how to create the best probe for any given model and label budget.
It is concluded that consistency under reordering can be optimized without improving the moral judgment it is meant to signal: consistency under reordering can be optimized without improving the moral judgment it is meant to signal.
Marius De Kuthy Meurers, Aaron T. Parisi, Bernd Bohnet· 0 citations
Training Arabic large language models faces challenges from noisy web data, dialectal variation, and the high cost of continual pretraining (CPT). We introduce AQL-Lite (AQL: Arabic Quality Language), a time- and resource-efficient framework for adapting a multilingual LLM to Modern Standard Arabic (MSA). AQL-Lite coup...
Nonlinear recurrent networks remain useful for streaming sequence modeling, yet gated cell design is still dominated by LSTM and GRU. We study whether recurrent computation can be reallocated away from gate transforms and toward candidate generation. We propose baseVultra, a compact recurrent cell that concentrates the...
Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.