Multilingual safety evaluations should measure tool admission and response harmfulness separately and distinguish refusal from capability failure, as well as identify Safety Loss through Interlingual Processing (SLIP).
Aditya Nawal, Manit Baser, M. Gurusamy· 0 citations
Large language models increasingly act as agents that call external tools, yet most tool-safety research examines only what follows a tool call. The prior decision of whether to call the tool remains largely unexamined and can influence downstream safety. Across the seven open-weight models, the unweighted model-averag...
Aditya Nawal, Manit Baser, M. Gurusamy· 0 citations
Multi-objective optimization models are often deployed in settings where decision makers (DMs) must balance some conflicting criteria. In practice, however, stakeholders must translate their qualitative preferences between different criteria into numerical weights, priorities, or reference points required by optimizati...
AI financial advisers set a client's stock allocation largely from one stated-risk question, yet people do not answer it the same way twice: in a national US panel, 41% of households chose a different answer two years later, and in a laboratory retest a third of people moved two or more points on a 0-10 scale after six...
Soovadeep Bakshi, Apurba Bose, Aishwarya Bose et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Long-context decoding in large language models (LLMs) is increasingly bottlenecked by the memory and computation required to attend over an ever-growing Key-Value (KV) cache at each autoregressive step. Although token-level sparse attention reduces this burden by restricting computation to a small subset of relevant pa...
Zhen-Xu Tian, Ke-Bin Liu, Zheng-Wu Yang et al.· 0 citations
Cold-Start Failure-Only Evolution reveals that current self-evolving agents are better at repairing observed failures than building generalizable capabilities from failure, and suggests that current self-evolving agents are better at repairing observed failures than building generalizable capabilities from failure.
Weixiang Zhao, Yi-Chen Zhang, Yan-Yan Zhao et al.· 0 citations
Large language model (LLM) agents are increasingly evaluated on long-horizon tasks, including autonomously running a business. Existing benchmarks for this setting are almost exclusively English-language, Western in retail context, and single-agent, with the agent observing the business directly. We study how these res...
Bhuvan Arora, Ankita Karmakar, Chaitanya Jain et al.· 0 citations
Domain terminology provides concise descriptions of game states and strategic relationships, but whether game-playing language models can accurately recognize these concepts and relate them to move evaluation remains unclear. We construct a controlled evaluation set centered on atari and its relationship to sente in Go...
As large language models (LLMs) generate increasingly fluent text, the need for reliable detection of LLM-generated content has grown substantially. However, existing research remains heavily English-centric, leaving Korean largely underexplored. Moreover, current evaluations of Korean text detection often rely on supe...
Automatic speech recognition (ASR) pipelines often normalize transcripts by removing filled pauses and punctuation and expanding colloquial forms, potentially discarding cues useful for dialogue act classification. We evaluate nine transcript conditions across six classifiers (TF-IDF logistic regression, RoBERTa, BERT,...
Bengali hallucination detection must distinguish unsupported factual claims from incorrect reasoning, often without a supplied reference passage. We present and characterize an inference-only system that combines response-conditioned query rewriting, hybrid retrieval, and task-specific language-model judging. Six retri...
Formulating optimization problems from raw inputs of problem descriptions and data is time-consuming and costly. While Large Language Models (LLMs) offer a promising way to automate this process, existing benchmarks overestimate their capabilities by relying on idealized inputs where all data is relevant and complete....
Lijia Liu, Kyohei Atarashi, Jiyi Li et al.· 0 citations
Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.