Large language models (LLMs) are increasingly used to discover scientific equations from experimental data. Such a discovery system has two parts that must work together: a library of executable computational tools and the model's tool-use policy. The tools supply the solving capability, from diagnosing structure in th...
Peng-Ze Li, Jia-Quan Zhang, En-Cheng Su et al.· 0 citations
This work introduces DuplexAct, a benchmark for evaluating interaction action taking in E2E FD-SLMs and defines a three-level action taxonomy spanning eight interaction actions and 24 corresponding interaction conditions, and develops action-specific evaluation metrics for both.
Jia-Heng Dong, Shi-Hong Tan, Gong-Ping Huang et al.· 0 citations
Egocentric multimodal assistants see through the user's eyes and guide what the user does next, so their outputs directly shape physical actions, including those that affect bystanders. Yet existing safety evaluations do not distinguish whom a response would harm, and score only whether a model refuses. Pooling all har...
Yewon Han, Jisu Jeon, Suhyun Choi et al.· 0 citations
Long-horizon, semi-verifiable agentic tasks often rely on rubric-based evaluation, but the evidence needed to assess these tasks can be spread across the environment state and the execution trace. A judge may overlook this evidence or accept unsupported claims, including an agent's own reports of success. When rubric v...
Reza Sanayei, Razvan-Gabriel Dumitru, Sun-Jie Hou et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
People act on evaluative judgments produced by LLM agents, and in multi-agent systems those judgments pass through several agents before reaching a person. We show that a workflow's information architecture---source access, handoff format, and which model reads the untrusted content---governs how much of a coordinated...
Chun-Yu Hsu, Lun-Wei Ku, Chung-Chi Chen· 0 citations
Agents build knowledge graphs as memory, and building them has become easy. Maintaining them has not. When a source is retracted, overruled, or erased, everything built on top of it (entity merges, entailed edges, community summaries) must be re-examined, and the maintainer must choose between deleting too much and too...
Electrocardiogram (ECG) models need supervision that targets evolving weaknesses and remains faithful to waveform evidence. We introduce ECG-RSI, a recursive self-improvement framework combining verified waveform synthesis with feedback-guided intervention search. Signal remeasurement verifies waveform edits; construct...
Xiaoliang Wang, Zhuo Chen, Chuanyang Zheng et al.· 0 citations
Training graphical user interface (GUI) agents with reinforcement learning suffers from sparse outcome rewards, leading to inefficient learning. Process rewards offer a promising direction for credit assignment to intermediate actions; however, accurately evaluating an action requires identifying evidence across long-h...
Zirui Shang, Yang Liu, Xin Shu et al.· 0 citations
Evaluating the quality of process models discovered from event logs is a fundamental challenge in process mining. Traditional evaluation relies on conformance metrics such as fitness and precision, which are highly sensitive to noise and deviations in event logs and therefore often fail to give a consistent assessment...
Medical multimodal reasoning models are typically trained on teacher-generated rationales, discarding the valid reasoning in students' own failed trajectories, while general-domain correction methods offer little guidance for errors in image reading, anatomical context, or differential diagnosis. We propose MedEvo, whi...
Xiaoliang Wang, Zhuo Chen, Chuanyang Zheng et al.· 0 citations
Serverless inference is emerging as an efficient deployment model for Large Language Models (LLMs) due to its ability to elastically scale resources, improve GPU utilization through resource sharing, and reduce infrastructure costs. However, existing approaches primarily optimize time to first token (TTFT) while overlo...
Hardi Ashishbhai Desai, K. BalajiN, Sourav Kanti Addya· 0 citations