Large language models can often identify useful semantic structure in formal artifacts, but their outputs cannot be trusted as proofs or solver decisions. We study whether LLMs can instead guide formal reasoning systems through a narrow, solver-verifiable interface. We instantiate this idea in quantified array SMT solv...
Kun-Hang Lv, Rui Han, Fuqi Jia et al.· 0 citations
Several corrections of an executable model can fit the same observations while predicting different execution outcomes. We study a repair-to-execution interface that retains compatible finite guard repairs, conditions their weights on diagnostic and ordinary-execution observations, and uses their predictions to choose...
This work introduces AgentDecept, an executable benchmark for evaluating behavioral deception under pressure that enables controlled analysis of when multi-turn agents'reports diverge from execution in realistic application interactions.
Ye-Han Zhang, Qian-Qi Yan, Hang Yin et al.· 0 citations
Skill-evolution methods typically analyze execution trajectories to guide agent skill refinement. However, policy updates can change the behavioral effects and marginal utility of an unchanged skill. Attribution based on earlier trajectories may therefore no longer reflect the skill's contribution under the updated pol...
Yifan Wang, Zhenyi Gai, Yiwen Zhao et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Game AI results are comparable only when different implementations expose the same decision problem. Yet seemingly minor representation choices can silently change that problem by altering action probabilities or collapsing states with different outcomes. We study this issue through CoToan, an executable specification...
Whether models trained on different modalities converge to the same representation of the world is central to AI. The Platonic Representation Hypothesis (PRH) conjectures that they do as they scale, but without a proof it offers neither a guarantee nor a recipe. We turn the hypothesis into a theorem. First, we prove a...
Computer-use agents plan on a screenshot for several seconds and then click at a position on the screen; if the page has changed in the meantime, the click lands on an unintended element. Prior work treats the planning interval as the source of this risk. Measuring planned clicks on 31 public web pages, we find that th...
MemSteer is introduced, which turns unlabeled user histories into question-answer (QA) supervision with supporting evidence for memory-design optimization and develops MemSteer-Opt, which combines QA-based design evaluation with evidence-guided failure diagnosis to revise memory store, retrieval, and context constructi...
Jie Huang, Cui-Ling Lan, Qi-Ze Yu et al.· 0 citations
Engineering design frequently involves redesigning a prior solution to adapt to changes in context, such as material prices or system requirements. Redesign often leverages simulators too complex and/or computationally intensive for traditional numerical solvers, which lack engineering knowledge and context, to ensure...
Chan-Eui Song, Jeremy J. Michalek, Christopher McComb· 0 citations
While frontier vision-language models demonstrate strong capabilities in user interface (UI) navigation, their high inference costs prohibit everyday use. Conversely, smaller models trained via supervised fine-tuning (SFT) or offline reinforcement learning often memorize static trajectories, leading to brittle executio...
Pei-Tong Duan, Khashayar Gatmiry, Jeffrey Nichols et al.· 0 citations
Trajectory-level GRPO is a common approach for training multi-step GUI agents, but repeatedly rolling out complete trajectories from the task root can be inefficient: task-level rewards provide coarse supervision over which intermediate decisions require improvement, while already-mastered prefixes are repeatedly re-ex...
Yuxiang Chai, Quyu Kong, Panrong Tong et al.· 0 citations
We introduce SocialArena, a benchmark for systematically defining and evaluating the social intelligence of large language models (LLMs). Although LLMs are increasingly deployed in socially interactive applications such as mental health counseling, companionship chatbots, and educational tutoring, existing evaluations...
Zongqi Wang, Rui Wang, Yuchuan Wu et al.· 0 citations