Existing Graphical User Interface (GUI) benchmarks predominantly rely on precise and stateless user instructions. In everyday usage, however, instructions are often \emph{vague and history-dependent}: users omit the exact details of their past operations because they no longer remember them, leaving the agent to recove...
Yi-Zhou Liu, Zhengxi Lu, Fei Tang et al.· 0 citations
As video models enable longer and more realistic interactive experiences, maintaining a world consistent with its history becomes essential. This requires both preserving previously observed content and ensuring coherent world evolution over time. World memory is a critical capability to evaluate alongside visual fidel...
Nan-Yi Zhou, Jianxiong Gao, Qiuyu Wang et al.· 2 citations
This work proposes KnowGPO, a reinforcement learning framework that aligns trajectories by the task-relevant knowledge they have acquired rather than by their surface observations, and demonstrates how this helps solve knowledge-intensive tasks through long-horizon, multi-turn interactions.
Si-Qi Chen, Zhengxi Lu, Yuchen Yan et al.· Proceedings of the 2026 Conf...· 0 citations
Skill-augmented agents improve sample efficiency by distilling successful trajectories into reusable strategies. Yet most existing approaches remain text-centric, linearizing spatial layouts and action-state correspondences into language that loses critical geometric structure. Recent efforts have begun incorporating v...
Hong-Xing Li, Ding-Ming Li, Yi-Xin Li et al.· 0 citations
Existing spatial reasoning benchmarks mainly test spatial perception: reading off relations already visible in the input. Yet real-world spatial intelligence demands predictive spatial reasoning: constructing a scene from observations, anticipating how an intervention changes it, and reasoning about the unseen outcome....
Hong-Xing Li, Jin-Yue Su, Ding-Ming Li et al.· 1 citation
GPD (Geometry-Privileged Distillation) is proposed, which makes geometric evidence the privilege in on-policy self-distillation (OPSD), outperforming both GRPO and answer-privileged OPSD across spatial reasoning benchmarks.
Hong-Xing Li, Yi-Xin Li, Ding-Ming Li et al.· 0 citations
Computer use agents (CUAs) have demonstrated strong capabilities in completing digital tasks. However, existing CUAs either rely solely on graphical user interface (GUI) interactions, which are often inefficient and error prone, or augment GUI interactions with application specific APIs or tools, which require substant...
Tong-I Chen, Jun-Bo Niu, Zhengxi Lu et al.· 0 citations
Graphical User Interface (GUI) grounding is essential for autonomous agents to map natural language instructions to precise screen coordinates. However, existing supervised fine-tuning and reinforcement learning methods are constrained by the high cost of annotation, creating a scalability bottleneck. In this paper, we...
Yi-Zhou Liu, Fei Tang, Yuchen Yan et al.· 0 citations
Online training enables computer-use agents (CUAs) to improve through interaction with executable environments. However, existing methods primarily rely on sparse outcome rewards, which provide no supervision for intermediate actions. On-policy self-distillation (OPSD) offers token-level learning signals through privil...
Yong Du, Tong-I Chen, Zhengxi Lu et al.· 0 citations
A Gaussian guidance framework that draws the depth per task from a Gaussian whose center and spread are estimated online from rollouts already collected for policy optimization, requiring no probe rollouts or learned depth predictor is proposed.
Zi-Xuan Wang, Yan-Rui Miao, Zhengxi Lu et al.· 2 citations
Deep search requires LLM agents to decompose complex queries, search for evidence, and synthesize grounded answers, yet existing ReAct-style agents suffer from two limitations: role coupling, where one policy must handle planning, evidence use, and synthesis; and context accumulation, where growing search histories int...
Xing-Yu Wu, Yuchen Yan, Zhengxi Lu et al.· 0 citations
This work proposes RetireOPD (Self-Retiring On-Policy Distillation), which first optimizes a decoupled, skill-conditioned teacher with environment rewards and then trains a skill-free student jointly with RL and OPD.
Yan Yu, Zhengxi Lu, Yi-Zhou Liu et al.· 4 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.