Existing Graphical User Interface (GUI) benchmarks predominantly rely on precise and stateless user instructions. In everyday usage, however, instructions are often \emph{vague and history-dependent}: users omit the exact details of their past operations because they no longer remember them, leaving the agent to recove...
Yi-Zhou Liu, Zhengxi Lu, Fei Tang et al.· 0 citations
Differences in hand geometry, joint parameterization, and kinematic topology pose challenges for cross-embodiment dexterous grasp generation. However, spatial relations among links alone are insufficient to fully capture the hand's kinematic topology. We propose DexGraspFlow, a conditional link-level $\mathrm{SE}(3)$ f...
Bin-Jia Zhou, Bo-Yu Ma, Xin-Yu Zhou et al.· 0 citations
Mobile manipulation requires precise navigation to a manipulation-ready pose followed by reliable object interaction. These two stages differ in action spaces and visual requirements, which complicates unified policy learning. In addition, collecting diverse real-world navigation data with explicit manipulation-ready p...
Wei Xue, Ke-Liang Liu, Ming-Zhang Cui et al.· 0 citations
Building omni-modal models with physical intelligence requires fine-grained supervision that captures physical evidence such as contact, support, deformation, and state transitions. However, existing omni-modal captioners primarily model general audiovisual semantics and often overlook transient or spatially localized...
Kai Qiu, Ming-Hao Han, Ke-Liang Liu et al.· 1 citation
Computer use agents (CUAs) have demonstrated strong capabilities in completing digital tasks. However, existing CUAs either rely solely on graphical user interface (GUI) interactions, which are often inefficient and error prone, or augment GUI interactions with application specific APIs or tools, which require substant...
Tong-I Chen, Jun-Bo Niu, Zhengxi Lu et al.· 0 citations
Graphical User Interface (GUI) grounding is essential for autonomous agents to map natural language instructions to precise screen coordinates. However, existing supervised fine-tuning and reinforcement learning methods are constrained by the high cost of annotation, creating a scalability bottleneck. In this paper, we...
Yi-Zhou Liu, Fei Tang, Yuchen Yan et al.· 0 citations
Hierarchical vision-language-action (VLA) systems consist of a high-level vision-language planner and a low-level action expert that generates continuous actions. This hierarchical design has practical value only if the planner can generate plans fast enough to meet real-time control requirements, and the resulting pla...
Chuan-Liang Xie, Bo-Yu Ma, Gen Li et al.· 0 citations
Online training enables computer-use agents (CUAs) to improve through interaction with executable environments. However, existing methods primarily rely on sparse outcome rewards, which provide no supervision for intermediate actions. On-policy self-distillation (OPSD) offers token-level learning signals through privil...
Yong Du, Tong-I Chen, Zhengxi Lu et al.· 0 citations
Comprehensive experiments show that SpatialGuard achieves state-of-the-art performance in complex 3D spatial layout generation and improves spatial faithfulness over existing text-to-image and layout control baselines.
Ziyun Qian, Zi-Zhi Chen, Yi-Zhou Liu et al.· 2 citations
Fysiverse-3D-Vision is proposed, a unified vision-language-geometry framework for generative 3D scene reconstruction and executable asset construction from a single image that establishes a shared representation where spatial reasoning and geometric reconstruction mutually enhance each other, allowing object layouts to...
OmniFysics-Nano-V2, a compact omni-modal model for physical-world perception and understanding, is presented and experiments show that the proposed data and training strategy improves physical-world understanding while preserving broad omni-modal competence.
Yi-Zhou Liu, Jing-Hang Han, Kai Qiu et al.· 0 citations
This work proposes RetireOPD (Self-Retiring On-Policy Distillation), which first optimizes a decoupled, skill-conditioned teacher with environment rewards and then trains a skill-free student jointly with RL and OPD.
Yan Yu, Zhengxi Lu, Yi-Zhou Liu et al.· 4 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.