Video world models aim to simulate complex environments with realistic appearance and dynamics. Maintaining consistency over long interactions requires tracking past actions and understanding how those actions affect the environment. Video world models can only generate partial observations of the entire world at a tim...
Lorenzo Venturoli, N. Savov, Xi Wang et al.· 0 citations
Computer-use agents need to reliably ground action targets in complex desktop scenes, where multiple applications, overlapping windows, and visually similar controls compete for attention. Existing training data rarely pair such scenes with dense annotations or vary them in a controlled way. We introduce DeskForge, a c...
A. Gurbuz, Ahmed S. Nassar, Sung-Jin Hong et al.· 0 citations
Real-world AI systems must reason about objects that are no longer visible: an AR assistant guiding a user back to an object used earlier, a household robot retrieving an item someone put away. This requires not just recalling where an object was last seen, but updating its state when it is moved and retaining that upd...
Fang-Zhou Ma, Ivo Alexander Ban, E. Homburg et al.· 0 citations
Embodied agents must determine where to act, anticipate the resulting scene changes, and interpret observed outcomes to guide subsequent actions. This requires connecting 4D interaction understanding, which explains how past actions changed the scene, with spatially grounded planning, which determines how and where to...
Chenyangguang Zhang, Malgorzata Gwiazda, Guan-Long Jiao et al.· 0 citations
A novel egocentric and exocentric video dataset capturing real-world collaboration in cooking scenarios, and establishes benchmarks for Joint Attention Estimation, Socially Conditioned Object Interaction Anticipation, and Collaborative Handover Prediction, enabling research on multimodal perception, proactive assistanc...
Alexey Gavryushin, Dingxi Zhang, Zhao Huang et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.