DSReg (Dependency-Sparsity Regularization) recovers individual world latents up to signed permutation, without reconstruction or a decoder, without reconstruction or a decoder, and establishes the first fully identifiable JEPA that recovers every world latent.
Yujia Zheng, David A. Klindt, Randall Balestriero et al.· 0 citations
Benchmarks for measuring the quality of action-conditioned world models are still evolving and shifting away from visual similarity-based metrics to action-semantic and physically-grounded metrics. However, for domain and task-agnostic action-conditioned world model training, existing benchmarks provide a limited signa...
Nirmit Desai, Eric Song, Mayank Sengupta et al.· 0 citations
This paper trains LeCuration, a small world model intended to serve as a data curation tool for a separate, larger downstream model, and finds that the embeddings of this model can be used as an anomaly detection signal and as a content-based clustering heuristic, and that auto-regressively predicting the game state wi...
Mayank Sengupta, Nirmit Desai, Eric Song et al.· 0 citations
This work identifies an additional informational curse of horizon in goal-conditioned policy learning, where increasing the goal relabeling horizon can significantly reduce policy generalization and performance, and finds that distilling the input Jacobians of short-horizon policies into long-horizon policies yields si...
John L. Zhou, Yuxuan Dong, Jonathan C. Kao· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Human videos provide rich motion targets for humanoid learning, yet visually plausible references can still produce persistent failures under physics-based execution. These failures reveal where training supervision should change. We present MimicX, a policy-in-the-loop framework that uses execution feedback to refine...
Shuai-Jun Liu, Cheng-Long Zhang, Xu-Hao Liu et al.· 0 citations
Astra can act, yet reliable manipulation depends on the system through which it observes and controls the world. We introduce PhysEvo, a framework for physical recursive self-improvement (RSI) around a single frozen model. A task agent executes robot tasks; a meta-agent uses the resulting trajectories to diagnose failu...
Wenqing Tian, Zeyu Zhang, Zhaocheng Liu et al.· 0 citations
While offline reinforcement learning (RL) enables policy optimization from static datasets without costly online interaction, it remains bottlenecked by the risk of executing out-of-distribution (OOD) actions. Recent approaches mitigate this by learning a behavior-cloning policy through flow matching and then performin...
Songyuan Zhang, Oswin So, Eric Yang Yu et al.· 0 citations
Deep-space crews cannot rely on real-time ground support for urgent off-nominal events. Initial alerts may underdetermine cause, while discriminating evidence may reside in crew observations or at locations that are unsafe, costly, or unavailable for crew inspection. We present an evidence-driven architecture for human...
Ignacio G Lopez-Francos, Alexis Gallagher, Samira Shalal· 0 citations
We present Go2-DrivoR, a goal-conditioned adaptation of the end-to-end autonomous driving trajectory planning framework DrivoR for urban navigation with quadrupedal robots. By conditioning trajectory generation on a local-frame subgoal through a goal token and adapting the vehicle-centric scoring formulation, the metho...
Joochan Kim, Chanuk Yang, Tackgeun You et al.· 0 citations
Latent world models have shown a remarkable ability to predict future states and to plan in the real world. In practice, however, we lack a principled way to estimate how their capabilities scale with model size, data, and compute, an open problem that slows progress in the field. In this work we present RoboJEPA, a wo...
Artem Zholus, Nicolas Beltran-Velez, Jian-Hao Yuan et al.· 0 citations
Autonomous navigation in dynamic environments requires computing spatiotemporal trajectories that satisfy non-holonomic motion constraints. When the trajectories of the moving obstacles are predictable or known, a promising approach is to rely on the combination of state lattices constructed from precomputed feasible m...
Marat Agranovskiy, Konstantin S. Yakovlev· 0 citations
Long-running autonomous agents must reuse accumulated reasoning experience without allowing explicit historical memory and LLM context to grow indefinitely. However, existing memory mechanisms mainly retrieve, summarize, or compress past content and do not directly learn when particular kinds of thinking should be acti...
A new system identifies and corrects unreliable object descriptions stored in a robot’s memory, improving the robot’s ability to interact with its environment.
Robots are getting smarter, but how can their hardware match that growth? New Microsoft Research findings show that moving AI inference beyond the robot can improve task success, boost efficiency, and support more advanced physical AI workloads. The post Offloaded inference for real-world physical AI robotics appeared first on Microsoft Research.