Skip to content

Author

Randall Balestriero

We have 10 of 19 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#artificial intelligence Preprint Oct 2026

World Modeling through Spectral Alignment

How do we tell a world model what information to preserve? We study this question through the lens of spectral representation learning. We introduce SpecWM, a JEPA framework that explicitly specifies desired relationships between observations through a target similarity kernel and trains the encoder to reproduce those...

Holger Molin, William Peng, M. Bagatella et al. · 0 citations
#artificial intelligence Preprint Oct 2026

LeHami: Symplectic Latent Dynamics for World Models

Joint-embedding predictive architectures (JEPAs) learn world models directly in latent space, but unconstrained autoregressive predictors may contract the latent distribution over long rollouts. We introduce Symplectic Hamiltonian JEPA (LeHami), which replaces the standard predictor with an action-conditioned Hamiltoni...

Romina Yalovetzky, Randall Balestriero, Yann LeCun · 0 citations
#machine learning Preprint Oct 2026

Sonic-AMG: Streaming Human Motion Generation from Spatial Audio

Modeling human reactions to spatial audio requires understanding both what is heard and where it comes from. Prior work generates motion offline from complete acoustic and spatial input sequences. Humans, however, react to sounds without knowing what they will hear next. We present Sonic-AMG, to our knowledge the first...

J. Ni, Ze-Kun Li, Zhiyang Dou et al. · 0 citations
#artificial intelligence Preprint Oct 2026

LeWAM: End-to-End World and Action Modeling with JEPAs

Joint-embedding predictive architectures (JEPAs) learn compact latent world models without pixel reconstruction. Existing JEPA pipelines typically train visual representations and action-conditioned dynamics before adding a control policy or solver. We introduce LeWAM, an end-to-end JEPA for control with: (1) a joint t...

Ming-Hao Fu, Tavis Siebert, Eryk Halicki et al. · 0 citations
#artificial intelligence Preprint Oct 2026

DSReg: Provably Recovering Individual World Latents without Reconstruction

DSReg (Dependency-Sparsity Regularization) recovers individual world latents up to signed permutation, without reconstruction or a decoder, without reconstruction or a decoder, and establishes the first fully identifiable JEPA that recovers every world latent.

Yujia Zheng, David A. Klindt, Randall Balestriero et al. · 0 citations
#machine learning Preprint Oct 2026

H-JEPA: End-to-End Learning of Hierarchical World Models for Visual Planning

Long-horizon planning with latent world models requires reasoning across timescales and levels of abstraction. Existing task-agnostic JEPA world models predict and plan at a single timescale or with multiple horizons in one shared latent space. We introduce H-JEPA, an end-to-end recipe for training a hierarchy of actio...

Wan-Cong Zhang, Basile Terver, Michael G. Rabbat et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Semigroup-JEPA: Latent Dynamics Consistency for Zero-Shot Physics Generalization

SemiGroup-JEPA (SG-JEPA), which extends the LeWorldModel framework by supplying the parameter governing the physics to the temporal model via action-conditioning and jointly training an encoder and predictor through an autoregressive latent rollout, is introduced.

A. Liu, Hao-Ran Sun, L. Baker et al. · 3 citations
Preprint Aug 2026

LeVJEPA: Efficient&Scalable Video Pretraining without the Heuristics

LeVJEPA is introduced, the first video encoder trained under LeJEPA's collapse-free objective, which indicates that video becomes a viable and in several respects preferable substrate for general-purpose visual pretraining.

Lukas Kuhn, Lucas Maes, Giuseppe Serra et al. · 3 citations · ⚡1
Preprint Aug 2026

LpWM: A Case for Sparse Representations in World Models

This work introduces LpWorldModel, a JEPA model regularized with Rectified Distribution Matching Regularization to match encoder features to a Rectified Generalized Gaussian distribution, yielding non-negative sparse codes, and finds that the learned sparse representations are mode-factored.

Yilun Kuang, Yash Dagade, Quentin Le Lidec et al. · 5 citations
Preprint Aug 2026

VIScore: Diagnosing Planning-Relevant Quality in Latent World Models

The Veracity-Influence-Sobriety score (VIScore), a metric that quantifies the reachability and capacity of a predictor given the encoded feature, and the hallucination of the searching-based planner, is proposed, showcasing the importance of these three aspects in planning success.

Hai-Yu Wu, Randall Balestriero, Morgan E. Levine · 3 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.