Preprint
Aug 2026
LpWM: A Case for Sparse Representations in World Models
This work introduces LpWorldModel, a JEPA model regularized with Rectified Distribution Matching Regularization to match encoder features to a Rectified Generalized Gaussian distribution, yielding non-negative sparse codes, and finds that the learned sparse representations are mode-factored.
Yilun Kuang, Yash Dagade, Quentin Le Lidec et al.
· 5 citations