Beyond Gaussian Worlds: Latent Geometry Matters for JEPAs
Experiments on Gaussian, spherical, and toroidal latent spaces show that geometrically compatible targets yield better linear recovery when optimization succeeds, whereas mismatched targets distort the latent structure.