LeVJEPA: Efficient&Scalable Video Pretraining without the Heuristics
LeVJEPA is introduced, the first video encoder trained under LeJEPA's collapse-free objective, which indicates that video becomes a viable and in several respects preferable substrate for general-purpose visual pretraining.