Helping Music Co-Creation Agents'Listen'Well: Hierarchical Self-Supervised World Models for Understanding and Generation
A hierarchical self-supervised ``world model'' for symbolic music is presented, using a 2.55M-parameter Swin V2 encoder trained on MIDI piano-roll images with JEPA-style objectives (pitch- and time-shift equivariance, masked embedding prediction, and a distributional regularizer), using no labels and no music-theory vo...