The Attention Triangle in Audio-Video Models
It is revealed that routing along the audio-video edge is bidirectional: audio can influence video generation, while video can influence audio generation, and biases encoded in the model's parameters and emerges as a major contributor to leakage.
Sagi Polaczek, Noa Kraicer, G. Metzer et al.
· 1 citation