TACO: Training-free Sound Prompted Segmentation via Semantically Constrained Audio-visual CO-factorization
This work introduces a training-free approach that leverages Non-negative Matrix Factorization (NMF) to co-factorize audio and visual features from pre-trained models so as to reveal shared interpretable concepts and establishes state-of-the-art performance in unsupervised sound-prompted segmentation.