Class-Incremental Learning (CIL) aims to learn new classes continuously without forgetting the previously learned ones. Recent works in CIL have significantly advanced across various modalities; however, at the intersection of audio-visual modality, this problem remains underexplored. While representations from multimo...
Avi Gupta, Nilotpal Sinha, Vishnu Raj et al.· 0 citations
Open-Vocabulary Audio-Visual Event Localization (OV-AVEL) labels each video segment with an event class, including classes that were never seen during training. The dominant pipeline uses a frozen multimodal foundation model (e.g. ImageBind) to embed the visual frame, the audio mel-spectrogram, and each candidate class...
A. Praveen, Koteswar Rao Jerripothula, Pratik Joshi et al.· 0 citations
This work proposes SELECT, a novel approach for Selective Context Transfer, which instead grounds each new class in a small set of semantically similar past classes, and adds a controlled noise perturbation and a margin-transfer loss that enforces separation between the new class token and its source tokens.
Avi Gupta, Saurabh Yadav, Koteswar Rao Jerripothula et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.