Learning from multimodal pseudo-labels for robust open-vocabulary instance and panoptic segmentation
This work addresses the challenge of open-vocabulary instance segmentation and open-set panoptic segmentation, which aim to recognize both predefined and unseen object categories without exhaustive human annotations, with a multimodal framework that leverages pre-trained vision-language models for automatic pseudo-labe...