Yao Shi

Progressive Multi-Layer Decoupling for Spatially-Enhanced Open-Vocabulary Perception

Scaling up vision-language models like CLIP for dense prediction tasks has recently gained considerable attention. DeCLIP builds upon this direction by decoupling the self-attention mechanism in the final transformer layer to separate content and context representations. However, evidence suggests that different layers...