Detection-Guided Attention Steering for Vision Language Models
A detection-guided dynamic attention steering system that leverages the locality insight from CNNs to efficiently steer a VLM’s attention toward more relevant sections of an image and demonstrates the effectiveness of combining different model architectures to harness their respective strengths for advancing VLM capabi...
Alan William Zhang, Rui Pan, Mike Wong et al.
· 0 citations