SinkPruner: Sink-Free Visual Token Pruning for Multimodal Large Language Models
SinkPruner is proposed, a training-free visual token pruning framework for efficient MLLM inference that follows a coarse-to-fine design with two key modules: a visual sanitizer that filters high-norm redundancies and alleviates attention sink and attention dispersion, and a text-guided pruner that further retains toke...
Shi-Yu Li, Zi-Yuan Hu, Shijia Huang et al.
· 2 citations