This work proposes ReMAP (Reasoning-Time Memory-Augmented Perception), which couples two complementary latent memories: a static, question-conditioned Global memory that preserves scene and cross-image context and a dynamic Local memory that uses this context as an anchor while selecting and re-encoding region-level ev...
Hao-Wen Jiang, Zhan-Yu Guo, Chen-Wei Wu et al.· 0 citations
Multimodal large language models (MLLMs) have demonstrated impressive performance in multimodal understanding, but processing large numbers of visual tokens results in high computational costs. While many methods have been proposed to reduce the number of visual tokens, most of them rely on heuristics and are prone to...
Ting-Hao Wang, Yi-Chen Guo, Qi-Zhe Zhang et al.· 0 citations
These findings show that effective pruning should preserve broad visual coverage before fusion and progressively refine the retained tokens as cross-modal evidence evolves during fusion, and propose STAR-Pro (STage-Wise Adaptive Token Reduction with Progressive Refinement), a training-free two-stage framework.
Yi-Chen Guo, Ting-Hao Wang, Qi-Zhe Zhang et al.· 1 citation
Improved text-visual attention patterns are introduced to enhance the fidelity of query-aware vision token selection and the Attention Gravity effect is correct, and a rank-based strategy to adaptively determine the sparsification ratio for each layer is introduced.
Yuan Zhang, Junpeng Ma, Qizhe Zhang et al.· IEEE Transactions on Pattern...· 2 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.