Attention Switch is All You Need: Collaborative Token and KV Compression for Long Video Inference in Hybrid MLLMs
Multimodal Large Language Models (MLLMs) often adopt a hybrid Mamba-Transformer architecture to balance accuracy and inference efficiency. However, when processing long-video inputs, the interdependence between Mamba and Transformer layers renders traditional optimization techniques ineffective, as they are designed ex...