Kwang-Ting Cheng

ProQuant: Progressive Quantization-aware Training for Edge MLLMs

Multi-modal large language models (MLLMs) with impressive perception and understanding capabilities will enable a range of downstream applications. However, their substantial computational and memory requirements hinder the real-world implementation, particularly for resource-constrained edge devices. Quantization has...