Evaluating the Evaluators: Diagnosing Large Multimodal Models for AI-Generated Image Assessment
This work introduces SQUARE-Bench, a comprehensive benchmark that systematically evaluates LMM capabilities as evaluators of AI-generated images across four aspects: Semantics, Quality, Authenticity, and Responsibility, and conducts a proof-of-concept study of LMM-guided iterative editing.