Lin-Zhuang Zou

MME-Safety: A Fine-grained Benchmark for Safety Evaluation of MLLMs

This work proposes MME-Safety, a rigorously verified benchmark featuring a unique four-dimensional annotation schema that categorizes risk scenarios, harm severity, and modality-specific stealth levels and introduces a hierarchical evaluation framework to assess fundamental response reliability, actual risk exposure, a...