MME-Safety: A Fine-grained Benchmark for Safety Evaluation of MLLMs
This work proposes MME-Safety, a rigorously verified benchmark featuring a unique four-dimensional annotation schema that categorizes risk scenarios, harm severity, and modality-specific stealth levels and introduces a hierarchical evaluation framework to assess fundamental response reliability, actual risk exposure, a...
Yi Shi, Yueming Lyu, Hao-Xiang Tan et al.
· 0 citations