Pengcheng Wen

Omni-RewardBench: Toward a Comprehensive Evaluation of Generative Reward Models Across Modalities

Omni-RewardBench is introduced, the first benchmark for comprehensive evaluation of ORMs across modalities and demonstrates that current OLLMs fall short as reward models, revealing several common failure modes such as perception failure, modality dominance failure, and cross-modal fusion failure.