Current value alignment evaluations for large language models (LLMs) heavily rely on output compliance, overlooking whether LLMs maintain value consistency when alternating between generator and evaluator roles. Such consistency is increasingly important because modern LLM agents and alignment pipelines often rely on t...
Jun-Ru Wu, Jing-Ting Zheng, Yu-Qi Ren et al.· 0 citations
F2DR evaluates DeepSearch workflows across three dimensions: Content, Trajectory, and Answer, enabling comprehensive process-level assessment, and constructs DeepSearch RM-Bench, a dedicated benchmark for evaluating RMs in DeepSearch scenarios.
Bo-Jian Xiong, Wen-Tao Ding, Yu-Jing Lu et al.· 0 citations
Experimental results demonstrate that D2VBench exhibits high reliability and robustness, effectively reflecting the LLMs'alignment across different value categories and dimensions, and providing a more realistic and fine-grained tool for research on value alignment.
Siyi Hao, Yidi Cao, Linhao Yu et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.