Direct-decision models enable efficient classification and evaluation by selecting from predefined candidates, but their reliability depends on more than prediction accuracy. Across 40 datasets and nine models from the JEV, KEV, and StartLux Decision families, we identify a systematic tendency to underuse ordinal ratin...
Tian-Xiang Gao, Jin-Zhe Li, Zhiyuan Li et al.· 3 citations
Overall, assistant-generated history has active but selective effects on multi-turn performance, motivating selective rather than uniform history management.
Jinnan Li, Zheren Fu, Yue Wang et al.· 0 citations
This work proposes MMPCBench, a comprehensive framework for evaluating MLLMs' proactive critique competence, which adopts a hierarchical evaluation protocol to measure models' error detection, diagnosis and resolution performance, and applies alignment-aware metrics to assess the coherence between internal reasoning an...
Jin-Zhe Li, Geng-Xu Li, Jinnan Li et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.