With the continuous expansion of tomato cultivation, early identification and accurate control of diseases are crucial for reducing economic losses and ensuring food security. However, in natural scenarios such as greenhouses and fields, challenges like complex backgrounds, drastic lighting changes, and limited computi...
JudgeProfile is introduced, a framework that dissects LLM evaluation into perception (how a judge compares two responses across specific attributes like clarity, correctness, and detail) and prioritization (how much each attribute influences the final choice) and finds a hidden consensus in perception.
Qiong-Qiong Cao, Kang-Ni Liu, Xuan Kan et al.· 0 citations
LLM judges are inherently subjective, often favoring different responses in pairwise comparison when neither option is objectively wrong. To study this subjectivity, we introduce JudgeProfile, a framework that dissects LLM evaluation into perception (how a judge compares two responses across specific attributes like cl...
Qiong-Qiong Cao, Kang-Ni Liu, Xuan Kan et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.