Chengyu Wu

DA-RAC: Distance-Aware Calibration of LLM Judges for Trustworthy AI Auditing

Generative AI systems are increasingly producing real-world artifacts, however their efficacy and validity are often evaluated via context-free LLM-scoring. These judges can be miscalibrated by irrelevant in-context reference examples, creating false confidence and allowing low-quality or harmful outputs to pass evalua...