Qi-Feng Lei

UtilityBench: Measuring Language Model Utility When Errors Have Different Costs

As language models are increasingly deployed in real-world scenarios with important outcomes, the impact of their mistakes often extends far beyond what correctness can capture. In domains like medicine, a single error can lead to serious consequences and put patient safety at risk. However, mainstream evaluation proto...