Does Model Uncertainty Track Human Ambiguity? Evidence from Multi-Annotator Vision Benchmarks
This work evaluates eight pretrained models across three architectures to investigate whether model uncertainty (softmax confidence, entropy, entropy) correlates with human disagreement, and finds that it does not: alignment is weak in both dimensions.