Sehee Hong

Can Large Language Model-Generated Responses Support Assessment Development? A Human-Calibrated Rasch Benchmark

Large language models had high internal consistency but used the lowest category in 0.2% of responses versus 13.7-21.5% for humans, and no persona chose it on every item, indicating responses more predictable than the Rasch model expects.