HumanStudy-Bench: Towards AI Agent Design for Participant Simulation
This work introduces an open platform and execution engine designed for practitioners to develop and evaluate agents tailored to their target experimental settings, and introduces two complementary metrics that quantify agreement with humans on both the significance conclusion and the effect size.