Traditional Item Response Theory (IRT) parameters for item difficulty and discrimination often depend heavily on the specific assumptions and constraints of the chosen model. This study introduces and evaluates population difficulty and population discrimination as complementary metrics that generalize across dichotomous and polytomous item types and apply to both unidimensional and multidimensional models. These metrics can be used independently or as a complement to traditional parameters. They also readily extend to semiparametric or nonparametric modeling approaches. We compare the population‐based metrics to traditional item parameters through a series of simulations and an empirical example. Our findings suggest that population‐based metrics are robust metrics for evaluating item characteristics across a variety of different populations or IRT models.
Calibrating item response theory models is challenging when item banks are large relative to available sample sizes and response data are sparsely observed, as commonly occurs in classroom assessment, low-stakes testing, and early-stage item bank development. These challenges are particularly pronounced for the two-par...
Shi-Yu Wang, Cong Cheng, Yuan Ke et al.· Multivariate Behavioral Rese...· 0 citations
Idiographic theories of psychological measurement emphasize that the relationships between item responses and a latent trait may vary across individuals, yet typical item response theory (IRT) models assume item parameters are constant across persons. We propose an IRT approach for modeling person-specific (idiographic...
Joshua B. Gilbert, Edward J. Kim, Zachary Himmelsbach et al.· Multivariate Behavioral Rese...· 0 citations
Classification consistency evaluates the degree of consistency of the classifications based on observed scores from repeated testing. The classification consistency index is often used in practice for tests that categorize examinees into two or more categories with respect to a specific standard. In this paper, the asy...
Kyung Yong Kim· Journal of educational and b...· 0 citations
As adaptive testing and learning systems proliferate, efficient item calibration is a pressing need. The Elo rating system jointly estimates student ability and item difficulty, offering an alternative to item response theory (IRT) models. Yet existing multidimensional extensions have mainly focused on ability trac...
Jia-Hui Zhang, Yu-Qing Yuan, Fu-Hang Zhang et al.· Frontiers in Psychology· 0 citations
Area measures for differential item functioning and differential test functioning are conventionally defined as functions of the difference in item response functions. This probability scale may be less convenient for interpretation than an assessment carried out on the logit scale of the latent variable θ. This articl...
Alexander Robitzsch· Mathematics· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
