Advanced Psychometrics and Latent Variable Modeling
Item Response Theory (IRT)
The 2-Parameter Logistic Model
Unlike Classical Test Theory (CTT), IRT models the non-linear relationship between a latent trait and the probability of endorsing a specific response. The 2-Parameter Logistic (2PL) model is defined mathematically as: where represents item discrimination and represents item difficulty.
IRT Parameters
Measurement Invariance
A test must measure the same construct in the same way across different subpopulations. If item parameters vary across groups (e.g., gender or culture) when controlling for the latent trait, the test exhibits Differential Item Functioning (DIF).
In the 2PL Item Response Theory model, what does the parameter represent?
The parameter is the slope of the Item Characteristic Curve (ICC) at the inflection point, representing how well the item discriminates between different levels of the latent trait .
Correct answer: Item discrimination
What acronym is used to describe when an item functions differently for different demographic groups who are matched on the underlying latent trait?
Differential Item Functioning (DIF) occurs when the probability of endorsing an item differs between groups despite having the same level of the latent trait.
Correct answer: DIF
Steps for Testing Measurement Invariance (MGCFA)
-
1
Configural Invariance: Test if the basic factor structure is the same across groups.
-
2
Metric (Weak) Invariance: Constrain factor loadings to be equal across groups.
-
3
Scalar (Strong) Invariance: Constrain item intercepts to be equal across groups.
-
4
Strict Invariance: Constrain residual variances to be equal across groups.