Journal article
Authors list: Steinmetz, Holger
Publication year: 2013
Pages: 1-12
Journal: Methodology. European Journal of Research Methods for the Behavioral and Social Sciences
Volume number: 9
Issue number: 1
ISSN: 1614-1881
eISSN: 1614-2241
DOI Link: https://doi.org/10.1027/1614-2241/a000049
Publisher: PsychOpen
Abstract:
Although the use of structural equation modeling has increased during the last decades, the typical procedure to investigate mean differences across groups is still to create an observed composite score from several indicators and to compare the composite's mean across the groups. Whereas the structural equation modeling literature has emphasized that a comparison of latent means presupposes equal factor loadings and indicator intercepts for most of the indicators (i.e., partial invariance), it is still unknown if partial invariance is sufficient when relying on observed composites. This Monte-Carlo study investigated whether one or two unequal factor loadings and indicator intercepts in a composite can lead to wrong conclusions regarding latent mean differences. Results show that unequal indicator intercepts substantially affect the composite mean difference and the probability of a significant composite difference. In contrast, unequal factor loadings demonstrate only small effects. It is concluded that analyses of composite differences are only warranted in conditions of full measurement invariance, and the author recommends the analyses of latent mean differences with structural equation modeling instead.
Citation Styles
Harvard Citation style: Steinmetz, H. (2013) Analyzing Observed Composite Differences Across Groups Is Partial Measurement Invariance Enough?, Methodology, 9(1), pp. 1-12. https://doi.org/10.1027/1614-2241/a000049
APA Citation style: Steinmetz, H. (2013). Analyzing Observed Composite Differences Across Groups Is Partial Measurement Invariance Enough?. Methodology. 9(1), 1-12. https://doi.org/10.1027/1614-2241/a000049
Keywords
composite scores; CONFIRMATORY FACTOR-ANALYSIS; CONSTRUCTS; COVARIANCE; cross-cultural research; differential item functioning; EQUIVALENCE; group differences; INTELLIGENCE; item response theory; mean differences; MEASUREMENT INVARIANCE; ORGANIZATIONAL RESEARCH; PSYCHOLOGY; test bias