Journal article

Analyzing Observed Composite Differences Across Groups Is Partial Measurement Invariance Enough?


Authors listSteinmetz, Holger

Publication year2013

Pages1-12

JournalMethodology. European Journal of Research Methods for the Behavioral and Social Sciences

Volume number9

Issue number1

ISSN1614-1881

eISSN1614-2241

DOI Linkhttps://doi.org/10.1027/1614-2241/a000049

PublisherPsychOpen


Abstract
Although the use of structural equation modeling has increased during the last decades, the typical procedure to investigate mean differences across groups is still to create an observed composite score from several indicators and to compare the composite's mean across the groups. Whereas the structural equation modeling literature has emphasized that a comparison of latent means presupposes equal factor loadings and indicator intercepts for most of the indicators (i.e., partial invariance), it is still unknown if partial invariance is sufficient when relying on observed composites. This Monte-Carlo study investigated whether one or two unequal factor loadings and indicator intercepts in a composite can lead to wrong conclusions regarding latent mean differences. Results show that unequal indicator intercepts substantially affect the composite mean difference and the probability of a significant composite difference. In contrast, unequal factor loadings demonstrate only small effects. It is concluded that analyses of composite differences are only warranted in conditions of full measurement invariance, and the author recommends the analyses of latent mean differences with structural equation modeling instead.



Citation Styles

Harvard Citation styleSteinmetz, H. (2013) Analyzing Observed Composite Differences Across Groups Is Partial Measurement Invariance Enough?, Methodology, 9(1), pp. 1-12. https://doi.org/10.1027/1614-2241/a000049

APA Citation styleSteinmetz, H. (2013). Analyzing Observed Composite Differences Across Groups Is Partial Measurement Invariance Enough?. Methodology. 9(1), 1-12. https://doi.org/10.1027/1614-2241/a000049



Keywords


composite scoresCONFIRMATORY FACTOR-ANALYSISCONSTRUCTSCOVARIANCEcross-cultural researchdifferential item functioningEQUIVALENCEgroup differencesINTELLIGENCEitem response theorymean differencesMEASUREMENT INVARIANCEORGANIZATIONAL RESEARCHPSYCHOLOGYtest bias

Last updated on 2025-02-04 at 02:34