Journal article

Publication year: 2007

Pages: 157-183

Journal: Multivariate Behavioral Research

Volume number: 42

Issue number: 1

ISSN: 0027-3171

DOI Link: https://doi.org/10.1080/00273170701341266

Publisher: Taylor and Francis Group

Abstract: 
Numerous studies have shown increasing item reliabilities as an effect of the item position in personality scales. Traditionally, these context effects are analyzed based on item-total correlations. This approach neglects that trends in item reliabilities can be caused either by an increase in true score variance or by a decrease in error variance. This article presents the Confirmatory Analysis of Item Reliability Trends (CAIRT) that allows estimating both trends separately within a structural equation modeling framework. Results of a simulation study prove the CAIRT method to provide reliable and independent parameter estimates; the power exceeds the analysis of item-total correlations. We present an empirical application to self- and peer ratings collected in an Internet-based experiment. Results show that reliability trends are caused by increasing true score variance in self-ratings and by decreasing error variance in peer ratings.

Harvard Citation style: Hartig, J., Hoelzel, B. and Moosbrugger, H. (2007) A confirmatory analysis of item reliability trends (CAIRT):: Differentiating true score and error variance in the analysis of item context effects, Multivariate Behavioral Research, 42(1), pp. 157-183. https://doi.org/10.1080/00273170701341266

APA Citation style: Hartig, J., Hoelzel, B., & Moosbrugger, H. (2007). A confirmatory analysis of item reliability trends (CAIRT):: Differentiating true score and error variance in the analysis of item context effects. Multivariate Behavioral Research. 42(1), 157-183. https://doi.org/10.1080/00273170701341266