Journal article

Publication year: 2017

Pages: 819-834

Journal: Psychological Assessment

Volume number: 29

Issue number: 6

ISSN: 1040-3590

eISSN: 1939-134X

DOI Link: https://doi.org/10.1037/pas0000426

Publisher: American Psychological Association

Abstract: 
This meta-analysis synthesizes research on interrater reliability of Criteria-Based Content Analysis (CBCA). CBCA is an important component of Statement Validity Assessment (SVA), a forensic procedure used in many countries to evaluate whether statements (e. g., of sexual abuse) are based on experienced or fabricated events. CBCA contains 19 verbal content criteria, which are frequently adapted for research on detecting deception. A total of k = 82 hypothesis tests revealed acceptable interrater reliabilities for most CBCA criteria, as measured with various indices (except Cohen's kappa). However, results were largely heterogeneous, necessitating moderator analyses. Blocking analyses and metaregression analyses on Pearson's r resulted in significant moderators for research paradigm, intensity of rater training, type of rating scale used, and the frequency of occurrence (base rates) for some CBCA criteria. The use of CBCA summary scores is discouraged. Implications for research vs. field settings, for future research and for forensic practice in the United States and Europe are discussed.

Harvard Citation style: Hauch, V., Sporer, S., Masip, J. and Blandon-Gitlin, I. (2017) Can Credibility Criteria Be Assessed Reliably? A Meta-Analysis of Criteria-Based Content Analysis, Psychological Assessment, 29(6), pp. 819-834. https://doi.org/10.1037/pas0000426

APA Citation style: Hauch, V., Sporer, S., Masip, J., & Blandon-Gitlin, I. (2017). Can Credibility Criteria Be Assessed Reliably? A Meta-Analysis of Criteria-Based Content Analysis. Psychological Assessment. 29(6), 819-834. https://doi.org/10.1037/pas0000426