Statistical significance criteria for the rWG and average deviation interrater agreement indices

• Autores: Kristin Smith-Crowe, Michael J. Burke, Ayala Cohen, Etti Doveh
• Localización: Journal of Applied Psychology, ISSN-e 1939-1854, Vol. 99, Nº. 2, 2014, págs. 239-261
• Idioma: inglés
• Texto completo no disponible (Saber más ...)
• Resumen

  • Despite the widespread use of interrater agreement statistics for multilevel modeling and other types of research, the existing guidelines for inferring the statistical significance of interrater agreement are quite limited. They are largely relevant only under conditions that numerous researchers have argued rarely exist. Here we address this problem by generating guidelines for inferring statistical significance under a number of conditions via a computer simulation. As a set, these guidelines cover many of the conditions researchers commonly face. We discuss how researchers can use the guidelines presented to more reasonably infer the statistical significance of interrater agreement relative to using the limited guidelines available in the extant literature. (PsycINFO Database Record (c) 2014 APA, all rights reserved)