Interobserver agreement: A preliminary investigation into how much is enough?

Autor:	Madeleine Guell, Molly K. Bednar, Erin Schaller, Noor Javed, Nicole L. Hausman, Sung Woo Kahng, Rose E. Nevill
Rok vydání:	2021
Předmět:	Observer Variation 050103 clinical psychology Data collection Sociology and Political Science 05 social sciences Philosophy Behavioral data Consistency (statistics) Statistics Humans 0501 psychology and cognitive sciences Psychology Applied Psychology Reliability (statistics)
Zdroj:	Journal of Applied Behavior Analysis. 55:357-368
ISSN:	1938-3703 0021-8855
DOI:	10.1002/jaba.811
Popis:	Interobserver agreement (IOA) is important for research and practice, and supports the consistency of behavioral data (Kahng et al., 2011). Although general parameters for how much IOA is needed have been suggested (Bailey & Burch, 2018), it is unknown if the total number of sessions with IOA might impact the IOA coefficient. In this study, IOA was reanalyzed using functional analysis data at various cutoffs. Obtained IOA from these analyses was then compared to the original IOA. Overall, results suggested that, at least when using highly trained observers in a structured clinical setting, there were no significant differences in IOA across cutoffs. However, IOA was sensitive to overall rate of responding in the functional analysis. These data are encouraging, particularly for practitioners, because they provide preliminary support that the amount of sessions with IOA may not be as important as the consistency of the data.
Databáze:	OpenAIRE
Externí odkaz:	https://explore.openaire.eu/search/publication?articleId=doi_dedup___::224a74c098dd44259cd378b517036f7f https://doi.org/10.1002/jaba.811 Zobrazit plný text záznamu Plný text