Test-retest reliability on the Cambridge Neuropsychological Test Automated Battery: Comment on Karlsen et al. (2020)
Autor: | Elizabeth A. Baker, Kiri Granger, Caroline Skirrow, Francesca Cormack, Sally Jennings, Jennifer H. Barnett, Nathan Cashdollar |
---|---|
Rok vydání: | 2021 |
Předmět: |
Adult
Psychometrics Cambridge Neuropsychological Test Automated Battery Applied psychology Neuropsychology Reproducibility of Results Cognition Neuropsychological Tests Test (assessment) Neuropsychology and Physiological Psychology Developmental and Educational Psychology Humans Psychology Reliability (statistics) |
Zdroj: | Applied Neuropsychology: Adult. 29:889-892 |
ISSN: | 2327-9109 2327-9095 |
Popis: | Test-retest reliability is essential to the development and validation of psychometric tools. Here we respond to the article by Karlsen et al. (Applied Neuropsychology: Adult, 2020), reporting test-retest reliability on the Cambridge Neuropsychological Test Automated Battery (CANTAB), with results that are in keeping with prior research on CANTAB and the broader cognitive assessment literature. However, after adopting a high threshold for adequate test-retest reliability, the authors report inadequate reliability for many measures. In this commentary we provide examples of stable, trait-like constructs which we would expect to remain highly consistent across longer time periods, and contrast these with measures which show acute within-subject change in response to contextual or psychological factors. Measures characterized by greater true within-subject variability typically have lower test-retest reliability, requiring adequate powering in research examining group differences and longitudinal change. However, these measures remain sensitive to important clinical and functional outcomes. Setting arbitrarily elevated test-retest reliability thresholds for test adoption in cognitive research limits the pool of available tools and precludes the adoption of many well-established tests showing consistent contextual, diagnostic, and treatment sensitivity. Overall, test-retest reliability must be balanced with other theoretical and practical considerations in study design, including test relevance and sensitivity. |
Databáze: | OpenAIRE |
Externí odkaz: |