Data quality and reliability metrics for event-related potentials (ERPs): The utility of subject-level reliability
Autor: | Peter E. Clayson, Christopher J. Brush, Greg Hajcak |
---|---|
Rok vydání: | 2021 |
Předmět: |
Computer science
media_common.quotation_subject education 050105 experimental psychology 03 medical and health sciences 0302 clinical medicine Event-related potential Physiology (medical) Statistical inference Humans 0501 psychology and cognitive sciences Generalizability theory Quality (business) Evoked Potentials Reliability (statistics) media_common General Neuroscience 05 social sciences Multilevel model Reproducibility of Results Electroencephalography Data Accuracy Benchmarking Neuropsychology and Physiological Psychology Data quality Metric (unit) 030217 neurology & neurosurgery Cognitive psychology |
Zdroj: | International Journal of Psychophysiology. 165:121-136 |
ISSN: | 0167-8760 |
DOI: | 10.1016/j.ijpsycho.2021.04.004 |
Popis: | Event-related brain potentials (ERPs) represent direct measures of neural activity that are leveraged to understand cognitive, affective, sensory, and motor processes. Every ERP researcher encounters the obstacle of determining whether measurements are precise or psychometrically reliable enough for an intended purpose. In this primer, we review three types of measurements metrics: data quality, group-level internal consistency, and subject-level internal consistency. Data quality estimates characterize the precision of ERP scores but provide no inherent information about whether scores are precise enough for examining individual differences. Group-level internal consistency characterizes the ratio of between-person differences to the precision of those scores, and provides a single internal consistency estimate for an entire group of participants that risks masking low internal consistency for some individuals. Subject-level internal consistency considers the precision of an ERP score for a person relative to between-person differences for a group, and an estimate is yielded for each individual. We apply each metric to published error-related negativity (ERN) and reward positivity (RewP) data and demonstrate how failing to consider data quality and internal consistency can undermine statistical inferences. We conclude with general comments on how these estimates may be used to improve measurement quality and methodological transparency. Subject-level internal consistency computation is implemented within the ERP Reliability Analysis (ERA) Toolbox. |
Databáze: | OpenAIRE |
Externí odkaz: |