To pool or not to pool: Can we ignore cross-trial variability in FMRI?

Autor: Luiz Pessoa, Srikanth Padmala, Yi Chen, Paul A. Taylor, Gang Chen, Robert W. Cox
Jazyk: angličtina
Rok vydání: 2021
Předmět:
Computer science
Cognitive Neuroscience
Pooling
Statistics as Topic
Machine learning
computer.software_genre
050105 experimental psychology
Article
lcsh:RC321-571
03 medical and health sciences
physiology [Brain]
methods [Magnetic Resonance Imaging]
0302 clinical medicine
Econometrics
Humans
0501 psychology and cognitive sciences
Generalizability theory
ddc:610
diagnostic imaging [Brain]
lcsh:Neurosciences. Biological psychiatry. Neuropsychiatry
methods [Functional Neuroimaging]
business.industry
Functional Neuroimaging
05 social sciences
Autocorrelation
Multilevel model
Brain
Reproducibility of Results
Bayes Theorem
Magnetic Resonance Imaging
Neurology
Sample size determination
Data Interpretation
Statistical

Multiple comparisons problem
Outlier
Multilevel Analysis
Artificial intelligence
business
computer
030217 neurology & neurosurgery
Zdroj: NeuroImage, Vol 225, Iss, Pp 117496-(2021)
NeuroImage
NeuroImage 225, 117496-(2021). doi:10.1016/j.neuroimage.2020.117496
ISSN: 1095-9572
DOI: 10.1016/j.neuroimage.2020.117496
Popis: In this work, we investigate the importance of explicitly accounting for cross-trial variability in neuroimaging data analysis. To attempt to obtain reliable estimates in a task-based experiment, each condition is usually repeated across many trials. The investigator may be interested in (a) condition-level effects, (b) trial-level effects, or (c) the association of trial-level effects with the corresponding behavior data. The typical strategy for condition-level modeling is to create one regressor per condition at the subject level with the underlying assumption that responses do not change across trials. In this methodology of complete pooling, all cross-trial variability is ignored and dismissed as random noise that is swept under the rug of model residuals. Unfortunately, this framework invalidates the generalizability from the confine of specific trials (e.g., particular faces) to the associated stimulus category (“face”), and may inflate the statistical evidence when the trial sample size is not large enough. Here we propose an adaptive and computationally tractable framework that meshes well with the current two-level pipeline and explicitly accounts for trial-by-trial variability. The trial-level effects are first estimated per subject through no pooling. To allow generalizing beyond the particular stimulus set employed, the cross-trial variability is modeled at the population level through partial pooling in a multilevel model, which permits accurate effect estimation and characterization. Alternatively, trial-level estimates can be used to investigate, for example, brain-behavior associations or correlations between brain regions. Furthermore, our approach allows appropriate accounting for serial correlation, handling outliers, adapting to data skew, and capturing nonlinear brain-behavior relationships. By applying a Bayesian multilevel model framework at the level of regions of interest to an experimental dataset, we show how multiple testing can be addressed and full results reported without arbitrary dichotomization. Our approach revealed important differences compared to the conventional method at the condition level, including how the latter can distort effect magnitude and precision. Notably, in some cases our approach led to increased statistical sensitivity. In summary, our proposed framework provides an effective strategy to capture trial-by-trial responses that should be of interest to a wide community of experimentalists.
Databáze: OpenAIRE