Stoll, Susanne;
Infanti, Elisa;
De Haas, Benjamin;
Schwarzkopf, D Samuel;
(2022)
Pitfalls in post hoc analyses of population receptive field data.
NeuroImage
, 263
, Article 119557. 10.1016/j.neuroimage.2022.119557.
Preview |
Text
2022 - Stoll et al - NeuroImage.pdf - Published Version Download (3MB) | Preview |
Abstract
Data binning involves grouping observations into bins and calculating bin-wise summary statistics. It can cope with overplotting and noise, making it a versatile tool for comparing many observations. However, data binning goes awry if the same observations are used for binning (selection) and contrasting (selective analysis). This creates circularity, biasing noise components and resulting in artifactual changes in the form of regression towards the mean. Importantly, these artifactual changes are a statistical necessity. Here, we use (null) simulations and empirical repeat data to expose this flaw in the scope of post hoc analyses of population receptive field data. In doing so, we reveal that the type of data analysis, data properties, and circular data cleaning are factors shaping the appearance of such artifactual changes. We furthermore highlight that circular data cleaning and circular sorting of change scores are selection practices that result in artifactual changes even without circular data binning. These pitfalls might have led to erroneous claims about changes in population receptive fields in previous work and can be mitigated by using independent data for selection purposes. Our evaluations highlight the urgency for us researchers to make the validation of analysis pipelines standard practice.
Type: | Article |
---|---|
Title: | Pitfalls in post hoc analyses of population receptive field data |
Location: | United States |
Open access status: | An open access version is available from UCL Discovery |
DOI: | 10.1016/j.neuroimage.2022.119557 |
Publisher version: | https://doi.org/10.1016/j.neuroimage.2022.119557 |
Language: | English |
Additional information: | Copyright © 2022 Published by Elsevier Inc. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/). |
Keywords: | Regression towards the mean, Circularity, Double-dipping, Validation, Functional magnetic resonance imaging |
UCL classification: | UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences UCL |
URI: | https://discovery-pp.ucl.ac.uk/id/eprint/10156840 |
Archive Staff Only
![]() |
View Item |