Journal article

Publication year: 2022

Journal: NeuroImage

Volume number: 263

ISSN: 1053-8119

eISSN: 1095-9572

Open access status: Gold

DOI Link: https://doi.org/10.1016/j.neuroimage.2022.119557

Publisher: Elsevier

Abstract: 
Data binning involves grouping observations into bins and calculating bin-wise summary statistics. It can cope with overplotting and noise, making it a versatile tool for comparing many observations. However, data binning goes awry if the same observations are used for binning (selection) and contrasting (selective analysis). This creates circularity, biasing noise components and resulting in artifactual changes in the form of regression towards the mean. Importantly, these artifactual changes are a statistical necessity. Here, we use (null) simulations and empirical repeat data to expose this flaw in the scope of post hoc analyses of population receptive field data. In doing so, we reveal that the type of data analysis, data properties, and circular data cleaning are factors shaping the appearance of such artifactual changes. We furthermore highlight that circular data cleaning and circular sorting of change scores are selection practices that result in artifactual changes even without circular data binning. These pitfalls might have led to erroneous claims about changes in population receptive fields in previous work and can be mitigated by using independent data for selection purposes. Our evaluations highlight the urgency for us researchers to make the validation of analysis pipelines standard practice.

Harvard Citation style: Stoll, S., Infanti, E., de Haas, B. and Schwarzkopf, D. (2022) Pitfalls in post hoc analyses of population receptive field data, NeuroImage, 263, Article 119557. https://doi.org/10.1016/j.neuroimage.2022.119557

APA Citation style: Stoll, S., Infanti, E., de Haas, B., & Schwarzkopf, D. (2022). Pitfalls in post hoc analyses of population receptive field data. NeuroImage. 263, Article 119557. https://doi.org/10.1016/j.neuroimage.2022.119557