AUTHOR=Grootswagers Tijl , Robinson Amanda K. 

TITLE=Overfitting the Literature to One Set of Stimuli and Data

JOURNAL=Frontiers in Human Neuroscience

VOLUME=15

YEAR=2021

URL=https://www.frontiersin.org/journals/human-neuroscience/articles/10.3389/fnhum.2021.682661

DOI=10.3389/fnhum.2021.682661

ISSN=1662-5161

ABSTRACT=<p>A large number of papers in Computational Cognitive Neuroscience are developing and testing novel analysis methods using one specific neuroimaging dataset and problematic experimental stimuli. Publication bias and confirmatory exploration will result in overfitting to the limited available data. We highlight the problems with this specific dataset and argue for the need to collect more good quality open neuroimaging data using a variety of experimental stimuli, in order to test the generalisability of current published results, and allow for more robust results in future work.</p>