Gábor Csifcsák1
Nya Mehnwolo Boayue1
Per M. Aslaksen1
Zsolt Turi2
Andrea Antal2
Josephine Groot1,3
Guy E. Hawkins4
Birte U. Forstmann3
Alexander Opitz5
Axel Thielscher6,7
Matthias Mittner1*- 1Department of Psychology, UiT The Arctic University of Norway, Tromsø, Norway
- 2Department of Clinical Neurophysiology, University Medical Center Goettingen, Göttingen, Germany
- 3Integrative Model-based Cognitive Neuroscience Research Unit, University of Amsterdam, Amsterdam, Netherlands
- 4School of Psychology, University of Newcastle, Newcastle, NSW, Australia
- 5Department of Biomedical Engineering, University of Minnesota, Minneapolis, MN, United States
- 6Danish Research Centre for Magnetic Resonance, Copenhagen University Hospital, Hvidovre, Denmark
- 7Department of Electrical Engineering, Technical University of Denmark, Kongens Lyngby, Denmark
A Commentary on
Transcranial stimulation of the frontal lobes increases propensity of mind-wandering without changing meta-awareness
by Axelrod, V., Zhu, X., and Qui, J. (2018). Sci. Rep. 8:15975. doi: 10.1038/s41598-018-34098-z
William James famously described attention as the process of “taking possession of the mind, in clear and vivid form, of one out of what seem several simultaneously possible objects or trains of thought” (James, 1890). Although put into words more than 125 years ago, this brilliant insight captures many aspects of human cognition that puzzle researchers even today. The process of how we select between different trains of thought and might become preoccupied with internally generated mental experiences is most commonly referred to as mind wandering (MW). Given that activity in the dorsolateral prefrontal cortex (DLPFC) has been linked to the onset and maintenance of MW episodes (Christoff et al., 2009; Smallwood et al., 2011; Mittner et al., 2014, 2016), non-invasive brain stimulation over that structure seems to be a suitable technique to interfere with MW. This approach can provide a causal link between DLPFC activity and MW, which in turn has the potential for developing new interventions to influence attentional lapses in health and disease (Berman et al., 2010; He et al., 2011; Bozhilova et al., 2018).
In 2015, a seminal study reported that anodal transcranial direct current stimulation (tDCS) above the left DLPFC could increase MW propensity in healthy adults (Axelrod et al., 2015). Participants were asked to perform the Sustained Attention to Response Task (SART), while MW was quantified using thought-probes both during and immediately following tDCS. The results of this study, however, were based on very small sample sizes (10–14 participants/group), and it is well-known that such underpowered studies necessarily overestimate effect sizes (Gelman and Carlin, 2014; Minarik et al., 2016). Indeed, Axelrod et al. (2015) reported a disproportionally large effect size of d = 1.24, which by far exceeds typical effect sizes in psychology. Given the current concerns about replicability in psychology (Open Science Collaboration, 2015) and tDCS in particular (Horvath et al., 2015), it is important to replicate the effect found by Axelrod et al. (2015) before drawing firm conclusions. Recently, the first author of the original study reported a successful replication (Axelrod et al., 2018) with the inclusion of a larger sample size (27–30 participants/group) obtaining an effect size of a similar magnitude, d = 0.97. Moreover, the new study was conducted in a different country (China instead of Israel) and language. This second study seems to provide converging evidence for the utility of anodal tDCS above the DLPFC in increasing MW propensity.
Based on our team's own work, here we critically discuss and evaluate concerns about the replicability of the reported effects. When the original study was published, we initiated a pre-registered, multi-site, high-powered replication attempt of that study (Axelrod et al., 2015). Pre-registration is considered to be the best way to perform objective, rigorous, and fully transparent data analysis, to avoid publication bias and thus, to promote publishing research with high replicability (Chambers et al., 2014). In the planning phase we contacted the original authors to ensure that our protocol matched the original protocol as closely as possible. We used Bayesian design analysis so we could quantify both the evidence for or against the efficacy of anodal tDCS relative to sham stimulation in modulating MW, and to provide a more reasonable estimate for the putative effect size (Boayue et al., 2018). The analysis and data-collection plan was pre-registered and accepted at the European Journal of Neuroscience. Subsequently, we collected data in three independent laboratories and across three languages (Dutch, German and Norwegian), with a total of 192 participants. Data analysis was performed in accordance with the pre-registered plan, and all scripts and raw data are available at https://osf.io/dct2r/. Our primary result was evidence for the absence of a facilitatory effect of tDCS on MW propensity. In fact, we even found numerically larger MW scores for sham tDCS, with an effect size estimate of d = −0.11 (although the posterior highest density interval included zero, indicating that this effect may not be robust). A Bayesian measure specifically designed to test replication success (Verhagen and Wagenmakers, 2014) suggested that it is about 500 times more likely that the effect did not replicate (vs. the effect replicated). This was also confirmed by the Bayes Factor quantifying evidence for a null effect (with a value of 10.65), indicating strong evidence against the existence of the effect. These findings were consistent across the three laboratories (Boayue et al., 2018).
Our findings are in stark contrast to (Axelrod et al., 2018) replication attempt. We also note that our study protocol was actually more similar to the original study (Axelrod et al., 2015) than the one used by Axelrod et al. (2018) in their own subsequent replication. For instance, we closely complied with all aspects of the tDCS protocol (except that we implemented a more thorough double-blinding procedure), whereas Axelrod et al. (2018) used longer stimulation times (30 min instead of 20 min) and a larger electrode size above the target region (5 x 7 cm instead of 4 x 4 cm). The functional relevance of these changes for any effect on MW is not clear, but the electric field induced in the brain can vary widely (Csifcsák et al., 2018). Due to the inconsistent use of stimulation parameters, the recent publication by Axelrod et al. (2018) can hardly be regarded a direct replication of the original study. Moreover, the sample size calculation of their replication attempt was based on the originally reported effect size (d = 1), which, as we detailed above, is extremely likely to be overestimated. In this respect, although the estimated sample size of 26 participants/stimulation protocol was met by Axelrod et al. (2018), a more realistic effect size of around 0.4 estimated in tDCS studies (Horvath et al., 2015; Minarik et al., 2016) would require at least 78 participants/group (one-tailed t-test, alpha = 0.05, power = 0.8), which criterion was fulfilled only by our study (96 participants/group). Given that our study design and analysis plan was peer reviewed and pre-registered prior to data collection, was conducted in three independent laboratories, and featured a much larger sample size, we suggest here that it is more likely that the putative effect does not exist.
We believe that one path toward a more detailed perspective on this issue is to perform a meta-analysis across all available datasets so far (we are not aware of any other replication attempts). This analysis would be based on data from a total of 270 participants speaking 5 different languages, recruited from 5 independent laboratories located in different countries. To date, our attempts to obtain the raw data from either of the studies conducted by Axelrod and colleagues have not been fruitful. Given this state of affairs, we therefore conclude that the enthusiasm about the finding by Axelrod et al. (2015) seems to have been premature.
Author Contributions
All authors listed have made a substantial, direct and intellectual contribution to the work, and approved it for publication.
Funding
This work was supported by the Northern Norway Regional Health Authority (grant no. PFP1237-15) for GC and MM. ZT received support from the by the Research Program, University Medical Center, University of Goettingen. AT received support from Lundbeckfonden (R118-A11308) and Novo Nordisk Fonden (BASICS; NNF14OC0011413). The publication charges for this article have been funded by a grant from the publication fund of UiT The Arctic University of Norway.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
Axelrod, V., Rees, G., Lavidor, M., and Bar, M. (2015). Increasing propensity to mind-wander with transcranial direct current stimulation. Proc. Natl. Acad. Sci. U.S.A. 112, 3314–3319. doi: 10.1073/pnas.1421435112
Axelrod, V., Zhu, X., and Qiu, J. (2018). Transcranial stimulation of the frontal lobes increases propensity of mind-wandering without changing meta-awareness. Sci. Rep. 8:15975. doi: 10.1038/s41598-018-34098-z
Berman, M. G., Peltier, S., Nee, D. E., Kross, E., Deldin, P. J., and Jonides, J. (2010). Depression, rumination and the default network. Soc. Cogn. Affect. Neurosci. 6, 548–555. doi: 10.1093/scan/nsq080
Boayue, N., Csifcsák, G., Aslaksen, P., Turi, Z., Antal, A., Groot, J., et al. (2018). Increasing propensity of mind wandering using tDCS. Eur. J. Neurosci. doi: 10.31234/osf.io/dfex3
Bozhilova, N. S., Michelini, G., Kuntsi, J., and Asherson, P. (2018). Mind wandering perspective on attention-deficit/hyperactivity disorder. Neurosci. Biobehav. Rev. 92, 464–476. doi: 10.1016/j.neubiorev.2018.07.010
Chambers, C. D., Feredoes, E., Muthukumaraswamy, S. D., and Etchells, P. (2014). Instead of “playing the game” it is time to change the rules: registered Reports at AIMS Neuroscience and beyond. AIMS Neurosci. 1, 4–17. doi: 10.3934/Neuroscience.2014.1.4
Christoff, K., Gordon, A. M., Smallwood, J., Smith, R., and Schooler, J. W. (2009). Experience sampling during fMRI reveals default network and executive system contributions to mind wandering. Proc. Natl. Acad. Sci. U.S.A. 106, 8719–8724. doi: 10.1073/pnas.0900234106
Csifcsák, G., Boayue, N. M., Puonti, O., Thielscher, A., and Mittner, M. (2018). Effects of transcranial direct current stimulation for treating depression: a modeling study. J. Affect. Disord. 234, 164–173. doi: 10.1016/j.jad.2018.02.077
Gelman, A., and Carlin, J. (2014). Beyond power calculations: assessing type S (Sign) and type M (Magnitude) errors. Perspect. Psychol. Sci. 9:641. doi: 10.1177/1745691614551642
He, J., Becic, E., Lee, Y.-C., and McCarley, J. S. (2011). Mind wandering behind the wheel: performance and oculomotor correlates. Hum Factors 53, 13–21. doi: 10.1177/0018720810391530
Horvath, J. C., Forte, J. D., and Carter, O. (2015). Quantitative review finds no evidence of cognitive effects in healthy populations from single-session transcranial direct current stimulation (tDCS). Brain Stimul. 8, 535–550. doi: 10.1016/j.brs.2015.01.400
Minarik, T., Berger, B., Althaus, L., Bader, V., Biebl, B., Brotzeller, F., et al. (2016). The importance of sample size for reproducibility of tDCS effects. Front. Hum. Neurosci. 10:453. doi: 10.3389/fnhum.2016.00453
Mittner, M., Boekel, W., Tucker, A. M., Turner, B. M., Heathcote, A., and Forstmann, B. U. (2014). When the brain takes a break: a model-based analysis of mind wandering. J. Neurosci. 34, 16286–16295. doi: 10.1523/JNEUROSCI.2062-14.2014
Mittner, M., Hawkins, G. E., Boekel, W., and Forstmann, B. U. (2016). A neural model of mind wandering. Trends Cogn. Sci. 20, 570–578. doi: 10.1016/j.tics.2016.06.004
Open Science Collaboration (2015). Estimating the reproducibility of psychological science. Science 349:aac4716. doi: 10.1126/science.aac4716
Smallwood, J., Brown, K. S., Tipper, C., Giesbrecht, B., Franklin, M. S., Mrazek, M. D., et al. (2011). Pupillometric evidence for the decoupling of attention from perceptual input during offline thought. PLoS ONE 6:e18298. doi: 10.1371/journal.pone.0018298
Keywords: mind wadering, transcranial direct cortical stimulation (tDCS), replication, dorsolateral preforntal cortex (DLPFC), Bayesian analysis
Citation: Csifcsák G, Boayue NM, Aslaksen PM, Turi Z, Antal A, Groot J, Hawkins GE, Forstmann BU, Opitz A, Thielscher A and Mittner M (2019) Commentary: Transcranial stimulation of the frontal lobes increases propensity of mind-wandering without changing meta-awareness. Front. Psychol. 10:130. doi: 10.3389/fpsyg.2019.00130
Received: 05 December 2018; Accepted: 15 January 2019;
Published: 05 February 2019.
Edited by:
Marieke Karlijn Van Vugt, University of Groningen, NetherlandsReviewed by:
Adam Turnbull, University of York, United KingdomMatthew Robison, Arizona State University, United States
David Stawarczyk, University of Liège, Belgium
Copyright © 2019 Csifcsák, Boayue, Aslaksen, Turi, Antal, Groot, Hawkins, Forstmann, Opitz, Thielscher and Mittner. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Matthias Mittner, bWF0dGhpYXMubWl0dG5lckB1aXQubm8=