This article is a commentary on:
Exercise-dependent BDNF as a Modulatory Factor for the Executive Processing of Individuals in Course of Cognitive Decline. A Systematic Review
Felipe Stigger
Miriam A. Z. Marcolino
Rodrigo D. M. Plentz- 1Departament of Physiotherapy, Federal University of Health Sciences of Porto Alegre, Rio Grande do Sul, Brazil
- 2Postgraduate Program in Rehabilitation Sciences, Federal University of Health Sciences of Porto Alegre, Porto Alegre, Brazil
A commentary on
Exercise-dependent BDNF as a Modulatory Factor for the Executive Processing of Individuals in Course of Cognitive Decline. A Systematic Review
by de Assis, G. G. and Almondes, K. M. (2017). Front. Psychol. 8:584. doi: 10.3389/fpsyg.2017.00584
The study of de Assis and de Almondes, 2017 fits the growing research movement regarding the effects of exercise over brain-derived neurotrophic factor (BDNF) and cognitive function in elderly. We read it with great interest and would like to elicit some concerning points about methodological principles applied to conduct the presented systematic review.
Systematic reviews are considered to provide the highest level of evidence for assessing the effectiveness of therapeutic interventions (Liberati et al., 2009; Oh, 2016). A systematic review, typically involves a well-defined, established, transparent and replicable method derived a priori, aiming to reduce bias through identifying, appraising, and synthesizing all potentially relevant studies on a particular topic of interest (Uman, 2011; Impellizzeri and Bizzini, 2012). Several resources are available defining methodological principles to help authors prepare and conduct a systematic review (Liberati et al., 2009; Oh, 2016).
To ensure the integrity of the design and conduction of the review, PROSPERO registration and PRISMA statement should always be used (Harris et al., 2017). Although not mandatory, registration ideally takes place before the researchers have started formal screening against inclusion criteria (Booth et al., 2012) guaranteeing that a systematic review is carefully planned and consistently conducted by the review team avoiding arbitrariness in decision-making with respect to inclusion criteria and data extraction (Shamseer et al., 2015). Although de Assis and Almondes registered their review protocol (CRD42016050017) there are discrepancies between the protocol and published review. By the end, the authors followed neither methodological description.
In our point of view, the main weaknesses of de Assis and Almondes' original article are: (1) the definition and pursuit of the research question, (2) fails to meet established eligibility criteria and (3) lack of methodological quality assessment of the included studies.
The research question distinguishes a systematic review from a narrative one and guides the search strategy and eligibility criteria. It generally contains a careful selection of PICO(S) criteria (Participants, Intervention(s), Comparator(s), Outcome(s), and Study Design) (Higgins and Green, 2011). Choosing these components provides an effective search and maximizes retrieving potential articles (Santos et al., 2007). An adequate search use internationally acknowledged keywords, and generally include several relevant electronic databases. A full search strategy description, for at least one database, enhances results reproducibility (Moher et al., 2009). However, de Assis and Almondes presented a confusing search strategy, making it difficult to replicate.
Although, de Assis and Almondes' review gives impression of inclusion of three different databases (“PubMed, Scopus and MEDLINE”), MEDLINE is the primary component of PubMed. Even accessing MEDLINE through other interface, its results are already covered in PubMed search. Also, accordingly to Cochrane, three main databases (MEDLINE, EMBASE, and CENTRAL) are recommended to find relevant studies (Chandler et al., 2013). In further analysis, to verify if potential studies were ignored in the database search choice, we adjusted their search strategy to EMBASE and CENTRAL, and found more than 1,000 records, a number more than three times higher than those pointed out by authors in their broad search. This may have led to errors in eligibility and inclusion of studies.
According to eligibility criteria, author cited that retrieved studies should “fully” meet the following inclusion criteria: aging subjects with cognitive impairments or dementia; at least one session of exercise; comparator criteria not presented; pre-post measures of BDNF and reported parameters of executive functions.
Misjudgments are noticeable considering eligibility criteria indicated above and, following the established, only Baker et al. (2010) and Nascimento et al. (2014) fully meet inclusion criteria. Tree studies do not include elderly with cognitive impairment defined as participant criteria. Ruscheweyh et al. (2011) excluded individuals with cognitive impairment and dementia (confirmed by Mini-Mental State Examination). Vaughan et al. (2014) stated as exclusion criteria individuals with cognitive impairment and dementia. And, although Anderson-Hanley et al. (2012) did not report cognitive impairment as exclusion criteria, only 38% of included participants presented mild cognitive impairment.
Inconsistencies are also related to intervention and outcome criteria. Even though exercise type was not determined by de Assis and Almondes as the intervention criteria, retrieved studies only reported aerobic training and three resistance training studies were excluded, as observed on selection process flow-chart. Moreover, measures of BDNF and executable functions must be performed pre and post exercise protocol, but Suzuki et al. (2013) reported only baseline BDNF measurement. Also, the absences of outcomes, other than executable functions, in inclusion criteria turn it difficult to confirm author's hypothesis “that increments in domains of executable functions due to the exercise regulation of BDNF in aging individuals undergoing cognitive decline depend on greater amounts of exercise-dependent BDNF stimuli than do those of memory and cognitive processing.”
As a final point, it is important to emphasize that de Assis and Almondes did not assess risk of bias of included studies. There is broad consensus among the scientific community on the relevance of assessing the methodological quality of the studies, especially when carrying out a research synthesis (Johnson et al., 2015). Problems with the design and execution of individual studies raise questions about the validity of their findings, as bias may lead them to overestimate or underestimate the true intervention effect (Higgins and Green, 2011). Tough, ignoring this process, authors did not considered the quality of the results polled in their review which could result in questionable conclusion about interventions effectiveness.
In sum, for all of the reasons stated above, we genuinely believe that it is important to point methodological issues regarding the conduction of systematic reviews aiming to improve quality of evidence synthesis that provide subsides to the evidence-based practice. Although we have outlined some major points in which we disagree in the de Assis and Almondes's review, we agree that “exercise influence on cognition is still a poorly explored field” and, even more importantly, that “further experimental research should concern better control.” Those statements provide courses on which any future research might proceed.
Author Contributions
FS contributed to the idea and writing. MM and RP contributed to the writing.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
Anderson-Hanley, C., Arciero, P. J., Brickman, A. M., Nimon, J. P., Okuma, N., Westen, S. C., et al. (2012). Exergaming and older adult cognition: a cluster randomized clinical trial. Am. J. Prev. Med. 42, 109–119. doi: 10.1016/j.amepre.2011.10.016
Baker, L. D., Frank, L. L., Foster-Schubert, K., Green, P. S., Wilkinson, C. W., McTiernan, A., et al. (2010). Effects of aerobic exercise on mild cognitive impairment. Arch. Neurol. 67, 71–79. doi: 10.1001/archneurol.2009.307
Booth, A., Clarke, M., Dooley, G., Ghersi, D., Moher, D., Petticrew, M., et al. (2012). The nuts and bolts of PROSPERO: an international prospective register of systematic reviews. Syst. Rev. 1:2. doi: 10.1186/2046-4053-1-2
Chandler, J., Churchill, R., Higgins, J., Lasserson, T., and Tovey, D. (2013). Methodological Standards for the Conduct of New Cochrane INTERVENTION Reviews. London, UK: Cochrane.
de Assis, G. G., and de Almondes, K. M. (2017). Exercise-dependent BDNF as a Modulatory Factor for the Executive Processing of Individuals in Course of Cognitive Decline. A Systematic Review. Front. Psychol. 8:584. doi: 10.3389/fpsyg.2017.00584
Harris, J. D., Brand, J. C., Cote, M. P., and Dhawan, A. (2017). Research pearls: the significance of statistics and perils of pooling. part 3: pearls and pitfalls of meta-analyses and systematic reviews. Arthroscopy. 33, 1594–1602. doi: 10.1016/j.arthro.2017.01.055
Higgins, J. P., and Green, S. (2011). Cochrane Handbook for Systematic Reviews of Interventions. John Wiley & Sons. Available online at: http://www.cochrane-handbook.org.
Impellizzeri, F. M., and Bizzini, M. (2012). Systematic review and meta-analysis: a primer. Int. J. Sports Phys. Ther. 7, 493–503.
Johnson, B. T., Low, R. E., and MacDonald, H. V. (2015). Panning for the gold in health research: Incorporating studies' methodological quality in meta-analysis. Psychol. Health 30, 135–152. doi: 10.1080/08870446.2014.953533
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., et al. (2009). The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J. Clin. Epidemiol. 62, 1–34. doi: 10.1016/j.jclinepi.2009.06.006
Moher, D., Liberati, A., Tetzlaff, J., and Altman, D. G., and PRISMA Group. (2009). Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 6:e1000097. doi: 10.1371/journal.pmed.1000097
Nascimento, C. M. C., Pereira, J. R., de Andrade, L. P., Garuffi, M., Talib, L. L., Forlenza, O. V., et al. (2014). Physical exercise in mci elderly promotes reduction of pro-inflammatory cytokines and improvements on cognition and bdnf peripheral levels. Curr. Alzheimer Res. 11, 799–805. doi: 10.2174/156720501108140910122849
Oh, E. G. (2016). Synthesizing quantitative evidence for evidence-based nursing: systematic review. Asian Nurs. Res. 10, 89–93. doi: 10.1016/j.anr.2016.05.001
Ruscheweyh, R., Willemer, C., Krüger, K., Duning, T., Warnecke, T., Sommer, J., et al. (2011). Physical activity and memory functions: an interventional study. Neurobiol. Aging 32, 1304–1319. doi: 10.1016/j.neurobiolaging.2009.08.001
Santos, C. M. C., Pimenta, C. A. M., and Nobre, M. R. C. (2007). The PICO strategy for the research question construction and evidence search. Rev. Lat. Am. Enfermagem 15, 508–511. doi: 10.1590/S0104-11692007000300023
Shamseer, L., Moher, D., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., et al. (2015). Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: elaboration and explanation. BMJ 349:g7647. doi: 10.1136/bmj.g7647
Suzuki, T., Shimada, H., Makizako, H., Doi, T., Yoshida, D., Ito, K., et al. (2013). A randomized controlled trial of multicomponent exercise in older adults with mild cognitive impairment. PLoS ONE 8:e61483. doi: 10.1371/journal.pone.0061483
Uman, L. S. (2011). Systematic reviews and meta-analyses. J. Can. Acad. Child Adolesc. Psychiatry 20, 57–59.
Keywords: executive function, brain-derived neurotrophic factor, exercise, aged, cognition
Citation: Stigger F, Marcolino MAZ and Plentz RDM (2017) Commentary: Exercise-dependent BDNF as a Modulatory Factor for the Executive Processing of Individuals in Course of Cognitive Decline. A Systematic Review. Front. Psychol. 8:1858. doi: 10.3389/fpsyg.2017.01858
Received: 24 May 2017; Accepted: 05 October 2017;
Published: 27 October 2017.
Edited by:
Alexandre Heeren, Harvard University, United StatesReviewed by:
Thorsten Mikoteit, Psychiatric Clinics of the University of Basel, SwitzerlandIoana Alina Cristea, Babeş-Bolyai University, Romania
Copyright © 2017 Stigger, Marcolino and Plentz. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Felipe Stigger, stigger@ufcspa.edu.br