Mirko Wegner1*†
Sandra Amatriain-Fernández2*†
Andrea Kaulitzky3
Eric Murillo-Rodriguez4
Sergio Machado5
Henning Budde3- 1Institute of Sport Science, Humboldt-Universität zu Berlin, Berlin, Germany
- 2Faculty of Sport Sciences and Physical Education, University of A Coruña, A Coruña, Spain
- 3Faculty of Human Sciences, Department of Pedagogy, Medical School Hamburg, Hamburg, Germany
- 4School of Medicine, Anahuac Mayab University, Mérida, Yucatán, Mexico
- 5Laboratory of Physical Activity Neuroscience, Physical Activity Sciences Postgraduate Program, Salgado de Oliveira University, Niterói, Brazil
Background: Depression is a common threat to children and adolescents in terms of affecting psychosocial development and increasing their risk of suicide. Apart from conventional treatments for depression, physical exercise has become a promising alternative. This paper aims to systematically review the existing meta-analyses that focus on the impact of physical exercise on clinical and nonclinical depression in children and adolescents.
Methods: A systematic literature search was conducted using PsycINFO, PsycARTICLES, MedLine, PubMed, and hand searching. Risk of bias analysis, effect sizes calculations, and evaluation of the methodological characteristics (AMSTAR 2) were carried out.
Results: Four meta-analyses met the inclusion criteria. After analysing the overlap, the total sample contained 30 single studies (mostly including gender mixed samples) and 2,110 participants (age range 5–20 years). The medium duration of the interventions was 11.5 weeks. The sessions had a medium length of 41 min, and the frequency of implementation was three sessions per week. The most implemented intervention type was aerobic exercise, while control groups mainly continued with their regular routine, among other related options. The overall mean effect of physical exercise on depression was medium (d = −0.50). The additional analysis in clinically depressed samples documented a small to medium mean effect (d = −0.48) in favor of the intervention.
Conclusion: The small to medium but consistently positive effects that were found in the present study place physical exercise as a promising and helpful alternative for children and adolescents with clinical and nonclinical depression. The limited literature focused on children and adolescents in comparison with adult samples points to the need for further research.
Introduction
Depressive symptoms and clinically relevant depressive disorders are a common threat to the mental health of children and adolescents (1). Depression is the leading cause of several diseases and disabilities in these age groups, which is why research on this topic should be intensified (2). Depression has multiple levels of severity (mild, moderate, or severe). It may appear as a single symptom of sadness, dejected mood or a complex of other symptoms described below. Depression in a nosological sense is diagnosed when a specific combination of symptoms occur over a definite period of time and with a particular intensity (3). The DSM-V (Diagnostic and Statistical Manual of Mental Disorders) defines major depression as having five or more symptoms over a period of two weeks (4). Symptoms include depressed or irritable mood, diminished interest or pleasure, insomnia or hypersomnia, psychomotor agitation or retardation, fatigue or loss of energy, feelings of worthlessness or inappropriate guilt, diminished ability to concentrate, recurrent thoughts of death, suicidal ideation with or without a specific plan or a suicide attempt. A persistent depressive disorder (dysthymia) is diagnosed when depressive symptoms are present for most days over at least one year. Compared to major depression, the symptoms are milder (4).
Common interventions against depression are pharmacological treatments and psychotherapy (5). Selective serotonin reuptake inhibitors (SSRI) are common interventions for clinical depression, however, side effects like weight gain, increases in blood pressure, and impairment of sexual functions are experienced (6). Furthermore, the effectiveness of antidepressants was questioned by placebo-controlled clinical trials showing only a small effect size (7). Psychological and pharmacological therapies had similar efficacies in the treatment of depressive disorders (8). However, active medication had a small but significant contribution to the overall efficacy of combined treatments (9). One review directly compared typical treatments using seven meta-analyses (with a total of 53 studies) for seven major types of psychological treatment for mild to moderate adult depression (cognitive-behavior therapy, nondirective supportive treatment, behavioral activation treatment, psychodynamic treatment, problem-solving therapy, interpersonal psychotherapy, and social skills training). There was no indication that one of the treatments was more or less efficacious, with the exceptions of interpersonal psychotherapy (which was more effective; d = 0.20) and nondirective supportive treatment (which was less effective than the other treatments; d = −0.13) (8). New avenues to treat major depressive disorders in adults are offered such as ketamine (10), nutritional interventions such as thiamine (11), and omega-3-polyunsaturated fatty acids (12–15) as well as neuromodulation (16).
Following the same profile as the SSRI fluoxetine, animal studies indicated that physical exercise training could be a useful tool in preventing and treating depressive disorders (17). This easy to apply and cheap intervention is an effective intervention against depression (18, 19) with similar effectiveness compared to other forms of treatment in adult humans (20) plus it also provides positive side effects (21).
Adult samples dominate this field of research (22) but age seems to have a significant impact on the effect of exercise on depression (23). Early childhood onset of depression increases chances for depression later in life and has a negative impact on psychosocial development (5, 24, 25). For example, it has been shown that higher order cortical development is dependent on the development of lower order cortical regions (26). We are going to sum up the current literature dealing with the exercise effects on depression in children and adolescents in the following paragraph.
Characteristics of Depression in Children and Adolescents
The World Health Organization defines adolescence as the stage between 10 and 19 years of age (27). The American Academy of Pediatrics extended this stage to 21 years with the so-called late adolescence (28). This paper follows the extended definition.
Depression is one of the most common mental disorders in children and adolescents. According to a meta-analysis carried out by Costello, Erkanli (1) including studies from around the world, the estimated prevalence in young children (under 13) is 2.8%. Furthermore, 5.6% of all adolescents (13 to 18 years) suffer from depression, and the number of female patients (5.9%) is higher than the number of male patients (4.6%). In the National Comorbidity Replication study it was shown that mental health disorders' onset (like depression) peaks at the age of 14 years (29, 30). According to the WHO, depression and anxiety disorders are among the top five causes of overall disease burden among children and adolescents in Europe (31). Depressive symptoms and clinically relevant depressive disorders in young children can have a huge negative impact on the psychosocial development of the individual and can increase the risk of suicide (5, 25). Suicide is the third most common cause of death in adolescents (2). In general, depression is associated with a shorter lifespan (32).
Although psychological disorders in children and adolescents have not dramatically increased over the past decades for girls there seems to be a significant change in the prevalence of depression compared to earlier decades (33). This sex difference, however, seems not to appear before the end of Tanner stage III, suggesting hormones being involved in the pathophysiology of this disorder (30, 34). The average duration of a major depressive episode in children is 7 to 9 months (35), while 90% of children with depression recover from such an episode (36). In some cases, depression has a chronic progression that reduces the likelihood of therapy success (25). Furthermore, every single depressive episode increases the risk of recurrence (37).
In the treatment of mild and moderate depressive symptoms in children and adolescents, nonpharmacological approaches such as psychotherapy play a major role. A 2006 meta-analysis found modest benefits for psychotherapy versus control (38) which was confirmed by Eckshtain, Kuppens (39) with effects being significantly larger for interpersonal therapy (40) than for cognitive behavioral therapy (CBT). A network meta-analysis (NMA) of youth depression treatment and prevention studies, conducted by Zhou, Hetrick (41), found only CBT and IPT to be significantly more beneficial than most control conditions. A severe symptomatology may demand a combination with antidepressants. A study conducted with adolescents by Foster and Mohler-Kuo (42) found that the combination of cognitive-behavioral therapy and fluoxetine was more effective than drug therapy alone. The SSRI fluoxetine is the first-choice medication for the treatment of juvenile depression. As second-choice antidepressants the SSRIs sertraline, escitalopram, and citalopram might be used (43). Side effects of a pharmacotherapy in adolescents are comparable to those in adults including sedation, agitation, weight gain, sleep problems, vegetative symptoms, and sexual dysfunction (43). Electroconvulsive therapy use in adolescents is considered a highly efficient option for treating depression, achieving high remission rates, and presenting few and relatively benign adverse effects. Risks can be mitigated by the correct use of the technique and are considered minimal when compared to the efficiency of ECT in treating psychopathologies (44).
Preliminary results also suggest repetitive transcranial magnetic stimulation as an effective and well tolerated antidepressant treatment for adolescents with treatment resistant depressive symptomology (45).
Physical Exercise and its Beneficial Impact on Health
It has been already demonstrated that physical exercise as well as physical activity can cause benefits at both, physical and mental level (46–48). Physical activity interventions have shown to be efficient not only to produce therapeutic benefits when implemented solely or as a part of a treatment for mental disorders, but also to prevent or delay the appearance of mental disorders (49). Additionally, physical exercise was found to be effective in treating symptoms and in reducing the mortality related to major depression (32). As this review discusses, meta-analyses on the depression-reducing effect of exercise in children and adolescents (50–53) so far suggest small to medium effects in this age group. Further moderating variables (e.g., dose specificity) could not be identified so far (51) although study quality and participants' characteristics (e.g. overweights as targets) seem to affect results (50). Several mechanisms have been suggested as responsible for the positive effects of exercise on depression including changes in HPA axis activity, mononamine levels, and neurotrophic growth factors as well as the adaptation of different neural structures [for an overview see Wegner, Helmich (19)].
Along with antidepressant drugs and psychotherapy, physical exercise is a promising option to treat depression. However, in reports exercise is often used synonymously with physical activity (54), which can be misleading. Physical activity is an umbrella term that includes sub-categories such as sports, leisure activities, dance, and physical exercise (55). The American College of Sports Medicine (56) defines physical activity as any bodily movement produced by the contraction of skeletal muscles that results in a substantial increase in caloric requirements over resting energy expenditure. Physical exercise, the concept of interest in this article, is characterised as a training exercise intervention that is planned and structured, repetitive and purposeful, leading to a change in fitness (54). We think that interventions can only run by exercise not by physical activity. Therefore, it can be said that physical exercise is always physical activity, but physical activity is not necessarily physical exercise. Nevertheless, we also included physical activity to our search because the use of exercise as an intervention for the treatment of mental health diseases is still used vaguely (57).
This article aims to evaluate whether children and adolescents with depression benefit in the same way from physical exercise training as adults do. The relief of depressive symptoms in both clinical and nonclinical samples was analysed.
Materials and Methods
Protocol and Registration
The protocol of this systematic review was registered on July 20, 2018 in PROSPERO (International prospective register of systematic reviews) at www.crd.york.ac.uk under the PROSPERO-ID CRD42018100357.
Eligibility Criteria
To determine if a meta-analysis was appropriate for this article the single studies included had to fulfill the eligibility criteria displayed in Table 1. In order to structure the eligibility criteria, the PICOS approach (58) was used by implementing five categories: population, intervention, comparator, outcome, and study design. Only meta-analyses, including longitudinal studies with control groups, were considered for inclusion. Their results are usually put in relation to a baseline collected at the beginning of the study, which allows a comprehensive understanding of the degree and direction of change over time (59).
Table 1 Eligibility criteria by category (PICOS).
Furthermore, the meta-analyses had to be published in a peer-reviewed journal and in the English language. All limitations were set before the literature search was conducted.
Search Strategy
A wide literature search strategy was developed using keywords and Medical Subject Headings from four categories: population, outcome, intervention type, and study design (Supplementary Material Table S1). The search terms from each category were combined in order to locate all relevant literature using the following databases: PsycINFO (EBSCO Interface), PsycARTICLES (EBSCO Interface), MEDLINE (via PubMed) and PubMed. The search was last conducted December 12, 2019.
Study Selection
The selection of meta-analyses was carried out independently by two researchers. Any disagreement between them was solved through discussion with a third reviewer. After deleting duplicates, the relevant articles were selected by screening the titles and examining the abstracts. Full-text articles were retrieved and scanned when abstracts did not provide sufficient data.
Data Extraction
For each of the included meta-analyses the following data was extracted independently by two researchers: Information about the included single studies (design, sample size, sample characteristics, depression assessment, intervention characteristics, control group characteristics) and information about the meta-analyses (risk of bias analysis, effect sizes, methodological characteristics). A data extraction form was used.
Quality Assessment
All contained meta-analyses performed a risk of bias analysis to assess the quality of the included single studies. Additionally, they focused on publication biases. In order to compare the data, the quality analyses were extracted and examined. To assess the methodological quality of the included systematic reviews with meta-analyses, the AMSTAR 2 checklist (a measurement tool to assess the methodological quality of systematic reviews) (60) was filled out independently by three researchers.
Effect Size Calculations
In all meta-analyses included, the standardized mean difference (SMD = M1 – M2/SDpooled) was used as the measure for effect size. The reported effect sizes of each one of the included meta-analyses were combined and a general effect size was calculated and discussed.
Additional Analysis
A subgroup analysis regarding the effect size for only clinical samples was carried out, understanding clinical samples as those including participants in treatment for a depressive-related disorder or with a formal diagnosis of a depressive disorder. Therefore, the single studies within the selected meta-analyses which examined clinical participants were extracted, the overlap studied, and the effect size calculated. Regarding the assessment of heterogeneity, a visual inspection of the forest plot and the I2 value was made. According to the interpretation guide provided by Higgins and Green (61), while I2 test results ranging from 0% to 40% might not report relevant heterogeneity levels, results from 30% to 60% may indicate moderate heterogeneity and between 50% and 90% substantial heterogeneity.
Potential publication bias was evaluated using a funnel plot. All statistical analysis and calculations were performed using the Review Manager (RevMan) software (62).
Results
Study Selection
A total of 1,941 studies were identified in the literature search process to seek out systematic reviews with meta-analysis focused in this field. After removing duplicates, two independent researchers reviewed 1,152 titles and abstracts. Any discrepancy between researchers was discussed with a third reviewer. A consensus was reached and ended in a total of 23 potentially relevant studies. Those 23 studies were reviewed in full text. Four studies met the eligibility criteria and were included in this review (50–53) (for more information see the Flow chart of the selection process, Figure 1). A table with the excluded studies can be found as Supplementary Material Table S2.
Figure 1 Flow chart of the selection process.
Study Characteristics
The general characteristics information of the four meta-analyses included were extracted by two reviewers using a data extraction form and were summarized in Table 2.
Table 2 General characteristics of included meta-analyses.
Methodological Characteristics
Of the four meta-analyses included, only two included RCTs (52, 53). The other two meta-analyses included RCTs and also other study designs of lower quality. Radovic, Gordon (51) included five RCTs and three controlled trials (CTs). The meta-analysis of Brown, Pearson (50) covered five RCTs, two CTs, one cluster randomized CT (CRCT) and one quasi-experimental study (QES).
Several questionnaires for reporting depression outcome measures were included in the single studies. The Beck Depression Inventory (BDI) (63) was by far the most frequently used one. The existence of control groups is reported in the four meta-analyses (50–53). Their nature varied between single studies: without intervention, on a waiting list, low intensity exercise, or the usual exercise routine, among others (Table 2).
Intervention Characteristics
The type of intervention differed between single studies. In three of the four included meta-analyses (50–52), aerobic exercise was the most used intervention. Carter, Morres (53) also included articles using some form of aerobic and/or resistance/strength training in the intervention. Within the single studies, the duration of the interventions varied from 4 to 40 weeks. In the meta-analysis of Radovic, Gordon (51), the maximum duration was only 20 weeks, whereas the minimum in Brown, Pearson (50) was at least 9 weeks. The approximated medium duration of all of the interventions was 11.5 weeks.
Regarding the frequency of the interventions, Brown, Pearson (50) and Radovic, Gordon (51) included single studies with a frequency of 2 to 5 days per week. In Carter, Morres (53) and Larun, Nordheim (52), the majority of studies included three sessions per week. In general, the mostly adopted frequency of implementation was three times per week. The duration of the exercise interventions varied between 5 and 90 min per session. The minimum of min was included by Larun, Nordheim (52). Carter, Morres (53) also included single studies with a minimum duration of 15 min only, whereas the other meta-analyses included minimums of 20 or 25 min. The maximum of a 90-min intervention was shared by all meta-analyses. The approximated medium duration of sessions was 41 min.
Participants Characteristics
The number of participants included in each meta-analysis varied according to the sample size of the single studies. Larun, Nordheim (52) had the largest sample. They included 16 studies and reported 1,191 subjects. The smallest sample was found in Radovic, Gordon (51), with eight studies and 297 subjects. Brown, Pearson (50) integrated nine single studies and a total of 581 subjects. Carter, Morres (53) used eleven single studies, although only eight of them (including 445 subjects) were eligible for their meta-analysis. Those numbers led to a total of 41 single studies and 2,514 subjects as a base for this analysis.
The overlap of single studies within the four analyzed meta-analyses (Table 3) caused a reduction to a final number of 30 single studies and 2,110 subjects for this review. The number of participants reported from each meta-analysis regarding the single studies did not always match. Some took the starting sample while others selected the final sample after drop outs. In this article, the latter was reported. This can be seen with the example of a single study (64) which was included in the four selected meta-analyses for this review (50–53). Two of the meta-analyses (51, 52) reported a sample size of 43 participants whereas Carter, Morres (53) reported 60 participants and Brown, Pearson (50) reported 30 participants. In the original article (64) 60 subjects started the program (30 control group; 30 experimental group). However, only 23 subjects of the experimental group and 20 of the control group completed the whole study, giving a final sample of 43 participants.
Table 3 Overlap of single studies.
The age of the participants ranged between 5 and 20 years. The characteristics of the included populations in each meta-analysis varied from normal population: healthy samples, to at-risk groups: juvenile delinquents, pregnant adolescents, obese children, or clinically depressed populations: with major depressive disorder (MDD), with primary diagnostic of childhood depression and dysthymia or with moderate depressive symptoms.
Three of the included meta-analyses consisted of both clinical and nonclinical samples. Brown, Pearson (50) did not include clinical samples with regards to understanding a clinical sample as the sample with a formal diagnosed depression using clinical recognized diagnostic criteria. Larun, Nordheim (52) and Radovic, Gordon (51) both included three single studies with clinical samples. Carter, Morres (53) included five studies with clinical samples. Due to the overlap of those 11 studies, six single clinical studies were finally identified.
Two of those six final single studies integrated adolescents with diagnosed major depressive disorder (67, 68). One study included adolescents with dysthymia and primary diagnosis of conduct disorder (66). Cohen-Kahn (69) and Kanner (65) included psychiatric inpatients. In the second one, the patients had moderate or severe levels of depression. In Carter, Guo (70), the participants were also receiving a health or social care professional treatment for depression.
Quality Assessment
Quality Assessment of Single Studies
All included meta-analyses conducted a risk of bias analysis regarding the single studies. Three of them (50, 51, 53) used the Delphi method. Larun, Nordheim (52) used another criterion. According to Radovic, Gordon (51), six of their eight articles included were of low quality. One study scored five representing moderate quality and another one scored seven representing high quality, with nine being the highest possible rating. Nevertheless, one item was removed from the original Delphi List in two of the meta-analyses. Brown, Pearson (50) and Carter, Morres (53) removed the care provider blinding item. According to them, in an exercise intervention it is not possible to allow the therapist blinding. Therefore, Carter, Morres (53) considered a study to be of high-quality when scoring five and above. Larun, Nordheim (52) used a different seven-criteria list and analyzed the following items: generation of allocation sequence, concealment of allocation, co-interventions, baseline comparability, intention-to-treat analysis, losses to follow up, and blinding of outcome assessor. None of their included studies were rated as of high quality. The ratings in this case were: for high quality studies needed to fulfill at least six of the criteria; three to five criteria fulfilled equal moderate quality rating; and two or less criteria fulfilled equal a low-quality rating. The overlapping single studies within the four meta-analyses did not necessarily receive the same score in all of the risk of bias evaluations reported by different authors even when using the same assessment tool. This fact reveals the variety of possible interpretations in the valuation with this type of tool.
Quality Assessment of Meta-Analyses
The results obtained with the AMSTAR 2 Checklist (60) regarding the methodological quality of the meta-analyses are shown as Supplementary Material Table S3. The final agreement between the three independent researchers produced the following results: Larun, Nordheim (52) = moderate quality review; Brown, Pearson (50) = moderate quality review; Carter, Morres (53) = moderate quality review; and Radovic, Gordon (51) = low quality review.
Synthesis of Results
The aim of this article is to systematically review the meta-analyses that focus on the effects of physical exercise interventions on clinical and nonclinical depression in children and adolescents. Therefore, a first calculation of the effect size reported in the four meta-analyses included was carried out. The overlap was not taken into account at this stage.
Following the interpretation guideline according to Cohen's criteria (small d = 0.20; medium d = 0.50; large d = 0.80) (71), the calculated overall effect size is medium (d = −0.50).
Clinical Samples Analysis
An additional analysis with all of the single studies including clinical samples was carried out. The effect size of the physical exercise intervention in clinical depressive subjects was calculated.
After analyzing the overlap between single studies with clinical samples (Table 4), the reported effect sizes were studied. The study of Hughes, Barnes (68) was included in Carter, Morres (53) and Radovic, Gordon (51) reporting different effect sizes. After analyzing the original study, the data of Carter, Morres (53) were used because the same results (d = −0.69) were reached. Radovic, Gordon (51) reported an effect size of d = −0.54. However, Carter, Morres (53) and Radovic, Gordon (51) showed the same results (d = −1.39) regarding the single study of Roshan, Pourasghar (67).
Table 4 Overlap of single studies with clinical sample.
The single study of Brown, Welsh (66) was included in three meta-analyses (51–53). The original article was checked in order to understand the reported data of each of the meta-analyses. Radovic, Gordon (51) reported an effect size of d = 0.15. Larun, Nordheim (52) reported an effect size of d = 0.78. Carter, Morres (53) explained the impossibility of estimating the effect size due to the insufficient data reported in the original study (standard deviation missing) (53). Due to the missing data, it was agreed upon the impossibility of calculating the effect size.
The study by Cohen-Kahn (69) was included in Larun, Nordheim (52). The effect size reported was d = −0.14.
Kanner (65) single study was included in two meta-analyses (52, 53). The selected data was extracted from Larun, Nordheim (52) reporting an effect size of d = −0.46. In Carter, Morres (53) two different effect sizes were reported for the single study. The explanation to this fact relapse in the two separate intervention arms—low intensity/high intensity—of the exercise intervention. The reported results were the following: d = 0.01 for the first condition and d = −0.31 for the second condition.
Another single study (70) was included in the meta-analysis of Carter, Morres (53). The effect size of the exercise intervention with severe depressive participants was d = −0.19 in favor of the intervention group.
The I2 statistic test was performed to assess heterogeneity. The results (I2 = 36%; p = 0.18) showed a moderate level of heterogeneity. Which means that the level of variation across studies is due to the moderate differences between them rather than to chance. The results reported a small to medium effect size taking the base of Cohen's criteria (d = −0.48) (71). Effect size calculations for clinical samples can be found in the clinical sample analysis forest plot (Figure 2). The publication bias analysis based on the visual inspection of the funnel plot indicated minor to no publication bias due to the asymmetric inverted funnel shape. The funnel plot can be found as Supplementary Material Figure S1.
Figure 2 Forest plot of the clinical sample analysis.
Discussion
The present article aims to review meta-analyses that focus on the effects of physical exercise on depressive outcome measures in children and adolescents with or without a clinical diagnosis. A medium effect size was found in the general effect size analysis of the included meta-analyses regarding exercise relieving depressive symptoms (d = −0.50). This result leads to the conclusion that physical exercise is a promising intervention against depression in the target population. Similar results were found in older individuals where the effect sizes pointing towards the intervention group ranged between moderate (d = −0.56) (19) and moderate to large (d = −0.68) (72).
The additional analysis of the single studies with clinical samples included in the four meta-analyses selected showed an effect size of d = −0.48. According to Cohen's criteria, the effect size is small to medium (71). Similar results were also discovered in clinically depressed adults (73) with an effect size of d = −0.40 pointing to the effectiveness of exercise interventions. However, it has been observed that most studies are carried out with nonclinical populations (70). There is a need for more research that includes clinical populations during childhood and adolescence due to the lack of data regarding this specific population.
With these results in mind it can be assumed that physical exercise could be a relevant treatment of depression both in children and adults. These findings are supported by the WHO, who emphasize the psychological benefits of the physical activity in young people with anxiety and depression (47) and make a clear recommendation for the use of physical activity as part of treatment for depressive episodes/disorders in adult populations (74). It should be remembered that physical exercise is included in the physical activity term (55), and is characterized by adding a purpose of achieving changes in fitness following a planned, structured, and repetitive intervention (54).
The most widely used intervention in the four included meta-analyses (50–53) was aerobic exercise. A systematic review carried out with adult samples measured the effects of different interventions on depression. They found no consensus on the correct intensity of aerobic exercise as to achieve the best dose-response relationship (75).
A RCT (76) was carried out to compare the effects of aerobic exercise and antidepressant treatment and showed no differences between groups regarding their level of depressive symptoms after 16 weeks of treatment. This suggests that exercise has the same effectiveness as the standard antidepressant treatments. Nevertheless, the combination of physical exercise with conventional therapies should be looked at more closely and with more effort focused on children and adolescent samples.
The optimal length and frequency of the physical interventions are still a matter of controversy. Dunn, Trivedi (77) examined the optimal dose of exercise needed to improve depressive symptoms in adults with MDD. Their results point to the relevance of higher energy expenditure. One recent publication transports a similar opinion: exercise intensity appears to matter in order to achieve exercise-induced mental health benefits (78). In any case, the following suggestion made by Gronwald, de Bem Alves (79) regarding the exercise intervention prescription seems to be relevant to clarify the real impact of different exercise interventions. They recommend that studies involving physical exercise, or exercise training should be precisely described in detail so that they can be reproduced in other research laboratories, and, more important, can be assessed for their translational impact.
Regarding the methodology, a RCT is the most desirable. The relevance of implementing RCTs to study the effects of interest lies in its quality. This is the most powerful design to determine the existence of cause-effects between intervention and results (80, 81). Therefore, they are widely used for assessing the cost effectiveness of a treatment (82). The importance of controlling for social support when designing the intervention and the need to establish a sham exercise condition has also been highlighted by different authors (20, 83).
In this review, the meta-analyses using only RCTs calculated d = −0.66 (52) and d = −0.48 (53) as effect sizes. Radovic, Gordon (51) included five RCTs and three CTs and reached an effect size of d = −0.61. The effect size reported by Brown, Pearson (50), who also included other study designs, was the smallest (d = −0.26). Those authors acknowledged that studies with higher quality ratings showed greater treatment effects. Furthermore, they calculated an effect size of d = −0.35 for their included RCTs studies and d = −0.14 for the studies with other designs.
Conclusion
It can be summarized that research reveals small to medium but consistently positive effects of physical exercise on depressive symptoms in clinical and nonclinical samples as well as no negative side effects for children and adolescents. Especially with this last part in mind, physical exercise should be seen as a promising future supplementary intervention against mental health problems in this age group. Therefore, more research in this field is of well-known importance. The lack of literature focused on children and adolescent samples compared to adults, and the responsibility of achieving better life conditions for children and adolescents with depression, should be enough reason to promote research in this field.
Due to the methodological limitations reported by several authors (20, 23) regarding the blinding conditions, the use of sham conditions to blind participants (83), and care providers is recommended. This will ensure high standard quality assessments to measure the effects of exercise and its intensity in randomized CTs. Besides, this might avoid findings that occur through other reasons such as group dynamics.
Data Availability Statement
The datasets analyzed in this article are not publicly available. Requests to access the datasets should be directed to sandra.amatriain@udc.es.
Author Contributions
HB, SA-F, and MW conceptualized and designed the study, drafted the initial manuscript and reviewed and revised the manuscript. SA-F, AK, EM-R, and SM designed the data collection instruments, collected data, carried out the initial analyses and reviewed and revised the manuscript. All authors have read and approved the final version of the manuscript and agree with the order of presentation of the authors.
Funding
We acknowledge support by the German Research Foundation (DFG) and the Open Access Publication Fund of Humboldt-Universität zu Berlin. SA-F acknowledges the support of the University of A Coruña through the Inditex-UDC Grant Program for research stays.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
We thank Samantha Slabyk for proofreading this article.
Supplementary Material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyt.2020.00081/full#supplementary-material
References
1. Costello EJ, Erkanli A, Angold A. Is there an epidemic of child or adolescent depression? J Child Psychol Psychiatry (2006) 0(0):061024022229003. doi: 10.1111/j.1469-7610.2006.01682.x
2. World Health Organization. (2014). WHO calls for stronger focus on adolescent health Geneva Available from: http://www.who.int/mediacentre/news/releases/2014/focus-adolescent-health/en/.
3. Garber J, Gallerani CM, Frankel SA. Depression in Children. In: Gotlib IH, HC L, editors. Handbook of Depression, 2nd ed. New York: Guilford Press (2009)p. 405–43.
4. American Psychiatric Association. (2013). Diagnostic and Statistical Manual of Mental Disorders, 5th ed.
5. Ryan ND. Treatment of depression in children and adolescents. Lancet (2005) 366(9489):933–40. doi: 10.1016/S0140-6736(05)67321-7
6. Helmich I, Latini A, Sigwalt A, Carta MG, Machado S, Velasques B, et al. Neurobiological alterations induced by exercise and their impact on depressive disorders [corrected]. Clin Pract Epidemiol In Ment Health : CP EMH (2010) 6:115–25. doi: 10.2174/17450179010060100115
7. Khan A, Brown WA. Antidepressants versus placebo in major depression: an overview. World Psychiatry (2015) 14(3):294–300. doi: 10.1002/wps.20241
8. Cuijpers P, van Straten A, Andersson G, van Oppen P. Psychotherapy for depression in adults: a meta-analysis of comparative outcome studies. J Consult Clin Psychol (2008) 76(6):909–22. doi: 10.1037/a0013075
9. Cuijpers P, van Straten A, Hollon SD, Andersson G. The contribution of active medication to combined treatments of psychotherapy and pharmacotherapy for adult depression: a meta-analysis. Acta Psychiatrica Scand (2010) 121(6):415–23. doi: 10.1111/j.1600-0447.2009.01513.x
10. Krystal JH, Abdallah CG, Sanacora G, Charney DS, Duman RS. Ketamine: a paradigm shift for depression research and treatment. Neuron (2019) 101(5):774–8. doi: 10.1016/j.neuron.2019.02.005
11. Ghaleiha A, Davari H, Jahangard L, Haghighi M, Ahmadpanah M, Seifrabie MA, et al. Adjuvant thiamine improved standard treatment in patients with major depressive disorder: results from a randomized, double-blind, and placebo-controlled clinical trial. Eur Arch Psychiatry Clin Neurosci (2016) 266(8):695–702. doi: 10.1007/s00406-016-0685-6
12. Mocking RJT, Harmsen I, Assies J, Koeter MWJ, Ruhé HG, Schene AH. Meta-analysis and meta-regression of omega-3 polyunsaturated fatty acid supplementation for major depressive disorder. Transl Psychiatry (2016) 6(3):e756–e. doi: 10.1038/tp.2016.29
13. Appleton KM, Sallis HM, Perry R, Ness AR, Churchill R. ω-3 Fatty acids for major depressive disorder in adults: an abridged Cochrane review. BMJ Open (2016) 6(3):e010172–e. doi: 10.1136/bmjopen-2015-010172
14. Jahangard L, Hedayati M, Abbasalipourkabir R, Haghighi M, Ahmadpanah M, Faryadras M, et al. Omega-3-polyunsatured fatty acids (O3PUFAs), compared to placebo, reduced symptoms of occupational burnout and lowered morning cortisol secretion. Psychoneuroendocrinology (2019) 109:1043843. doi: 10.1016/j.psyneuen.2019.104384
15. Jahangard L, Sadeghi A, Ahmadpanah M, Holsboer-Trachsler E, Sadeghi Bahmani D, Haghighi M, et al. Influence of adjuvant omega-3-polyunsaturated fatty acids on depression, sleep, and emotion regulation among outpatients with major depressive disorders - results from a double-blind, randomized and placebo-controlled clinical trial. J Psychiatr Res (2018) 107:48–56. doi: 10.1016/j.jpsychires.2018.09.016
16. Jahangard L, Tayebi M, Haghighi M, Ahmadpanah M, Holsboer-Trachsler E, Sadeghi Bahmani D, et al. Does rTMS on brain areas of mirror neurons lead to higher improvements on symptom severity and empathy compared to the rTMS standard procedure? – Results from a double-blind interventional study in individuals with major depressive disorders. J Affect Disord (2019) 257:527–35. doi: 10.1016/j.jad.2019.07.019
17. Sigwalt AR, Budde H, Helmich I, Glaser V, Ghisoni K, Lanza S, et al. Molecular aspects involved in swimming exercise training reducing anhedonia in a rat model of depression. Neuroscience (2011) 192:661–74. doi: 10.1016/j.neuroscience.2011.05.075
18. Biddle SJ, Asare M. Physical activity and mental health in children and adolescents: a review of reviews. Br J Sports Med (2011) 45(11):886–95. doi: 10.1136/bjsports-2011-090185
19. Wegner M, Helmich I, Machado S, Nardi AE, Arias-Carrion O, Budde H. Effects of exercise on anxiety and depression disorders: review of meta- analyses and neurobiological mechanisms. CNS Neurol Disord Drug Targets (2014) 13(6):1002–14. doi: 10.2174/1871527313666140612102841
20. Blumenthal JA, Babyak MA, Doraiswamy PM, Watkins L, Hoffman BM, Barbour KA, et al. Exercise and pharmacotherapy in the treatment of major depressive disorder. Psychosomatic Med (2007) 69(7):587–96. doi: 10.1097/PSY.0b013e318148c19a
21. Higuera-Hernandez MF, Reyes-Cuapio E, Gutierrez-Mendoza M, Rocha NB, Veras AB, Budde H, et al. Fighting obesity: Non-pharmacological interventions. Clin Nutr ESPEN (2018) 25:50–5. doi: 10.1016/j.clnesp.2018.04.005
22. Whitelaw S, Teuton J, Swift J, Scobie G. The physical activity – mental wellbeing association in young people: a case study in dealing with a complex public health topic using a ‘realistic evaluation’ framework. Ment Health Phys Act (2010) 3(2):61–6. doi: 10.1016/j.mhpa.2010.06.001
23. Budde H, Velasques B, Ribeiro P, Machado S, Emeljanovas A, Kamandulis S, et al. Does intensity or youth affect the neurobiological effect of exercise on major depressive disorder? Neurosci Biobehav Rev (2018) 84:492–4. doi: 10.1016/j.neubiorev.2016.09.026
24. Andersen SL, Teicher MH. Stress, sensitive periods and maturational events in adolescent depression. Trends Neurosci (2008) 31(4):183–91. doi: 10.1016/j.tins.2008.01.004
25. Ravens-Sieberer U, Wille N, Bettge S, Erhart M. Mental health of children and adolescents in Germany. Results from the BELLA study within the german health interview and examination survey for children and adolescents. Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz (2007) 50(5-6):871–8. doi: 10.1007/s00103-007-0250-6
26. Gogtay N, Giedd JN, Lusk L, Hayashi KM, Greenstein D, Vaituzis AC, et al. Dynamic mapping of human cortical development during childhood through early adulthood. Proc Natl Acad Sci USA (2004) 101(21):8174–9. doi: 10.1073/pnas.0402680101
27. World Health Organization. (2018). Adolescent health [Available from: https://www.who.int/topics/adolescent_health/en/.
28. American Academy of Pediatrics. Health Supervision: Late Adolescence (18 to 21 Year Visits). In: Hagan JF, Shaw JS, Duncan PM, editors. Bright Futures: Guidelines for Health Supervision of Infants, Children, and Adolescents (2008).
29. Kessler RC, Berglund P, Demler O, Jin R, Merikangas KR, Walters EE. Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the National Comorbidity Survey Replication. Arch Gen Psychiatry (2005) 62(6):593–602. doi: 10.1001/archpsyc.62.6.593
30. Paus T, Keshavan M, Giedd JN. Why do many psychiatric disorders emerge during adolescence? Nat Rev Neurosci (2008) 9(12):947–57. doi: 10.1038/nrn2513
32. Murri MB, Ekkekakis P, Magagnoli M, Zampogna D, Cattedra S, Capobianco L, et al. Physical exercise in major depression: reducing the mortality gap while improving clinical outcomes. Front Psychiatry (2019) 9:762. doi: 10.3389/fpsyt.2018.00762
33. Bor W, Dean AJ, Najman J, Hayatbakhsh R. Are child and adolescent mental health problems increasing in the 21st century? A systematic review. Aust New Z J Psychiatry (2014) 48(7):606–16. doi: 10.1177/0004867414533834
34. Angold A, Costello EJ. Puberty and depression. Child Adolesc Psychiatr Clinics North America (2006) 15(4):919–37. doi: 10.1016/j.chc.2006.05.013
35. Kovacs M, Feinberg TL, Crouse-Novak M, Paulauskas SL, Pollock M, Finkelstein R. Depressive disorders in childhood. II. A longitudinal study of the risk for a subsequent major depression. Arch Gen Psychiatry (1984) 41(7):643–9. doi: 10.1001/archpsyc.1984.01790180013001
36. Birmaher B, Arbelaez C, Brent D. Course and outcome of child and adolescent major depressive disorder. Child Adolesc Psychiatr Clin N. Am (2002) 11(3):619–37. doi: 10.1016/S1056-4993(02)00011-1
37. Monroe SM, Harkness KL. Life stress, the “kindling” hypothesis, and the recurrence of depression: considerations from a life stress perspective. Psychol Rev (2005) 112(2):417–45. doi: 10.1037/0033-295X.112.2.417
38. Weisz JR, McCarty CA, Valeri SM. Effects of psychotherapy for depression in children and adolescents: a meta-analysis. Psychol Bull (2006) 132(1):132–49. doi: 10.1037/0033-2909.132.1.132
39. Eckshtain D, Kuppens S, Ugueto A, Ng MY, Vaughn-Coaxum R, Corteselli K, et al. Meta-analysis: 13-year follow-up of psychotherapy effects on youth depression. J Am Acad Child Adolesc Psychiatry (2019) 59(1):45–63. doi: 10.1016/j.jaac.2019.04.002
40. Paschall M, Lipton RI. Wine preference and related health determinants in a U.S. national sample of young adults. Drug Alcohol Depend (2005) 78(3):339–44. doi: 10.1016/j.drugalcdep.2004.12.004
41. Zhou X, Hetrick SE, Cuijpers P, Qin B, Barth J, Whittington CJ, et al. Comparative efficacy and acceptability of psychotherapies for depression in children and adolescents: a systematic review and network meta-analysis. World Psychiatry (2015) 14(2):207–22. doi: 10.1002/wps.20217
42. Foster S, Mohler-Kuo M. Treating a broader range of depressed adolescents with combined therapy. J Affect Disord (2018) 241:417–24. doi: 10.1016/j.jad.2018.08.027
43. Taurines R, Gerlach M, Warnke A, Thome J, Wewetzer C. Pharmacotherapy in depressed children and adolescents. World J Biol Psychiatry : Off J World Fed Soc Biol Psychiatry (2011) 12(Suppl 1):11–5. doi: 10.3109/15622975.2011.600295
44. Lima NN, Nascimento VB, Peixoto JA, Moreira MM, Neto ML, Almeida JC, et al. Electroconvulsive therapy use in adolescents: a systematic review. Ann Gen Psychiatry (2013) 12(1):7–12. doi: 10.1186/1744-859X-12-17
45. Donaldson AE, Gordon MS, Melvin GA, Barton DA, Fitzgerald PB. Addressing the needs of adolescents with treatment resistant depressive disorders: a systematic review of rTMS. Brain Stimulation (2014) 7(1):7–12. doi: 10.1016/j.brs.2013.09.012
46. Singh AS, Saliasi E, van den Berg V, Uijtdewilligen L, de Groot RHM, Jolles J, et al. Effects of physical activity interventions on cognitive and academic performance in children and adolescents: a novel combination of a systematic review and recommendations from an expert panel. Br J Sports Med (2018) 53(10):640–7. doi: 10.1136/bjsports-2017-098136
47. World Health Organization. (2018c). Physical activity and young people - Recommended levels of physical activity for children aged 5 - 17 years - [Available from: https://www.who.int/ncds/prevention/physical-activity/factsheet_young_people/en/.
48. Niemann C, Wegner M, Voelcker-Rehage C, Holzweg M, Arafat AM, Budde H. Influence of acute and chronic physical activity on cognitive performance and saliva testosterone in preadolescent school children. Ment Health Phys Act (2013) 6(3):197–204. doi: 10.1016/j.mhpa.2013.08.002
49. Zschucke E, Gaudlitz K, Ströhle A. Exercise and physical activity in mental disorders: clinical and experimental evidence. J Preventive Med Public Health (2013) 46(Suppl 1):S12–21. doi: 10.3961/jpmph.2013.46.S.S12
50. Brown HE, Pearson N, Braithwaite R, Brown W, Biddle S. Physical activity interventions and depression in children and adolescents : a systematic review and meta-analysis. Sports Med (Auckland NZ) (2013) 43(3):195–206. doi: 10.1007/s40279-012-0015-8
51. Radovic S, Gordon MS, Melvin GA. Should we recommend exercise to adolescents with depressive symptoms? A meta-analysis. J Paediatr Child Health (2017) 53(3):214–20. doi: 10.1111/jpc.13426
52. Larun L, Nordheim LV, Ekeland E, Hagen KB, Heian F. Exercise in prevention and treatment of anxiety and depression among children and young people. Cochrane Database Syst Rev (2006)(3), CD004691. doi: 10.1002/14651858.CD004691.pub2
53. Carter T, Morres ID, Meade O, Callaghan P. The effect of exercise on depressive symptoms in adolescents: a systematic review and meta-analysis. J Am Acad Child Adolesc Psychiatry (2016) 55(7):580–90. doi: 10.1016/j.jaac.2016.04.016
54. Budde H, Schwarz R, Velasques B, Ribeiro P, Holzweg M, Machado S, et al. The need for differentiating between exercise, physical activity, and training. Autoimmun Rev (2016) 15(1):110–1. doi: 10.1016/j.autrev.2015.09.004
55. Corbin CB, Pangrazi RP, Franks BD. Definitions: health, fitness and physical activity. President's Counc Phys Fitness Sports: Res Digest (2000) 3(9):1–8.
56. American College of Sports Medicine. ACSM's Guidelines for Exercise Testing and Prescription. Philadelphia, Pennsylvania: Lippincott Williams & Wilkins. (2013).
57. Gronwald T, Budde H. Commentary: physical exercise as personalized medicine for dementia prevention? Front Physiol (2019) 10:1358. doi: 10.3389/fphys.2019.01358
58. Methley AM, Campbell S, Chew-Graham C, McNally R, Cheraghi-Sohi S. PICO. PICOS and SPIDER: a comparison study of specificity and sensitivity in three search tools for qualitative systematic reviews. BMC Health Serv Res (2014) 14(1):579. doi: 10.1186/s12913-014-0579-0
59. Caruana EJ, Roman M, Hernández-Sánchez J, Solli P. Longitudinal studies. J Thorac Dis (2015) 7(11):E537–E40. doi: 10.3978/j.issn.2072-1439.2015.10.63
60. Shea BJ, Reeves BC, Wells G, Thuku M, Hamel C, Moran J, et al. AMSTAR 2: a critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both. BMJ (2017) 358:j4008. doi: 10.1136/bmj.j4008
61. Higgins JPT, Green S. editors. Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0: The Cochrane Collaboration. (2011). Available from: www.handbook.cochrane.org
62. The Cochrane Collaboration. (2011). Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0.
63. Beck AT, Steer RA, Brown GK. Manual for the Beck Depression Inventory-II. San Antonio, TX, USA: Psychological Corporation (1996).
64. Hilyer JC, Wilson DG, Dillon C, Caro L, Jenkins C, Spencer WA, et al. Physical fitness training and counseling as treatment for youthful offenders. J Couns Psychol (1982) 29(3):292–303. doi: 10.1037/0022-0167.29.3.292
65. Kanner KD. (1991). High versus low-intensity exercise as part of an inpatient treatment program for childhood and adolescent depression.
66. Brown SW, Welsh MC, Labbe EE, Vitulli WF, Kulkarni P. Aerobic exercise in the psychological treatment of adolescents. Percept Mot Skills (1992) 74(2):555–60. doi: 10.2466/pms.1992.74.2.555
67. Roshan VD, Pourasghar M, Mohammadian Z. The efficacy of intermittent walking in water on the rate of MHPG sulfate and the severity of depression. Iran J Psychiatry Behav Sci (2011) 5(2):26–31.
68. Hughes CW, Barnes S, Barnes C, Defina LF, Nakonezny P, Emslie GJ. Depressed adolescents treated with exercise (DATE): a pilot randomized controlled trial to test feasibility and establish preliminary effect sizes. Ment Health Phys Act (2013) 6(2):119–31. doi: 10.1016/j.mhpa.2013.06.006
69. Cohen-Kahn DD. The effects of a graded mastery weight- training program on depression and overall functioning in inpatient adolescents. Dissertation Abstr Int: Sect B: Sci Eng (1995) 55(8-B):Feb–B.
70. Carter T, Guo B, Turner D, Morres I, Khalil E, Brighton E, et al. Preferred intensity exercise for adolescents receiving treatment for depression: a pragmatic randomised controlled trial. BMC Psychiatry (2015) 15:247. doi: 10.1186/s12888-015-0638-z
72. Kvam S, Kleppe CL, Nordhus IH, Hovland A. Exercise as a treatment for depression: a meta-analysis. J Affect Disord (2016) 202:67–86. doi: 10.1016/j.jad.2016.03.063
73. Krogh J, Nordentoft M, Sterne JAC, Lawlor DA. The effect of exercise in clinically depressed adults: systematic review and meta-analysis of randomized controlled trials. J Clin Psychiatry (2011) 72(4):529–38. doi: 10.4088/JCP.08r04913blu
74. World Health Organization. (2012). Mental health - Physical activity - Recommendations [Available from: https://www.who.int/mental_health/mhgap/evidence/depression/q6/en/.
75. de Souza Moura AM, Lamego M, Paes F, Barbosa Ferreira Rocha N, Simões-Silva V, Almeida Rocha S, et al. Comparison among aerobic exercise and other types of interventions to treat depression: a systematic review. (2015) 14. doi: 10.2174/1871527315666151111120714
76. Blumenthal JA, Babyak MA, Moore KA, Craighead WE, Herman S, Khatri P, et al. Effects of exercise training on older patients with major depression. Arch Intern Med (1999). 159(19):2349–56. doi: 10.1001/archinte.159.19.2349
77. Dunn AL, Trivedi MH, Kampert JB, Clark CG, Chambliss HO. Exercise treatment for depression: efficacy and dose response. Am J Prev Med (2005) 28(1):1–8. doi: 10.1016/j.amepre.2004.09.003
78. Gronwald T, Velasques B, Ribeiro P, Machado S, Murillo-Rodriguez E, Ludyga S, et al. Increasing exercise’s effect on mental health: Exercise intensity does matter. Proceedings of the National Academy of Sciences of the United States of America. (2018). 159(51):E11890–E1. doi: 10.1073/pnas.1818161115
79. Gronwald T, de Bem Alves AC, Murillo-Rodríguez E, Latini A, Schuette J, Budde H. Standardization of exercise intensity and consideration of a dose-response is essential. Commentary on “Exercise-linked FNDC5/irisin rescues synaptic plasticity and memory defects in Alzheimer's models”, by Lourenco et al., published 2019 in nature medicine. J Sport Health Sci (2019) 8(4):353–4. doi: 10.1016/j.jshs.2019.03.006
80. Sibbald B, Roland M. Understanding controlled trials: why are randomised controlled trials important? BMJ (1998) 316(7126):201. doi: 10.1136/bmj.316.7126.201
81. Kendall JM. Designing a research project: randomised controlled trials and their principles. Emergency Med J : EMJ (2003) 20(2):164–8. doi: 10.1136/emj.20.2.164
82. Cockcroft A. Randomised controlled trials and changing public health practice. BMC Public Health (2017) 17(Suppl 1):409–. doi: 10.1186/s12889-017-4287-7
83. Budde H, Akko D, Ainamani H, Murillo-Rodriguez E, Weierstall R. The impact of an exercise training intervention on cortisol levels and post-traumatic stress disorder in juveniles from an Ugandan refugee settlement: study protocol for a randomized control trial. (2018) 19. doi: 10.1186/s13063-018-2753-x
Keywords: depression, physical exercise, intervention, children, adolescents
Citation: Wegner M, Amatriain-Fernández S, Kaulitzky A, Murillo-Rodriguez E, Machado S and Budde H (2020) Systematic Review of Meta-Analyses: Exercise Effects on Depression in Children and Adolescents. Front. Psychiatry 11:81. doi: 10.3389/fpsyt.2020.00081
Received: 25 October 2019; Accepted: 31 January 2020;
Published: 06 March 2020.
Edited by:
Éric Laurent, Université Bourgogne Franche-Comté, FranceReviewed by:
Serge Brand, University Psychiatric Clinic Basel, SwitzerlandJoana Jaureguizar, University of the Basque Country, Spain
Copyright © 2020 Wegner, Amatriain-Fernández, Kaulitzky, Murillo-Rodriguez, Machado and Budde. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Mirko Wegner, mirko.wegner@hu-berlin.de; Sandra Amatriain-Fernández, sandra.amatriain@udc.es
†These authors have contributed equally to this work