Brigid Bolton1
Rosanna Mary Rooney
Anya Hughes
Vincent Oreste Mancini- 1Psychology Department, Curtin School of Population Health, Faculty of Health Sciences, Bentley, WA, Australia
- 2Discipline of Psychology, School of Population Health, Curtin University, Bentley, WA, Australia
- 3Human Development and Community Wellbeing, Telethon Kids Institute, Nedlands, WA, Australia
- 4Division of Paediatrics, UWA Medical School, University of Western Australia, Perth, WA, Australia
- 5The Fathering Project, Sydney, NSW, Australia
Introduction: Internalizing problems comprise a significant amount of the mental health difficulties experienced during childhood. Implementing prevention programs during early childhood may prevent internalizing problems. The present systematic review and meta-analysis aimed to evaluate the effect of both targeted and universal prevention programs in preventing internalizing problems for children aged 3- to 5-years and their parents.
Methods: PsycINFO, Embase, and MEDLINE were systematically searched, and 17 randomized control trials, consisting of 3,381 children, met eligibility criteria. There were seven universal prevention programs, and 10 targeted prevention programs. Four prevention programs were delivered to children, 10 prevention programs were delivered to parents/caregivers, and three prevention programs were delivered to both parents and children.
Results: Prevention programs led to significantly fewer internalizing problems at 6- and 7-month post-intervention (n = 7, p = 0.02, CI −0.69, 0.06) with a small-to-moderate effect size (g = −0.38), however, not at post-intervention or at 12-month follow up.
Discussion: Overall, findings suggest that there may be value in ongoing development and evaluation of prevention programs for internalizing problems, as they improve social and emotional wellbeing in students and reduce internalizing difficulties within the 6- to 7-month timeframe following prevention programs.
Systematic review registration: PROSPERO: CRD42021261323.
Introduction
Internalizing problems are a leading contributor to health burden amongst young people globally, with mental disorders affecting one in five children (Bitsko et al., 2022) and estimates of one in four during the COVID-19 pandemic (Australian Institute of Health Welfare, 2020). Internalizing problems encompass a range of difficulties characterized by emotional distress and symptoms associated with anxiety and depression (Wergeland et al., 2021). Internalizing problems can be a combination of cognitive, physiological, and behavioral symptoms and are associated with a significant impact on functioning (Kertz et al., 2019).
There is significant intersection between depression and anxiety symptoms, and they can be clustered within the construct of internalizing problems (Lee and Vaillancourt, 2020). Anxiety is the second most common disorder in childhood and affects up to 9% of young children (Ghandour et al., 2019). While depressive disorders are less common, affecting approximately 3% of children (Doering et al., 2022), there is evidence that there is considerable stability of internalizing problems from 3 years of age (Hatoum et al., 2018). Further, earlier onset of depression and anxiety is attributed to a worse clinical outcome over the lifespan (Finsaas et al., 2020), as both depression and anxiety can be chronic and recurring. When considering the current COVID-19 pandemic, emerging evidence has shown an effect of the pandemic on the psychological health of parents and children (Crescentini et al., 2020). The pandemic has had a significant psychosocial impact on young people and is thought to contribute to higher instances of anxiety and depression (Duan et al., 2020).
The impact of internalizing problems is wide-ranging and encompasses emotional, social, and economic costs, even in younger children (Pedersen et al., 2019). The third and fourth leading causes of the burden of disease for children in Australia are anxiety-related problems and psychological developmental problems, respectively (Australian Institute of Health Welfare, 2020). Internalizing problems have a pervasive impact on numerous areas of life such as adaptive functioning, relationships, academic pursuits, school engagement, and they can further impact mental health and relationships as children grow older (Caldwell et al., 2021). If internalizing disorders are not treated effectively, they can have a significant negative effect on development, and children's long-term capacity to live productive, healthy, and fulfilling lives (Chatterton et al., 2020). In Australia, the annual expense of mental health problems to the economy is estimated to be $70 billion, and large savings are theorized if mental illness can be prevented through early intervention (Productivity Commission, 2020).
Prevention in early childhood can have a significant impact developmentally, as opposed to later school or adult intervention (Bierman et al., 2021). Due to mental health difficulties in early life having a significant impact on future health, it is pertinent to build the foundations of social and emotional learning during early development. For example, the British National Child Development Study found that internalizing problems from ages in early childhood could be predictive of higher mortality by age 45 (Jokela et al., 2009; Eurenius et al., 2021). The continued burden of mental health may suggest that current treatment may not be significantly reducing the effect and prevalence of internalizing problems. Prevention programs in early childhood can reduce symptoms and delay the onset of internalizing symptoms (Stockings et al., 2016; Loevaas et al., 2020). Utilizing a preventative approach during early childhood can be more effective as patterns of behavior have not already been established (Davey and McGorry, 2019).
Prevention programs generally comprise either universal or targeted prevention approaches. Universal prevention approaches are delivered to all individuals in a population (e.g., a classroom; Bernaras et al., 2019). Universal prevention programs can be beneficial as they can target a large population, reduce stigma within the population and individual children do not feel like they are targeted (Baughman et al., 2020). They can also minimize the risk of overlooking students which is beneficial as children with internalizing problems can exhibit compliant and non-disruptive behavior (Baughman et al., 2020). In contrast, targeted or selective approaches focus on children at risk of developing a psychological disorder (Bernaras et al., 2019). Growing research has shown the value of well-designed prevention programs across both levels in preventing, delaying onset, and reducing internalizing problems in children (Caldwell et al., 2019).
Prevention programs are a proactive approach to preventing psychopathology and support children's development of social-emotional competence (Lakes et al., 2019). Lower social-emotional competence and the skills associated are a predictor of internalizing behaviors (Huber et al., 2019). Social-emotional competence encompasses emotional, cognitive, and behavioral areas of development, including awareness of and regulation of emotions, emotional literacy, perspective-taking, and problem-solving skills (Green et al., 2021). Cognitive, emotional, and behavioral skills are important for prosocial behavior and the prevention of internalizing problems (Eklund et al., 2018).
Effective social and emotional prevention programs have been available for older children in primary school and lower high school for some time, with literature supporting them (Ishikawa et al., 2019). However, social and emotional skill development is considered to be beneficial in early childhood to enhance social-emotional competencies (Aksoy, 2019). Early childhood prevention programs for internalizing problems are relatively new, and research is still developing (Baughman et al., 2020). Few preventative programs are both accessible and suitable for children younger than 5 years old (Forbes et al., 2019).
While reviews and meta-analyses on anxiety and depression prevention initiatives in children have been completed, there are still gaps in the literature. In particular, a large network meta-analysis focused on children aged 4- to 18-years, however only in school-based settings (Caldwell et al., 2019). Caldwell et al. (2019) review did not include online, or community-based programs and they also did not assess prevention programs for 3-year-old children. Further systematic reviews and meta-analyses have been conducted on the prevention of depression and anxiety in young people, both children and adolescents, however, most have focused on children over 5-years of age and have not addressed prevention outside of schools (Johnstone et al., 2018).
Baughman et al. (2020) reviewed programs within schools and the community for children aged 4–6 years and their parents. They completed searches within the Australian mental health promotion website BeYou and the Cochrane Library database. The review concluded that prevention efforts earlier in childhood were needed to reduce the burden associated with internalizing problems, however, they were only able to identify six programs that could be delivered as prevention programs. They further identified that skills training in cognitive and social-emotional areas is effective in reducing internalizing problems. While the programs they reviewed showed favorable support for prevention in early childhood, more rigorous studies were needed that would involve longer-term randomized controlled trials. Baughman et al. (2020) review gave an excellent picture of the programs in place for young children, and it is thought that a meta-analysis will provide further clarity on the effectiveness of current interventions.
Research findings suggest that children from 3 years of age are well placed to receive social and emotional education (Ardoin and Bowers, 2020; Blewitt et al., 2021). However, most prevention programs and reviews have focused on children within the school system and over the age of four or five (Caldwell et al., 2019). For younger children, community-based interventions focusing on parenting or social-emotional learning may be well suited (e.g., child health centers, playgroups etc.). Research has also led to recommendations that interventions delivered to parents may positively support children's internalizing problems (Baughman et al., 2020). During the COVID-19 pandemic, it also became apparent how beneficial online support and programs can be. Therefore, reviewing the effectiveness of programs across the community for children aged 3- to 5-years and their parents is required.
While there are few internalizing disorder prevention programs created for early childhood; the programs available appear to show promising results. To date, no studies have systematically reviewed social and emotional programs specifically addressing children aged 3- to 5-years. The current study aims to investigate the effectiveness of social and emotional programs in the prevention of internalizing symptoms in children aged 3- to 5-years. The study will examine data from prevention programs to provide more conclusive results regarding the effectiveness of the programs.
This paper conducts a systematic review and meta-analysis of randomized control trials evaluating programs for use with children aged 3- to 5-years and their parents. To facilitate the further adoption and creation of programs, the systematic review will address the following research questions:
1. Are social and emotional programs effective for the prevention of internalizing disorders in early childhood (3- to 5-years)?
2. Which characteristics of the featured programs are related to the effectiveness of the programs in reducing internalizing disorders?
Materials and methods
Protocol and registration
The study's protocol was prospectively published and registered with the International Prospective Register of Systematic Reviews (PROSPERO) before screening studies for inclusion and was allocated the registration number CRD42021261323. An amendment was reported, changing the eligibility criteria to only include randomized controlled trials. The preferred reporting items for systematic reviews and meta-analyses (PRISMA) guidelines were consulted to perform the literature review (Page et al., 2021), (see Supplementary material).
Eligibility criteria
Types of studies
The review considered experimental studies where they were (a) published from 2000 to 2021, to ensure that the programs were still feasible to continue to be executed, (b) written in English, due to language constraints of the reviewers, (c) used a randomized control trial (RCT) methodology, due to the methodology being considered the gold standard, and (d) published in a peer-reviewed scientific journal.
Participants
Population: The review considered studies that included children with a mean age between 3 and 5 years. Studies focusing on children with externalizing difficulties, developmental disabilities, or that were treating a specific disorder were not included.
Inclusion criteria
Intervention: The review included universal, and targeted interventions (i.e., children at risk) that focused on preventing internalizing problems. Studies were eligible if they included psychological, psychosocial, or educational interventions that were implemented to either children or parents. If the study's intervention also focused on parents but assessed the intervention's outcome on children, it was still included. The review only focused and reported on the specific outcomes for children. Comparators: Studies were included when the intervention group was compared to a control group. Randomized control trial methodologies were included due to being considered more rigorous and were thought to contribute to the quality of studies Outcomes: Internalizing symptoms were the primary outcome measure for this review, e.g., the Strengths and Difficulties Questionnaire (Goodman, 1997), Behavior Assessment System for Children (Reynolds, 2010), and the Preschool Anxiety Scale (Edwards et al., 2010). Exclusion criteria: Studies were excluded if they were duplicates or used duplicate samples and data. Duplicates were be identified and removed based on authors or sample populations and/or sample data. Literature reviews and meta-analyses were also excluded. Follow up: Some studies provided follow up data (i.e., 6 and 12 months following the intervention). Follow up data was extracted if available, however the control groups were required to have remained the same throughout the study and not have received any intervention.
Information sources and search strategy
The full electronic search was completed on August 12th, 2021. Three electronic databases (PsycINFO, Embase, and MEDLINE) were identified and searched for articles. The databases were selected due to the social and emotional programs being multidisciplinary and that these databases allow searches to be refined to participants' age ranges. Databases were searched using a combination of terms (full search terms are provided in Supplementary material).
Data collection and analysis
Selection of studies
Studies for inclusion were imported to Endnote X9 software (Clarivate Analytics, 2018) and duplicates were removed. An eligibility assessment was performed in a standardized manner by one reviewer. Titles and abstracts from the initial search were reviewed to determine the relevance of the articles. Studies from the initial search were excluded if the title and abstract did not meet the eligibility criteria. The remainder of the studies were read, reviewed, and selected for inclusion if they met the standard inclusion criteria. A second reviewer then utilized ASReview software (van de Schoot et al., 2021), reviewed ten percent of the initial search, and then had machine learning complete the review of articles. Reviewers resolved any differences through consensus. Additional reference mining was then also completed, the selected study's reference lists and citations were reviewed through a hand search.
Data screening
The screening process of studies is displayed in a “Flow of Studies” diagram as depicted below in Figure 1 as per the PRISMA guidelines (Page et al., 2021).
Figure 1. Identification and selection of studies for inclusion in the meta-analysis. Adapted from The PRISMA Statement (Page et al., 2021).
Data extraction
One researcher independently obtained details from the included RCTs. The information that was extracted included the study, country, intervention program, population, sample size, participants' ages, number of sessions, the mode of delivery, the outcome measure(s), and the measure intervals (see Table 1).
Table 1. Summary of the study characteristics of the included studies (ordered by author).
Data extracted for analysis included means, standard deviations, and sample sizes for intervention and control group at pre-intervention, post-intervention, and follow-up on reliable and valid outcome/symptom rating scales for depression, anxiety, and internalizing symptoms (see Supplementary material). If multiple internalizing measures were used in studies, the measure that was selected in the study to specifically assess internalizing symptoms and was most representative of internalizing symptoms were used. When studies reported mothers and fathers separately, data were assessed separately. When studies utilized multiple comparison conditions, the conditions were separated, and both were compared to the control condition. It was ensured that intervention groups were not included twice in a synthesized effect size. If studies utilized an intervention group, an active control, and a waitlist control, the intervention and active control data were assessed separately. When data was unable to be extracted, the reviewer contacted the article's corresponding author to attain the data, if data was unable to be attained, the studies were removed from the meta-analysis (see Supplementary material). Due to a short timeframe to run the data-analysis, some data was attained from contacted authors, however, it was not within the timeframe of the data-analysis and was unable to be included.
Assessment of study quality and risk of bias
Quality and risk of bias was assessed using the Revised Cochrane risk-of-bias tool (RoB 2; Higgins and Thomas, 2019). Risk of bias was assessed by one researcher. Risk of bias was reported separately for each of the five criteria: the randomization process, deviations from the intended interventions, missing outcome data, measurement of the outcome, and selection of the reported result. Domains were scored as (1) low risk, (2) some concerns, and (3) high risk.
Statistical analysis
Data synthesis
All data were synthesized using the statistical software program Jamovi and the Meta-Analysis for JAMOVI, R (MAJOR) Package version 1.2.0. (Hamilton, 2019; The Jamovi Project, 2021). A meta-analysis was completed on data from all studies to examine the intervention effects for internalizing problems as a complete construct. Two additional analyses were planned to assess if the interventions had a continuing effect after follow-up assessment, 6–7 months, and 12 months.
Effect size calculations
Effect size was calculated utilizing Hedges g, calculated as:
. Hedge's g was utilized due to the small number of studies included, as it is more conservative. Standardized mean differences were used (the standardized mean difference between the two groups at post-treatment) as it accounted for the variability in measurements used for the study outcomes and it includes an adjustment to address small sample sizes (Hedges and Olkin, 2014). A 95% confidence interval was reported. Hedge's g was interpreted according to Cohen's guidelines of 0.2, 0.5, and 0.8 referring to small, moderate, and large effect sizes, respectively (Cohen, 2013).
Aggregation of effect sizes
The aggregate effect sizes were estimated using the random effects model, which makes the assumption that true effect size varies in each study, therefore the studies in the analysis represent a random sample of effect-sizes. The approach allows for the estimation of differences in the effects of studies that are not attributed to error. The estimated heterogeneity is then used to support the accurate weighting of individual studies when estimating the aggregation of effect size (DerSimonian and Kacker, 2007).
Statistical heterogeneity was determined through the Q statistic and I2 statistic. To quantify the heterogeneity in the pooled estimates I2statistic index was used, where heterogeneity was classified as low, moderate, or high with an I2statistic value of 25, 50, and 75%, respectively (Higgins and Thomas, 2019).
Moderator analyses
Moderator analysis should only be utilized when there is significant variability across effect sizes, which may suggest the likelihood of a moderator. The study used I2statistic to indicate if moderator analyses should be conducted. Two moderators were planned, assessing prevention type (i.e., targeted, and universal prevention), and who the prevention was provided to (i.e., caregiver[s], or child).
Funnel plot asymmetry
To further assess for publication bias, the funnel plot was examined. The funnel plot plots the study's effect sizes against standard error, assuming that effects from larger studies are generally more consistent (Egger et al., 1997). Egger et al. (1997) regression test was proposed to be used to test funnel plot asymmetry.
Results
Description of studies
Study characteristics
Of the seventeen studies identified, a total number of 1,813 intervention and 1,568 control participants were included. Sample sizes of the included studies varied considerably from between 14 participants (N'zi et al., 2016), and 734 (Dadds and Roth, 2008), with a median of 263 participants. Of the seventeen studies, eight studies were from Australia, five studies were from USA, and the remaining studies were from Germany, Iran, Sweden, and England.
Prevention type
There were seven universal prevention programs, and ten targeted prevention programs. All universal prevention programs took place within a school setting. Of the studies implementing targeted preventions, six studies focused on populations of inhibited preschool children (Rapee et al., 2005; Kennedy et al., 2009; Chronis-Tuscano et al., 2015; Lau et al., 2017; Morgan et al., 2017; Bayer et al., 2018), one study focused on low-income families at risk of maltreatment (Carta et al., 2013), one study focused on children with parents that have a diagnosed anxiety disorder (Cartwright-Hatton et al., 2018), one study focused on children with elevated anxiety symptoms (Edrissi et al., 2019), and one study focused on children living in kinship care (N'zi et al., 2016).
Randomization
The randomization in studies varied in terms of whether it occurred at the school (Dadds and Roth, 2008; Hahlweg et al., 2010; Anticich et al., 2013; Fishbein et al., 2016; Eninger et al., 2021; 29%), class (13%; Domitrovich et al., 2007; Pahl and Barrett, 2010), or individual level (58%). All studies that utilized a targeted prevention method utilized individual randomization.
Control groups
Six studies utilized usual care as their control group and had no intervention/treatment as usual (Rapee et al., 2005; Domitrovich et al., 2007; Dadds and Roth, 2008; Hahlweg et al., 2010; Bayer et al., 2018; Cartwright-Hatton et al., 2018), nine studies utilized waitlist control groups, where the control group underwent the intervention at a later date (Kennedy et al., 2009; Pahl and Barrett, 2010; Carta et al., 2013; Chronis-Tuscano et al., 2015; N'zi et al., 2016; Lau et al., 2017; Morgan et al., 2017; Edrissi et al., 2019; Eninger et al., 2021), and one study utilized an unspecified attention control (Fishbein et al., 2016). It is noted that Anticich et al. (2013) had an intervention group, an active comparison group, and a waitlist control; the active comparison and intervention groups were separated independently in the statistical analysis.
Prevention programs
Four prevention programs were delivered to children, ten prevention programs were delivered to parents/caregivers, and three prevention programs were delivered to both parents and children. Most intervention programs identified in the review utilized cognitive behavior therapy (CBT; 53%). Other studies fell under the umbrella of parent training, that is, Planned Activities Training (Carta et al., 2013), Parent Child Interaction therapy (Chronis-Tuscano et al., 2015; N'zi et al., 2016), Emotion-Focused Parenting (Edrissi et al., 2019), and Triple P Positive Parenting Program (Hahlweg et al., 2010). Three studies also utilized the PATHS program which is based on the affective-behavior-cognitive-dynamic model (Domitrovich et al., 2007; Fishbein et al., 2016; Eninger et al., 2021).
Program format and mode of delivery
Eight of the prevention programs were facilitated by psychologists, three were facilitated by post-graduate psychology trainees, four programs were facilitated by teachers, one program was presented online and was parent-led, and one program was facilitated by research staff with a bachelor's degree. The majority of programs were conducted in a group setting (82%), two targeted (12%) programs were provided individually (Carta et al., 2013; N'zi et al., 2016) focusing on parenting, and one program (6%; was conducted individually to parents completing an online program (Morgan et al., 2017).
Program sessions
The length of the programs ranged from a one-day session to 44 sessions, with most programs (53%) being delivered in between six and eight sessions (median = 8). Most studies (76%) ran the majority of sessions weekly, with two studies running sessions fortnightly, one running sessions biweekly, and one running a day workshop.
Outcome measures
Of the studies identified in the systematic review, the majority used measures that assessed internalizing problems as a construct (53%), the remaining studies specifically assessed anxiety symptoms (47%), no studies specifically assessed symptoms of depression in children. Of the studies that assessed internalizing problems, two studies used the Strengths and Difficulties Questionnaire (Goodman, 1997), one study used the Behavior Assessment System for Children (Reynolds, 2010), three studies used the Child Behavior Checklist (Achenbach, 1999), two studies used the Preschool and Kindergarten Behavior Scales (Merrell, 2002), and one study used the Teacher Observation of Classroom Adaptation Revised (Werthamer-Larsson et al., 1989). Of the studies that assessed anxiety symptoms, five studies utilized the Preschool Anxiety Scale (Edwards et al., 2010), one study used the Anxiety and Related Disorders Interview Schedule (Brown and Barlow, 2014), one study used the Spence Children's Anxiety Scale (Spence, 1997), and one used the Social Competence and Behavior Evaluation (LaFreniere and Dumas, 1996).
Follow-up
Eleven studies identified in the systematic review reported pre- and post-data for the control and intervention groups, two studies reported 3-month follow-up data, one study reported 7-month follow-up data, four studies reported 6-month follow-up data, seven studies reported 12-month follow-up data, and one study reported 24-month follow-up data.
Risk of bias
The 17 RCTs were evaluated using the RoB2 tool. The quality of the methodology of the studies reported varied substantially (see Figure 2 for study quality ratings). Overall, five studies had “some concerns” for risk of bias, and the remaining twelve studies had “high concerns” for risk of bias. Concerns surrounding the risk of bias predominantly surrounded lack of clarity regarding the randomization process, and due to universal prevention studies utilizing cluster randomization. The weighted risk of bias is presented as a plot in Figure 3.
Figure 2. Methodological quality summary: judgements about each methodological quality item for each included study.
Figure 3. Methodological quality summary: judgments about each methodological quality item for each included study—as presented as percentages across all included studies.
Effect size analysis
The meta-analyses were completed to compare the intervention and control of the primary outcomes (internalizing problems) at post-intervention and 6- and 12-month follow-up. MAJOR was used to conduct the meta-analysis, and a random-effects model was used to weight the primary studies. Results for each outcome variable are provided within the Supplementary material.
Measures of internalizing symptoms
The overall effect size at post-intervention for the prevention of internalizing symptoms estimated a non-significant small-to-moderate effect size of−0.37 (n = 11, p = 0.23 CI −0.98, 0.23; Figure 4). There was significant heterogeneity (I2 = 98.1) found. Moderators (targeted/universal, caregiver intervention/child intervention) were entered to attempt to explain this heterogeneity, however, no significant relationships were found (see Table 2).
Figure 4. Effect size for internalizing problem score. Anticich et al. (2013) denoted the intervention group and Anticich et al. (2013) denotes the active control group.
Table 2. Meta-analysis and supplementary analyses for internalizing symptoms: analysis of standardized difference in means (hedges g).
Publication bias
There was some evidence of publication bias, as evidenced by inspection of the funnel plot. Additionally, Egger et al. (1997) regression test also showed funnel plot asymmetry (z = −2.37, p = 0.02). See Supplementary material for the funnel plot.
Six-and seven-month follow-up
The overall effect size at 6- and 7-month post-intervention estimated a significant small-to-moderate effect size of −0.38 (n= 7, p = 0.02, CI −0.69, −0.06; Figure 5). Egger's regression test indicated some evidence of publication bias (z = −2.35, p = 0.02) and significant heterogeneity (I2 = 83) was found.
Figure 5. Effect size for internalizing problem scores- 6 and 7 month follow up.
12-month follow-up
The overall effect size at 6-and 7-month post-intervention estimated a non-significant negligible effect size of −0.03 (n = 6, p = 0.81, CI −0.32, 0.25; Figure 6). Egger's regression test did not indicate evidence of publication bias (z- 1.19, p = 0.23). Significant heterogeneity (I2 = 84.78) was found.
Figure 6. Effect size for internalizing problem scores−12 month follow-up.
Discussion
This is the first meta-analysis specifically focusing on children aged 3- to 5-years, that reviewed the effects of both universal, and targeted interventions for both parents and children. The aim of the systematic review and meta-analysis was to determine whether social and emotional programs were effective for the prevention of internalizing disorders in early childhood (3- to 5-years), and in which characteristics of the featured programs were related to the efficacy of the programs in reducing internalizing disorders. Overall, the study included 3,381 children and identified 17 studies, consisting of seven universal prevention programs, and ten targeted prevention programs. Results of the meta-analyses revealed that prevention programs contributed a small-to-moderate significant effect size in reducing internalizing problems at 6-and 7-month post-intervention. However, no significant effect was found post-intervention, or in the 12-month follow-up period. There was significant heterogeneity in effect sizes between studies in all meta-analyses, however, neither the type of the prevention (i.e., universal, or targeted) nor whom the prevention was provided to (i.e., caregiver[s] or children) were found to be significant moderators of variance. While the 6- and 7-month post-intervention showed a significant effect, there is varying evidence to conclude that the universal and targeted programs are effective for the prevention of internalizing disorders. No included studies were rated as being low in bias, and there was significant funnel plot asymmetry indicating publication bias.
In synthesizing the results reported in the current study, it appears that social and emotional programs have a small-to-moderate effect on internalizing problems in the 6 months following the programs. This is consistent with other meta-analyses that have reported that studies often only detect significant changes when long-term follow-up assessments have been completed (Stockings et al., 2016; Werner-Seidler et al., 2017). Caldwell et al. (2019) discussed a trend where previous meta-analyses generally have shown small but significant prevention effects at 6-to-12 months, with effects tending to deteriorate by 12-month follow-up. It has been proposed that prevention programs may need a 6-to-12-month follow-up before significant change is identified, as prevention effects may only emerge when children experience increased risk, which may only emerge over time. It is also important to acknowledge that the results reported from the period immediately after the intervention, 6- to 7-month and 12-month follow-up may also not necessarily be from the same studies, as several studies only reported at a particular time point (e.g., only at 6-month follow up). This sampling difference may have also contributed to the differences in effects between time points, particularly at 6- and 12-month follow-up. Additionally, other meta-analyses (Fisak, 2014; Stockings et al., 2016; Werner-Seidler et al., 2017) addressing prevention often include data from children and adolescents and do not assess at a particular age period, as our analyses have done. Caldwell et al. (2019) proposed that direct comparisons including a wide range of age groups may not be appropriate, as young children generally exhibit less anxiety compared to adolescents. The differences in symptoms in an early childhood sample may be too small to find a prevention effect as there is less opportunity for improvement in scores.
The current study also reviewed characteristics of studies and how they related to the effectiveness of the programs in reducing internalizing problems. This was important in informing future directions and planning of social and emotional prevention programs. There appeared to be no significant effect when addressing whether programs were delivered to children or parents. None of the tested characteristics seemed to stand out as being associated with bigger effects.
Targeted programs that focused on inhibited and anxious children seemed to contribute to decreased internalizing symptoms more than universal interventions, although still not significantly. This was congruent with other meta-analyses that have previously assessed universal prevention programs which have also reported negligible-to-small effect sizes on internalizing problems (Yap et al., 2016; Werner-Seidler et al., 2017; Caldwell et al., 2019). Our results were also consistent with (Werner-Seidler et al., 2017) meta-analyses that reviewed 81 RCTs, where they only found a small effect on depression and anxiety and found that targeted programs showed greater effect sizes as opposed to universal programs. Universal programs may appear to be less effective than targeted programs as they are not directed at sub-clinical populations (i.e., inhibited children). It is thought that universal prevention programs aimed at broader and low-risk populations have less breadth for improvement, and thus results may be due to a floor effect. While targeted prevention programs may have more significant effects as they are more focused on children who are at greater risk of developing a disorder. While universal prevention effects appear to be less likely to be found as they include the broader population who are not at risk. However, due to universal programs being designed to target a broader population, even small effects of universal programs that are clinically significant are influential (Werner-Seidler et al., 2017). Compared to targeted programs, universal programs can intervene at a macro level, are more cost effective, may support children at risk of being overlooked, promote mental health literacy, and reduce stigmatization (Baughman et al., 2020).
Limitations and future research directions
Our results should be interpreted in the context of some limitations, including the identification and extraction of studies. The study searched three electronic databases, with seventeen research studies identified. Previous meta-analyses have been far broader and assessed a far greater number of studies due to having fewer constraints in their exclusion criteria. While this may be interpreted as a benefit, as to our knowledge, no previous meta-analyses have specifically assessed the early childhood period, it also limits the breadth of our findings. While including only RCTs was considered more rigorous and thought to contribute to the quality of studies included, it also limited the number of studies being reviewed. Future studies may broaden the inclusion criteria by including a wider range of research designs, for example, quasi-experimental and pre-post (e.g., Oorloff et al., 2021). Including a wider range of research designs may support the further investigation of new and emerging prevention programs. Furthermore, the search was limited by language bias, with the language barrier of the reviewers limiting the study, resulting in the selection of English-only papers. Moreover, while authors of the included studies were contacted to obtain missing data, authors were only provided with a brief period to respond due to time constraints surrounding the data analysis meaning that five otherwise eligible studies were excluded (see Supplementary material). It is possible that the inclusion of these studies might have modified the validity and conclusion of the review.
Additionally, a significant limitation was the evidence of risk of bias. No studies were rated as “low risk of bias”, and the meta-analyses exhibited evidence of publication bias, which may have inflated effect sizes. The “file draw problem”, where studies with statistically significant results are more likely to be published than those findings that have no significant differences (Wagner III, 2022) is important to be acknowledged. It is unknown how many unpublished studies with non-significant results were unavailable on these sources. Publication bias creates confirmation bias toward successfully published literature, which can affect the accurate representation of the true intervention effect. However, some studies utilized the publication of study protocols, and the increasing trend of this practice should reduce the selective publication of studies reporting group differences. Future reviewers may consider broadening their inclusion criteria and literature to maximize the breadth of their findings and to reduce potential publication bias.
An additional risk of bias included a lack of transparency surrounding the randomization process and the use of cluster randomization. The quality of prevention programs may be improved through using random-sequencing methods and using adequate allocation concealment, which few studies reported using. While it is plausible that many studies followed these methods, most studies did not provide sufficient information surrounding possible selection bias. All studies utilizing universal prevention programs used cluster randomization, given they all took place within school settings. Most studies utilizing cluster randomization were flagged in the randomization process during the RoB2 assessment and were rated as “high risk” for risk of bias. The main concern surrounding cluster designs is that participants in a cluster (i.e., a classroom or primary school as a whole) may respond similarly, and the results cannot be assumed to be independent (Eninger et al., 2021).
Future research would benefit from identifying the characteristics which improve program retention and follow up outcomes (Hahlweg et al., 2010). This study sought to identify differences in outcomes for programs delivered to parents and young children, along with targeted and universal programs. Additional research which considers specific factors of intervention, such as coping skills being developed (Bernaras et al., 2019). Furthermore, our study is limited by focusing on prevention of symptoms and future reviews may benefit from inclusion of interventions targeted toward reducing symptoms in young children already presenting with internalizing problems (Blewitt et al., 2021).
Conclusion
Findings from the current systematic review and meta-analysis suggest that there may be value in ongoing development and evaluation of prevention programs for internalizing programs for children aged 3-to-5 years, as they impact students and reduce internalizing difficulties within the 6- to 7- month timeframe following prevention programs. However, results should be interpreted with the provision that the overall quality of the included studies was low, and there was significant heterogeneity. Future individual studies should prioritize minimizing the use of clustered randomization, publish study protocols, and report clearer method and randomization approaches. Future meta-analyses should also involve the incorporation of a wider range of inclusion criteria (e.g., increased research designs) and should also involve grouping research by age range (e.g., preschool, middle years, and youth) to determine if combining of age groups is supporting a floor effect.
Due to mental health difficulties in early life having a significant impact on future health, it is vital to build the foundations of social and emotional learning during early development. Prevention programs are a proactive and macro approach to preventing psychopathology and support children's development of social-emotional well-being. Given the significant impact of internalizing problems for developing children, it is worth continuing to pursue the development and evaluation of prevention programs, as these support children and communities to flourish.
Data availability statement
The original contributions presented in the study are included in the article/Supplementary material, further inquiries can be directed to the corresponding author.
Author contributions
All authors listed have made a substantial, direct, and intellectual contribution to the work and approved it for publication.
Acknowledgments
This research was conducted as partial fulfillment of the requirements for the degree of Master of Clinical Psychology at Curtin University.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyg.2023.1061825/full#supplementary-material
References
Achenbach, T. M. (1999). The Child Behaviour Checklist and Related Instruments. The Use of Psychological Testing for Treatment Planning and Outcome Assessment. 2nd ed. Mahwah, NJ: Lawrence Erlbaum Associates Publishers. p. 429–466.
Aksoy, P. (2019). How to access social emotional learning of preschool children through different decision-making methods. Eur. J. Educ. Stud. 6, 463–481. doi: 10.5281/zenodo.3529826
Anticich, S. A., Barrett, P. M., Silverman, W., Lacherez, P., and Gillies, R. (2013). The prevention of childhood anxiety and promotion of resilience among preschool-aged children: a universal school based trial. Adv. Sch. Ment. Health Promot. 6, 93–121. doi: 10.1080/1754730X.2013.784616
Ardoin, N. M., and Bowers, A. W. (2020). Early childhood environmental education: a systematic review of the research literature. Educ. Res. Rev. 31, 100353. doi: 10.1016/j.edurev.2020.100353
Baughman, N., Prescott, S. L., and Rooney, R. (2020). The prevention of anxiety and depression in early childhood. Front. Psychol. 11, 517896. doi: 10.3389/fpsyg.2020.517896
Bayer, J. K., Beatson, R., Bretherton, L., Hiscock, H., Wake, M., Gilbertson, T., et al. (2018). Translational delivery of cool little kids to prevent child internalising problems: Randomised controlled trial. Aus. N. Z. J. Psychiatry. 52, 181–191. doi: 10.1177/0004867417726582
Bernaras, E., Jaureguizar, J., and Garaigordobil, M. (2019). Child and adolescent depression: a review of theories, evaluation instruments, prevention programs, and treatments. Front. Psychol. 10, 543. doi: 10.3389/fpsyg.2019.00543
Bierman, K. L., Heinrichs, B. S., Welsh, J. A., and Nix, R. L. (2021). Reducing adolescent psychopathology in socioeconomically disadvantaged children with a preschool intervention: a randomized controlled trial. Am. J. Psychiatry. 178, 305–312. doi: 10.1176/appi.ajp.2020.20030343
Bitsko, R. H., Claussen, A. H., Lichtstein, J., Black, L. J., Everett Jones, S., Danielson, M. D., et al. (2022). Surveillance of Children's Mental Health – United States, 2013 – 2019. Morbidity and Mortality Weekly Report - Supplements 71, 1–42. doi: 10.15585/mmwr.su7102a1
Blewitt, C., O'Connor, A., Morris, H., May, T., Mousa, A., Bergmeier, H., et al. (2021). A systematic review of targeted social and emotional learning interventions in early childhood education and care settings. Early Child Dev. Care 191, 2159–2187. doi: 10.1080/03004430.2019.1702037
Brown, T. A., and Barlow, D. H. (2014). Anxiety and Related Disorders Interview Schedule for DSM-5 (ADIS-5L): Lifetime Version. Client Interview Schedule. Oxford: Oxford University Press.
Caldwell, D. M., Davies, S. R., Hetrick, S. E., Palmer, J. C., Caro, P., López-López, J. A., et al. (2019). School-based interventions to prevent anxiety and depression in children and young people: a systematic review and network meta-analysis. Lancet Psychiatry. 6, 1011–1020. doi: 10.1016/S2215-0366(19)30403-1
Caldwell, D. M., Davies, S. R., Thorn, J. C., Palmer, J. C., Caro, P., Hetrick, S. E., et al. (2021). School-based interventions to prevent anxiety, depression and conduct disorder in children and young people: a systematic review and network meta-analysis. Public Health Res. 9. doi: 10.3310/phr09080
Carta, J. J., Lefever, J. B., Bigelow, K., Borkowski, J., and Warren, S. F. (2013). Randomized trial of a cellular phone-enhanced home visitation parenting intervention. Pediatrics 132, S167–S173. doi: 10.1542/peds.2013-1021Q
Cartwright-Hatton, S., Ewing, D., Dash, S., Hughes, Z., Thompson, E. J., Hazell, C. M., et al. (2018). Preventing family transmission of anxiety: feasibility RCT of a brief intervention for parents. Br. J. Clin. Psychol. 57, 351–366. doi: 10.1111/bjc.12177
Chatterton, M. L., Bayer, J. K., Engel, L., Rapee, R. M., Beatson, R., Hiscock, H., et al. (2020). Cost-effectiveness of preventing child internalising problems: results from the translational trial of Cool Little Kids at school entry. J. Anxiety Disord. 70, 102191. doi: 10.1016/j.janxdis.2020.102191
Chronis-Tuscano, A., Rubin, K. H., O'Brien, K. A., Coplan, R. J., Thomas, S. R., Dougherty, L. R., et al. (2015). Preliminary evaluation of a multimodal early intervention program for behaviorally inhibited preschoolers. J. Consult. Clin. Psychol. 83, 534–540. doi: 10.1037/a0039043
Cohen, J. (2013). Statistical Power Analysis for the Behavioral Sciences. Cambridge, MA: Academic press.
Crescentini, C., Feruglio, S., Matiz, A., Paschetto, A., Vidal, E., Cogo, P., et al. (2020). Stuck outside and inside: an exploratory study on the effects of the COVID-19 outbreak on Italian parents and children's internalizing symptoms. Front. Psychol. 11, 586074. doi: 10.3389/fpsyg.2020.586074
Dadds, M. R., and Roth, J. H. (2008). Prevention of anxiety disorders: results of a universal trial with young children. J. Child Fam. Stud. 17, 320–335. doi: 10.1007/s10826-007-9144-3
Davey, G. C., and McGorry, P. D. (2019). Early intervention for depression in young people: a blind spot in mental health care. The Lancet Psychiatry 6, 267–272. doi: 10.1016/S2215-0366(18)30292-X
DerSimonian, R., and Kacker, R. (2007). Random-effects model for meta-analysis of clinical trials: an update. Contemp. Clin. Trials 28, 105–114. doi: 10.1016/j.cct.2006.04.004
Doering, S., Larsson, H., Halldner, L., Gillberg, C., Kuja-Halkola, R., and Lundström, S. (2022). Internalizing symptoms in adolescence are modestly affected by symptoms of anxiety, depression, and neurodevelopmental disorders in childhood. BMC Psychiatry 22, 233. doi: 10.1186/s12888-022-03875-6
Domitrovich, C. E., Cortes, R. C., and Greenberg, M. T. (2007). Improving young children's social and emotional competence: a randomized trial of the preschool “PATHS” curriculum. J. Prim. Prev. 28, 67–91. doi: 10.1007/s10935-007-0081-0
Domitrovich, C. E., Li, Y., Mathis, E. T., and Greenberg, M. T. (2019). Individual and organizational factors associated with teacher self-reported implementation of the PATHS curriculum. J. Sch. Psychol. 76, 168–185. doi: 10.1016/j.jsp.2019.07.015
Duan, L., Shao, X., Wang, Y., Huang, Y., Miao, J., Yang, X., et al. (2020). An investigation of mental health status of children and adolescents in China during the outbreak of COVID-19. J. Affect. Disord. 275, 112–118. doi: 10.1016/j.jad.2020.06.029
Edrissi, F., Havighurst, S. S., Aghebati, A., Habibi, M., and Arani, A. M. (2019). A pilot study of the tuning in to kids parenting program in Iran for reducing preschool children's anxiety. J. Child Fam. Stud. 28, 1695–1702. doi: 10.1007/s10826-019-01400-0
Edwards, S. L., Rapee, R. M., Kennedy, S. J., and Spence, S. H. (2010). The assessment of anxiety symptoms in preschool-aged children: the revised preschool anxiety scale. J. Clin. Child Adol. Psychol. 39, 400–409. doi: 10.1080/15374411003691701
Egger, M., Smith, G. D., Schneider, M., and Minder, C. (1997). Bias in meta-analysis detected by a simple, graphical test. BMJ 315, 629–634. doi: 10.1136/bmj.315.7109.629
Eklund, K., Kilpatrick, K. D., Kilgus, S. P., and Haider, A. (2018). A systematic review of state-level social-emotional learning standards: implications for practice and research. School Psych. Rev. 47, 316–326. doi: 10.17105/SPR-2017.0116.V47-3
Eninger, L., Ferrer-Wreder, L., Eichas, K., Olsson, T. M., Hau, H. G., Allodi, M. W., et al. (2021). A cluster randomized trial of Promoting Alternative Thinking Strategies (PATHS®) with Swedish Preschool Children. Front. Psychol. 12, 695288. doi: 10.3389/fpsyg.2021.695288
Eurenius, E., Mohamed, A. F., Lindkvist, M., Ivarsson, A., Öhlund, I., and Vaezghasemi, M. (2021). Social-Emotional Problems among 3-year-olds are associated with an unhealthy lifestyle: a population-based study. Front. Public Health 9, 694832. doi: 10.3389/fpubh.2021.694832
Finsaas, M. C., Kessel, E. M., Dougherty, L. R., Bufferd, S. J., Danzig, A. P., Davila, J., et al. (2020). Early childhood psychopathology prospectively predicts social functioning in early adolescence. J. Clin. Child Adol. Psychol. 49, 353–364. doi: 10.1080/15374416.2018.1504298
Fisak, B. (2014). The prevention of anxiety in preschool-aged children: development of a new program and preliminary findings. Mental Health Prev. 2, 18–25. doi: 10.1016/j.mhp.2014.07.001
Fishbein, D. H., Domitrovich, C., Williams, J., Gitukui, S., Guthrie, C., Shapiro, D., et al. (2016). Short-term intervention effects of the PATHS curriculum in young low-income children: capitalizing on plasticity. J. Prim. Prev. 37, 493–511. doi: 10.1007/s10935-016-0452-5
Forbes, M. K., Rapee, R. M., and Krueger, R. F. (2019). Opportunities for the prevention of mental disorders by reducing general psychopathology in early childhood. Behav. Res. Ther. 119, 103411. doi: 10.1016/j.brat.2019.103411
Ghandour, R. M., Sherman, L. J., Vladutiu, C. J., Ali, M. M., Lynch, S. E., Bitsko, R. H., et al. (2019). Prevalence and treatment of depression, anxiety, and conduct problems in US children. J. Pediatr. 206, 256–267.e3. doi: 10.1016/j.jpeds.2018.09.021
Goodman, R. (1997). The strengths and difficulties questionnaire: a research note. J. Child Psychol. Psychiatry 38, 581–586. doi: 10.1111/j.1469-7610.1997.tb01545.x
Green, A. L., Ferrante, S., Boaz, T. L., Kutash, K., and Wheeldon-Reece, B. (2021). Social and emotional learning during early adolescence: effectiveness of a classroom-based SEL program for middle school students. Psychol. Sch. 58, 1056–1069. doi: 10.1002/pits.22487
Hahlweg, K., Heinrichs, N., Kuschel, A., Bertram, H., and Naumann, S. (2010). Long-term outcome of a randomized controlled universal prevention trial through a positive parenting program: is it worth the effort? Child Adol. Psychiatry Mental Health, 4, 14. doi: 10.1186/1753-2000-4-14
Hamilton, W. K. (2019). MAJOR: Meta-Analysis for JAMOVI [Computer Software]. Available online at: https://www.github.com/kylehamilton/MAJOR
Hatoum, A. S., Rhee, S. H., Corley, R. P., Hewitt, J. K., and Friedman, N. P. (2018). Etiology of stability and growth of internalizing and externalizing behavior problems across childhood and adolescence. Behav. Genet. 48, 298–314. doi: 10.1007/s10519-018-9900-8
Hedges, L. V., and Olkin, I. (2014). Statistical Methods for Meta-analysis. Cambridge, CA: Academic Press.
Higgins, J. P., and Thomas, J. (2019). Cochrane Handbook for Systematic Reviews of Interventions. Hoboken, NJ: John Wiley and Sons.
Huber, L., Plötner, M., Tina In-Albon, S.tadelmann, S., and Schmitz, J. (2019). The perspective matters: a multi-informant study on the relationship between social–emotional competence and preschoolers' externalizing and internalizing symptoms. Child Psychiatry Hum. Dev. 50, 1021–1036. doi: 10.1007/s10578-019-00902-8
Ishikawa, S., Kishida, K., Oka, T., Saito, A., Shimotsu, S., Watanabe, N., et al. (2019). Developing the universal unified prevention program for diverse disorders for school-aged children. Child Adolesc. Psychiatry Ment. Health 13, 44. doi: 10.1186/s13034-019-0303-2
Johnstone, K. M., Kemps, E., and Chen, J. (2018). A meta-analysis of universal school-based prevention programs for anxiety and depression in children. Clin. Child Fam. Psychol. Rev. 21, 466–481. doi: 10.1007/s10567-018-0266-5
Jokela, M., Ferrie, J., and Kivimäki, M. (2009). Childhood problem behaviors and death by midlife: the British national child development study. J. Am. Acad. Child Adolesc. Psychiatry 48, 19–24. doi: 10.1097/CHI.0b013e31818b1c76
Kennedy, S. J., Rapee, R. M., and Edwards, S. L. (2009). A selective intervention program for inhibited preschool-aged children of parents with an anxiety disorder: effects on current anxiety disorders and temperament. J. Am. Acad. Child Adolesc. Psychiatry 48, 602–609. doi: 10.1097/CHI.0b013e31819f6fa9
Kertz, S. J., Petersen, D. R., and Stevens, K. T. (2019). Cognitive and attentional vulnerability to depression in youth: a review. Clin. Psychol. Rev. 71, 63–77. doi: 10.1016/j.cpr.2019.01.004
LaFreniere, P. J., and Dumas, J. E. (1996). Social competence and behaviour evaluation in children ages 3 to 6 years: the short form (SCBE-30). Psychol. Assess. 8, 369. doi: 10.1037/1040-3590.8.4.369
Lakes, K., Nguyen, H. M., Jones, M., and Schuck, S. E. B. (2019). I am me: adolescent perspectives of a school-based universal intervention program designed to promote emotional competence. Int. J. Emot. Educ. 11, 97–114. Available online at: https://www.um.edu.mt/library/oar/handle/123456789/42650
Lau, E. X., Rapee, R. M., and Coplan, R. J. (2017). Combining child social skills training with a parent early intervention program for inhibited preschool children. J. Anxiety Disord. 51, 32–38. doi: 10.1016/j.janxdis.2017.08.007
Lee, K. S., and Vaillancourt, T. (2020). The role of childhood generalized anxiety in the internalizing cluster. Psychol. Med. 50, 2272–2282. doi: 10.1017/S0033291719002484
Loevaas, M. E. S., Lydersen, S., Sund, A. M., Neumer, S.-.P., Martinsen, K. D., et al. (2020). A 12-month follow-up of a transdiagnostic indicated prevention on internalizing symptoms in school-aged children: the results from the EMOTION study. Child Adolesc. Psychiatry Ment. Health 14, 15. doi: 10.1186/s13034-020-00322-w
Morgan, A. J., Rapee, R. M., Salim, A., Goharpey, N., Tamir, E., McLellan, L. F., et al. (2017). Internet-delivered parenting program for prevention and early intervention of anxiety problems in young children: Randomized controlled trial. J. Am. Acad. Child Adolesc. Psychiatry 56, 417–425.e1. doi: 10.1016/j.jaac.2017.02.010
N'zi, A. M., Stevens, M. L., and Eyberg, S. M. (2016). Child directed interaction training for young children in kinship care: a pilot study. Child Abuse and Neglect 55, 81–91. doi: 10.1016/j.chiabu.2016.03.001
Oorloff, S., Rooney, R., Baughman, N., Kane, R., McDevitt, M., and Bryant, A. (2021). The impact of the Aussie optimism program on the emotional coping of 5- to 6-year-old children. Front. Psychol. 12, 570518. doi: 10.3389/fpsyg.2021.570518
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., et al. (2021). The PRISMA 2020 statement. An updated guideline for reporting systematic reviews. BMJ 372, n71. doi: 10.1136/bmj.n71
Pahl, K. M., and Barrett, P. M. (2010). Preventing anxiety and promoting social and emotional strength in preschool children: a universal evaluation of the fun friends program. Adv. Sch. Ment. Health Promot. 3, 14–25. doi: 10.1080/1754730X.2010.9715683
Pedersen, M. L., Holen, S., Lydersen, S., Martinsen, K., Neumer, S., Adolfsen, F., et al. (2019). School functioning and internalizing problems in young schoolchildren. BMC Psychology 7, 88. doi: 10.1186/s40359-019-0365-1
Productivity Commission (2020). Mental Health, Report no. 95. Melbourne, VIC: Productivity Commission.
Rapee, R. M., Kennedy, S., Ingram, M., Edwards, S., and Sweeney, L. (2005). Prevention and early intervention of anxiety disorders in inhibited preschool children. J. Consult. Clin. Psychol. 73, 488–497. doi: 10.1037/0022-006X.73.3.488
Reynolds, C. R. (2010). Behavior assessment system for children. Corsini Encyc. Psychol. 1–2. doi: 10.1002/9780470479216.corpsy0114
Stockings, E. A., Degenhardt, L., Dobbins, T., Lee, Y. Y., Erskine, H. E., Whiteford, H. A., et al. (2016). Preventing depression and anxiety in young people: a review of the joint efficacy of universal, selective and indicated prevention. Psychol. Med. 46, 11–26. doi: 10.1017/S0033291715001725
The Jamovi Project. (2021). https://www.jamovi.org
van de Schoot, R., de Bruin, J., Schram, R., Zahedi, P., de Boer, J., Weijdema, F., et al. (2021). An open-source machine learning framework for efficient and transparent systematic reviews. Nat. Mach. Intel. 3, 125–133. doi: 10.1038/s42256-020-00287-7
Wagner III, J. A. (2022). The influence of unpublished studies on results of recent meta-analyses: Publication bias, the file drawer problem, and implications for the replication crisis. Int. J. Soc. Res. Methodol. 25, 639–644. doi: 10.1080/13645579.2021.1922805
Wergeland, G. J. H., Riise, E. N., and Öst, L. (2021). Cognitive behavior therapy for internalizing disorders in children and adolescents in routine clinical care: A systematic review and meta-analysis. Clin. Psychol. Rev. 83, 101918. doi: 10.1016/j.cpr.2020.101918
Werner-Seidler, A., Perry, Y., Calear, A. L., Newby, J. M., and Christensen, H. (2017). School-based depression and anxiety prevention programs for young people: A systematic review and meta-analysis. Clin. Psychol. Rev. 51, 30–47. doi: 10.1016/j.cpr.2016.10.005
Werthamer-Larsson, L., Kellam, S., and Ovesen-McGregor, K. E. (1989). Teacher Observation of Classroom Adaptation-Revised (TOCA-R). Johns Hopkins Prevention Centre Training Manual. Baltimore, MD: Johns Hopkins University.
Yap, M. B., Morgan, A. J., Cairns, K., Jorm, A. F., Hetrick, S. E., and Merry, S. (2016). Parents in prevention: a meta-analysis of randomized controlled trials of parenting interventions to prevent internalizing problems in children from birth to age 18. Clin. Psychol. Rev. 50, 138–158. doi: 10.1016/j.cpr.2016.10.003
Keywords: meta-analysis, anxiety, depression, early childhood, internalizing, prevention
Citation: Bolton B, Rooney RM, Hughes A, Hopkins A and Mancini VO (2023) Systematic review and meta-analysis of the prevention of internalizing disorders in early childhood. Front. Psychol. 14:1061825. doi: 10.3389/fpsyg.2023.1061825
Received: 05 October 2022; Accepted: 03 May 2023;
Published: 14 December 2023.
Edited by:
Gianluca Castelnuovo, Catholic University of the Sacred Heart, ItalyReviewed by:
Sara Bagur, University of the Balearic Islands, SpainElisabetta Conte, University of Milano-Bicocca, Italy
Copyright © 2023 Bolton, Rooney, Hughes, Hopkins and Mancini. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Rosanna Mary Rooney, ci5yb29uZXkmI3gwMDA0MDtjdXJ0aW4uZWR1LmF1