Cecilia Serena Pace1*
Stefania Muzi1
Alessandra Frigerio2
Wanda Morganti1
Victoria Bianchi1
Guyonne Rogier1- 1Department of Education Sciences, School of Social Sciences, University of Genoa, Genova, Italy
- 2Scientific Institute, IRCCS E. Medea, Child Psychopathology Unit, Bosisio Parini, Lecco, Italy
Background: This is a systematic review and meta-analysis of emotional and behavioral problems among Italian community adolescents in the last 20 years, as assessed through the ASEBA questionnaires CBCL 6–18, YSR 11–18 and TRF 6–18. Research questions address: (1) pooled means of problems’ scores in questionnaires scales; (2–3) variations in scores according to sociodemographic and time-related factors, and studies’ quality; (4) trends in research with ASEBA instruments along with other outcomes, e.g., psychopathological symptoms.
Methods: A systematic literature review of Scopus, EBSCO, PubMed, Web of Science, and ProQuest databases using the PRISMA 2020 guidelines was conducted on November, 2021, and of grey literature on December, 2021. The quality of studies was assessed through the Newcastle-Ottawa Scale.
Results: Forty-four studies were eligible for the systematic review, of which 34 were included for meta-analysis. Results showed that: (1) emotional-behavioral problems were higher when assessed by the CBCL and lower when assessed by the YSR compared to normative data; (2) there were no gender and age differences, except for higher scores of Anxious/Depression symptoms, in girls. (3) internalizing and attention problems increased over the last two decades. (4) major trends of Italian research investigate adolescents’ emotional behavioral problems concerning attachment, comorbid symptoms, especially internet addictions, and eating disorders.
Discussion: Despite some limitations (e.g., low-medium quality of most studies, no data on the TRF, under-representation of some geographical areas, some search-related choices), these data provides Italian practitioners and international researchers of some parameter to evaluate Italian adolescents emotional-behavioral problems. Registered on PROSPERO N. CRD42022299999.
Introduction
The World Health Organization defines “adolescence” as the period of life between 10 to 19 years old (1), indicating it as a time of developmental risk for the onset of mental disorders (1), which could be predictive of poor social and health adjustment up to adulthood (2). Therefore, the World Mental Health [WHO] encourages research on prodromal signs, developmental processes, and variations of adolescent mental health disorders, useful to support prevention as a priority (1). In this regard, decades of research have established the preventive utility of early detection of prodromic symptoms of mental disorders in the form of “emotional-behavioral problems” (1, 3, 4). According to Achenbach’s definition (3), these include internalizing problems – e.g., anxiety, depression, and/or withdrawal - and externalizing problems, such as behavioral problems (3), as well as other types of typical symptoms found in adolescence. These include namely social problems (like shyness, bullying, substance, and alcohol use or abuse), thought problems including dissociative symptoms, and attention problems (3).
Recent data show an increase in emotional-behavioral problems among adolescents in the last decades (5), and even more because of the COVID-19 pandemic (6). Specifically, pre- and post-pandemic evidence suggests an increase in anxiety and depression, particularly in girls (5, 7, 8). The last systematic review on the topic – dated 2014 – reports no increase in externalizing difficulties (9). This in apparent contrast with later contributions which show a rising prevalence of conduct disorders in clinical settings (7). Moreover, pandemic studies reveal contrasting findings. They either occasionally document no change (8) or show an increase in externalizing difficulties during the COVID-19 pandemic (10), especially when subclinical behavioral symptoms were present before the disease’s outbreak (11). Therefore, updating the meta-analytical data on the levels of adolescent emotional-behavioral difficulties may help to understand how they have varied over the last decade, including the pandemic years (12). This supports the research and prevention goals defined by the WHO (1).
An update appears crucial for Italy, where the latest epidemiological data date back to more than 10 years ago (13, 14). According to this information, Italy fell into average European values at that time (13, 14), with a prevalence of total problems around 8.2%. However, a recent UNICEF report estimates that 16.6% of Italian adolescents experienced a mental health condition in 2019, with a European prevalence of 19%, twice as much as 10 years ago (15). Therefore, updating data on the current state of Italy may help to understand if emotional-behavioral problems have increased. Moreover, it may show whether existing subthreshold problems are aggravated until the criteria for a psychiatric diagnosis are met, which types of problems have remained stable, and which have changed.
For this purpose, four decades of research depict the Achenbach Empirically Based Assessment System (ASEBA) (16, 17) as a reliable and widely used method of assessment for internalizing and externalizing difficulties in the age range of 6–18 years. This system is translated into more than one hundred languages and used in both research and clinical settings (4). Indeed, a recent review on internalizing and externalizing difficulties in children (4) found that 554 of 592 studies employed the ASEBA instruments. To date, cross-cultural comparisons with the ASEBA system greatly contributed to understanding trends in adolescent mental health disorders, for example by detecting more internalizing problems in girls and externalizing and attentional problems in boys, and higher syndrome scale scores in older teenagers (18).
Specifically, the system comprises three parallel questionnaires that can be used with adolescents: The parent-report Child Behavior Checklist (CBCL), the self-report Youth Self Report (YSR), and the teacher-report Teacher Report Form (TRF). After continuous empirically based modifications and updates in the items, (19), the latest versions of these questionnaires are dated back to 2001, specifically the CBCL 6–18 years, YSR 11–18 years, and TRF 6–18 years. All three are composed of a first part with questions on adaptive functioning and a second part that assesses emotional-behavioral problems through 113 items on a 3-point Likert scale. These questionnaires evaluate children’s problems according to 8 syndrome scales and three broadband scales. The broadband Total problems scale is the sum of all items; the Internalizing problems scale includes syndrome scales Withdrawn/Depressed, Anxious/Depressed, and Somatic Complaints; the Externalizing problems scale sums scores of Aggressive Behavior and Rule-breaking (CBCL 6–18)/Delinquent Behavior (YSR) syndromes scales. In addition, there are other three syndrome scales for Social problems, Attention problems, and Thought problems.
The ASEBA questionnaires can also be used to support a diagnosis based on criteria of the more recent version of the Diagnostic and Statistical Manual of mental disorders (DSM-5) (3). The DSM-oriented scales for the age range 6–18 refer to Affective problems, Anxiety problems, Somatic problems, Attention Deficit/Hyperactivity problems, Oppositional-Defiant problems, and Conduct problems (20). However, these have not been considered in this study as poorly used with non-clinical populations, and generally less employed compared to scores (16).
In Italy, the largest and most well-known study which used the 2001 version of the ASEBA is epidemiological research dating back to 2009 (21). However, the only available normative data comes from the previous versions of the CBCL and the TRF, which are dated back to 1991. These instruments show reliable psychometric properties are extensively used for both research and clinical purposes in the Italian population (13). Therefore, the current systematic review and meta-analysis focused on studies where the emotional-behavioral difficulties of Italian adolescents have been assessed through the CBCL, YSR, and TRF. The aim is to contribute to an update of the current knowledge of Italian adolescents’ mental health. To ensure grasping eventual changes in the levels of emotional-behavioral difficulties over time, this review included the versions of the questionnaires released in 2001, which are the most used in the last 20 years, especially in the last decade. Gender and age differences were also considered to further explore similarities and discrepancies with previous literature. Moreover, the ASEBA research has also identified connections between emotional-behavioral difficulties and other outcomes, such as comorbid “new” symptoms [e.g., internet addiction (22)], or psychological (e.g., attachment) or biographical (e.g., exposure to childhood adversities) characteristics (23, 24). For this reason, this review additionally aims to identify major trends in research on emotional-behavioral difficulties and other outcomes, to highlight possible foci of future meta-analyses. This will provide useful information to compare with data retrieved from the ASEBA questionnaires in populations that will be the object of a second part of this review. Specifically, these are clinical populations of adolescents who have received a diagnosis for a mental health disorder according to criteria of the fifth version of the Diagnostic and Statistical Manual of Mental Disorders (3) or the International Statistical Classification of Diseases, Injuries and Causes of Death version 11 (25). There are also adolescents at risk for the development of mental health disorders because of socioeconomic disadvantage (26), medical disorders, e.g., diabetes (27), or unfavorable biographic experiences, e.g., exposure to disaster or early placement in adoption, foster care or residential care due to childhood adversities (28).
Lastly, the methodological characteristics and quality of the studies will be reviewed and evaluated to assess their impact on the reported estimation of emotional and behavioral difficulties of Italian adolescents. This will help readers to frame the results by identifying the strengths and weaknesses of the current research and to formulate suggestions directing future research.
Objectives
This study aims to answer four research questions:
1) RQ1 What were the pooled mean scores of Italian adolescents’ emotional-behavioral problems -in terms of total, externalizing, internalizing problems, and specific scales- assessed through ASEBA?
2) RQ2 Do scores of emotional-behavioral problems vary according to socio-demographic (i.e., gender and age) variables?
3) RQ3 Were there any changes in problems’ scores over 20 years? And after the COVID-19 pandemic? Do the scores of emotional-behavioral problems vary according to methodological characteristics and the quality of the studies?
4) RQ4 What are the major trends in the research on relationships between emotional-behavioral difficulties of Italian adolescents and other outcomes, in terms of comorbid symptoms, or psychological and biographical features?
Methods
Protocol registration
The format of the methods and results was based on the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) 2020 guidelines (29). The study was pre-registered on PROSPERO (No. CRD42022299999).
Eligibility criteria
Inclusion and exclusion criteria are summarized below according to the PICOS format, except for the Comparison criteria which was not relevant for the aims of this systematic review.
• Population: Community adolescents aged 11–18 years living in Italy and without a psychiatric diagnosis or adolescents at-risk for a psychiatric disorder as defined in the introduction (3, 25–28). The latter population will be analyzed in the second part of this review.
• Intervention: Administration of at least one of the ASEBA instruments of the latest version from 2001 (i.e., CBCL 6–18, YSR 11–18, and TRF 6–18).
• Outcomes: The raw mean obtained by participants in at least one syndrome and/or broadband scale. The corresponding author was contacted when this information was not provided (i.e., not available in the full text of the article or full text not retrieved). In case this was not available, the contribution was excluded from meta-analyses but still remained eligible for the qualitative review.
• Study: Empirical and quantitative studies with original and not overlapping data, including gray literature.
Search strategy
Information sources
Searches were performed via Scopus, EBSCO (PsycINFO, PsycArticles and Behavioral Science Collection), PubMed, and all databases of Web of Science and ProQuest (listed in Appendix A). Gray literature was searched through the following strategies: checking the first 200 records on Google Scholar (30) asking for unpublished data from the contacted authors and sharing the unpublished data of team member Alessandra Frigerio. The latter required the stipulation of a registered agreement between the University of Genoa and the Scientific Institute E. Medea. Moreover, to complete the whole search strategy, a cross-check on the reference lists of the included contributions was performed. Searches on academic databases were performed on November 22nd, 2021, and the search for gray literature was performed on December 16th, 2021.
Search strategy
To retrieve contributions, sources were identified and keywords were listed to create a syntax of operationalized research questions. Keywords corresponded to two main constructs, namely “ASEBA” and “Italian,” related through the Boolean operator AND. Then, this list (detailed in Appendix A) was adapted to the respective languages of databases. A reduced syntax was used to search for gray literature on Google Scholar (see Appendix A).
Selection process
Following the PRISMA 2020 guidelines (29) and using the Zotero software, duplicates were removed. Following this operation, from 7,103 records, 6,347 remained for evaluation. Subsequently, two authors (WM, VB) independently screened abstracts and titles of the records through Zotero© Software, according to inclusion and exclusion criteria. After this screening process, full texts of the included records (n = 555) were downloaded and screened for eligibility in line with the inclusion and exclusion criteria. Disagreements in each phase were discussed and resolved by consensus (inter-rater agreement rate 92.73%). The selection process led to the final inclusion of 44 full texts including data on community adolescents. This is illustrated in Figure 1. Data on at-risk and clinical populations of adolescents will be the focus of the second part of this meta-analytic review. By the end of this procedure, all 44 full texts were eligible for the qualitative review but only 34 were eligible for meta-analyses.
Figure 1. Flow diagram summarizing the identification and selection process.
Data extraction
Two independent researchers (WM, VB) carried out the data extraction. Any arising discrepancies were resolved through consensus, consulting a third researcher (GR) if an agreement was not attained. For each contribution, the following data were extracted: (i) characteristics of the contributions: Authors, Publication year (coded as 2022 – publication year), publication status (published versus unpublished), diffusion (published in an international versus Italian journal); (ii) characteristics of participants: sample size (for both males and females, only males, and only females), gender composition (coded as % of males), mean age (for both males and females, only males, and only females), age range (in years); (iii) characteristics of methods: research design (e.g., cross-sectional, experimental, longitudinal), ASEBA measure used/extracted (CBCL, YSR, or TRF), time of data collection in respect to the COVID-19 pandemic (pre or post-pandemic), quality assessment (see below); (iv) outcomes: ASEBA scales (e.g., total, internalizing, externalizing), raw scores and standard deviations (for both males and females, only males, and only females).
Quality assessment
Quality assessment for studies included in the meta-analyses was performed through an adapted version of the checklist Newcastle-Ottawa Scale [NOS; (31–33)] for epidemiological studies. This evaluates specific aspects regarding selection (e.g., definition and representativeness of the cases), comparability (related to the inclusion of confounders), and outcome (linked to criteria such as the quality of the measurement process and the registration of response rate), and then provides a total score of assessment quality. Authors WM and VB independently rated quality, with GR and SM solving disagreements.
Statistical analyses
To compute pooled means, the meta and the metafor packages of the R software for Mac were used. These packages employed untransformed raw scores and account for the weight of the sample size to compute weighted pooled means (34). The random effect model was applied, according to the possibility that each study has an independent effect related to its sample (35). Also, when observations are significantly heterogeneous, random-effects models are thought to be more conservative and appropriate (36) allowing to make inferences regarding the general population.
In addition to the computation of pooled means, their standard errors, and their respective confidence interval (95%) to evaluate quality, the heterogeneity was explored using the Q statistic. Lastly, the moderating roles of continuous variables (gender composition, age, quality of the study, publication year) were assessed throughout the computation of meta-regression on pooled means and the test of heterogeneity throughout the Q statistic (33, 37). Because of the high homogeneity regarding categorical moderators (pre/post-pandemic period of data collection; design of research) and the consequent low statistical power, moderation analyses with categorical factors were not directly tested (38).
Instead, an exploratory approach was adopted performing sensitivity analyses. Indeed, when the number of studies with a value of a categorical moderator was low (i.e., ≤ 2) these contributions were left out and the changes in pooled mean, its statistical significance, and in the heterogeneity were evaluated. To better estimate the proportion of changes of these indexes from their original values, a percentage was computed. The same approach was adopted (i.e., sensitivity analyses) observing the changes in statistical indexes when leaving out studies with a small sample size (i.e., ≤ 25). The analyses were computed to check that studies with small sample sizes may significantly distort the estimation of average effect sizes.
Lastly, to estimate publication bias, funnel plots were created, visually inspected and the Egger linear regression method was used (39). In case of a statistically significant result (i.e., p < 0.01), a corrected effect size was calculated adopting Duval and Tweedie’s trim-and-fill method (40).
Results
Main characteristics of the included studies
The systematic search led to the identification of 44 independent contributions, and their main characteristics are displayed in Table 1. These studies were published between 2009 and 2021 and only one of them was unpublished (i.e., retrieved from grey literature search). Most were from international journals and only one was found in an Italian journal. Regarding the study design, three were experimental, one was longitudinal, and all of the others were cross-sectional. Sample sizes ranged from 13 to 3,399 participants and a total of 18,955 participants were on average between 11.12 and 17.40 years old. Most of the studies were conducted on mixed-gender samples, except for three which were carried out only among females and one only among males. No more than three researches were conducted after the COVID-19 pandemic. Then, 27 of the 44 studies reported data regarding the YSR, 17 of the CBCL 6–18, 4 of both YSR and CBCL, and none concerning the TRF. Lastly, concerning the risk of bias of the contributions included in the meta-analysis, results of the quality assessment evidenced 19.35% of studies were classified as high quality and the remaining as medium quality regarding the selection criteria. Regarding the exposure criteria, less satisfactory results were obtained, with 22.58% of studies being classified as “low.” Details of the total scores of quality assessments are available in Table 1.
Table 1. Main characteristics of the included studies (N = 44).
RQ1: the distribution of emotional behavioral problems
The number of studies, number of participants, and pooled means are shown in Table 2. Results are displayed for the total sample and separately for males and females.
Table 2. Pooled means of emotional-behavioral problems in the child behavior checklist 6–18a and youth self-report 11–18 among Italian teenagers.
Regarding CBCL, Figure 2 reports the forest plot resulting from data of Total problems, Figures 3, 4 show those for Internalizing problems (and related subscales) and for Externalizing problems (related subscales) respectively. Figure 5 displays those for Thought, Attention and Social problems scales.
Figure 2. Forest plot for CBCL total scores.
Figure 3. Forest plot for the internalizing CBCL scores. (A) CBCL internalizing problems. (B) CBCL withdrawn/depressed. (C) CBCL anxious/depressed. (D) CBCL somatic complaints.
Figure 4. Forest plot for the externalizing CBCL scores. (A) CBCL externalizing. (B) CBCL aggressive behavior. (C) CBCL rule breaking.
Figure 5. Forest plot for the thought, attention, and social problems CBCL mean scores. (A) CBCL thought problems. (B) CBCL attention problems. (C) CBCL social problems.
Concerning the YSR results, forest plots of Total problems, Internalizing problems, and Externalizing problems with related subscales are reported in Figures 6–8 respectively. Figure 9 shows those for Thought, Attention and Social problems scales.
Figure 6. Forest plot for the total YSR scores.
Figure 7. Forest plots for the internalizing YSR scores. (A) YSR internalizing. (B) YSR withdrawn/depressed. (B) YSR anxious/depressed. (B) YSR somatic complaints.
Figure 8. Forest plot for the externalizing YSR scores. (A) YSR externalizing. (B) YSR aggressive behavior. (C) YSR delinquent behavior.
Figure 9. Forest plot for the thought, attention, and social problems YSR scores. (A) YSR thought problems. (B) YSR Attention problems. (C) YSR social problems.
Appendices B, C contain funnel plots regarding pooled means in the CBCL and the YSR. Results of the Egger tests were never significant except for the scores obtained on the Anxiety dimension of the YSR. Therefore, Trim and Fill was applied, resulting in a corrected pooled mean equal to 1.34 (see Appendix D).
Also, sensitivity analyses removing studies with small sample sizes were conducted (detailed results are displayed in Appendix D in the “CBCL small” and “YSR small” sections). Regarding the CBCL data, the pooled mean as well as the heterogeneity index largely dropped resulting to be 3.93 and 360.40, respectively. Also, regarding the Somatic CBCL dimensions, it was observed that removing studies with small sample sizes greatly reduced heterogeneity (54.46% of reduction). These analyses were carried out on a few dimensions of the YSR because of the limited number of studies with small sample sizes. No significant increase or reduction of indexes was observed.
RQ2: moderation of gender and age
Only one significant moderation effect was found on the CBCL pooled means. Specifically, the percentage of males in the samples negatively moderated the Anxious/Depressed pooled mean (Q = 12.56, p < 0.05, ß = −0.48, se = 13), which means that the pooled mean of Anxious/Depressed scale decreased along with the increase of the proportion of males in the sample. Table 2 displays the pondered percentage of males for each of the pool of contributions considered in the moderation analyses. As shown in Table 2, the Anxious/Depressed CBCL dimension has the most unbalanced composition regarding gender.
The remaining moderation effects illustrated subsequently were all on YSR pooled means. There was no effect due to the gender composition, while there were several significant moderating effects due to age. Specifically, in the whole mixed-gender sample, as mean age of the samples increased, the Total problems mean increased (Q = 61.11; p < 0.05; ß = 10.80; se = 4.49) and the Attention problems mean decreased (Q = 19.65; p < 0.05; ß = −3.81; se = 0.86). Moreover, as mean age increased, the Anxious/Depressed mean obtained by males decreased (Q = 9.07; p < 0.05; ß = −3.17; se = 1.05). The remaining non-significant results are all displayed in Appendix D.
RQ3: moderation of the studies’ variables pre-post pandemic, publication year, and quality
As stated above, the excessive homogeneity of data (being post-pandemic only one study was carried out with the CBCL and three with the YSR) did not allow to perform a moderation analysis using the period of data collection as a categorical moderator. Instead, the role of these variables was explored through sensitivity analyses.
Because no study using the CBCL was conducted during the post-pandemic period, these analyses were not performed for this outcome. Regarding the YSR pooled mean, it was observed that, when removing studies conducted in the post-pandemic period, heterogeneity was reduced by 25% in several subscales. These include Aggression, Withdraw, Anxiety, Attention, and Somatic Problems. Also, pooled means greatly increased on the Withdraw and Somatic subscales. Detailed findings are available in the “YSR pandemic” section of Appendix D.
The same approach was adopted to explore changes in pooled mean and heterogeneity when removing studies without a cross-sectional design of research. This was tested when at least one study adopted a not cross-sectional design of research. Regarding the CBCL, pooled mean never significantly changed. However, we observed that heterogeneity was reduced by nearly 50% in the case of Internalizing, Externalizing, Attention, and Somatic problems scales. The same effect was found regarding the Aggression, Rule, Withdraw, and Somatic problems of the YSR. In addition, removing studies without a cross-sectional design led to a reduction of nearly 25% of the pooled means estimated on the Rule, Withdraw, and Somatic subscales of the YSR. All results are displayed in the “CBCL design” and “YSR design” of Appendix D.
Then, moderation analyses were carried out using the publication year as a continuous moderator. There were no significant moderation effects of any variables on CBCL pooled means (see Appendix C).
Concerning moderation effects on YSR pooled means in the whole sample, as the publication year increased (i.e., more recent publication), scores increased on the total (Q = 6.22; p < 0.05; ß = −3.41; se = 1.37) and externalizing problems (Q = 8.82; p < 0.05; ß = −0.39; se = 0.13), while a reverse effect was observed regarding the mean scores of Withdrawn (Q = 5.98; p < 0.05; ß = 1.39; se = 0.57), Attentional (Q = 4.64; p < 0.05; ß = 1.51; se = 0.07) and Somatic complaints (Q = 6.86; p < 0.05; ß = 1.48; se = 0.56) narrow-band scales.
Also, as the publication year increased, the total problems in the only-males sample decreased (Q = 4.71; p < 0.05; ß = −4.46; se = 2.06) and the Somatic complaints of the only-females group increased (Q = 5.08; p < 0.05; ß = 1.13; se = 0.50).
Lastly, as the methodological quality of the study increased, the Total problems mean score increased (Q = 5.27; p < 0.05; ß = 18.75; se = 8.17) and the Somatic complaints decreased (Q = 7.01; p < 0.05; ß = −2.61; se = 0.98) in the whole sample, as well as the Internalizing problems mean of the only-males group (Q = 4.35; p < 0.05; ß = −2.71; se = 1.30).
RQ4: major trends of studies on the relationships between emotional-behavioral problems and other outcomes
As shown in Table 1, 27 of the 44 studies (61.4%) included in the systematic review explored the difficulties assessed with the ASEBA questionnaires together with other outcomes. A narrative description of the findings of these studies is reported in Table 1. There are three major trends identified in the current literature: The larger part of these studies (n = 8, 29.6%) investigated adolescents’ problems in respect to attachment (42, 44, 45, 52, 54, 64, 67, 72); a second trend investigated problems and other comorbid symptoms (n = 8, 29.6%), i.e., internet or social media misuse (48, 50, 57, 67), eating disorders (71, 81), alcohol misuse (57), sleep problems (66). A last identifiable trend focused the role of parental features (n = 5, 18.5%) such as parenting style/control (61, 79), patterns of communication (60), and symptoms (69, 83).
The rest of studies investigated relationships with miscellaneous variables. Particularly, these are various psychological features such as mindfulness skills (49, 70), emotion dysregulation (62, 75), psychological inflexibility (70, 77), autistic traits (46), reflective functioning (44), verbal skills (44), and perceived self-efficacy (50), while two studies investigated problems’ together with various dimensions of school engagement (51, 58).
Discussion
This study reviewed data of the ASEBA questionnaires CBCL, YSR, and TRF in the versions of the year 2001 in Italian adolescents. The aims were to review studies on emotional-behavioral difficulties of Italian adolescents and to investigate the moderating role played by sociodemographic factors, time of assessment, and quality of studies. This first part is on community samples, in order to provide an updated picture of mental health of Italian adolescents with typical functioning and no clinical or at-risk conditions.
A preliminary consideration is that none of the included Italian studies considered the Teacher Report Form, which makes these results poorly informative for practitioners wishing to employ this questionnaire. This absence should not be interpreted as a complete lack of use or interest in TRF among Italian practitioners, as perhaps Italian studies that include this questionnaire did not respond to inclusion criteria, e.g., lower age range, or data not retrieved. In addition, the TRF version mainly used with community sample could be the one updated in 1991 (18), which was excluded in this study. Therefore, enlarging the research by including all versions of the ASEBA measures could help clarify this absence. However, the results of this review can be of interest to all practitioners employing the parent-report CBCL and the adolescent-report YSR.
Means of emotional-behavioral problems in Italian adolescents
Results answering the first research question reveal a different picture than the one offered by previous Italian epidemiological studies and cross-cultural comparisons (14, 18, 21, 84).
The Total problems pooled mean in the CBCL 6–18 was eight points higher than the one registered with the CBCL 4–18 in Italian adolescents aged 12–18 years (13). Thus, the mean reported in this review resulted in 6–7 points higher than the pooled intercountry one in Rescorla et al. (18), contrary to the previously registered Italian mean, which is slightly below the international average (18). In addition, the mean of total problems as self-reported by Italian adolescents in the YSR was 4 points lower here than previously (14), but still in the highest positions of the international rank (18). Therefore, Italian adolescents’ pooled means of Total problems differed from those resulting from previous versions of the instruments.
On the one hand, differences between the pooled means calculated here and previous normative results are merely descriptive, with no analyses having been conducted to test their statistical significance. Thus, a future contribution wanting to address this issue could calculate pooled means obtained by adolescents on the past and current versions of the ASEBA instruments to test the moderating role of the version used.
On the other hand, albeit descriptive, these differences between results from 2001 and previous ASEBA instruments solicit reflection and different possible explanations. First, an explication is suggested by Rescorla et al. (18, 85) observation of cultural differences in rating difficulties, which may suggest attributing these differences to changes in the Italian culture that have occurred over time. In this circumstance, Italian parents could be more prone to perceive difficulties in their children. Of note, this explanation is partially supported by the results of analyses performed here, which examine the role of time in the pool of contributions included. This is fully commented on in the next paragraphs. Second, these differences may be due to discrepancies between the versions of the instruments. For this, we invite researchers to be cautious when comparing scores obtained with different versions of the same ASEBA instrument. However, this explanation may be insufficient as few items have been modified from the past versions of the questionnaires. Third, there could be differences between the Italian adolescents recruited for the epidemiological normative studies (13, 14) and those participating in the studies included in the current review. For instance, this work did not check the role of some potentially confounding variables, such as age and gender, on the differences observed between normative and this review’s pooled means.
Gender and age differences
A traditional line of investigation concerns gender and age differences in ASEBA rates (18, 86), the object of the second research question in this review.
Participants gender
Results regarding the moderating role of gender composition were unexpected. Indeed, most studies using CBCL or YSR and that compared scores of girls and boys found significant differences. For instance, a previous Italian contribution (13) found that parents assigned higher scores to boys, compared to girls, on many scales except for more somatic complaints. In addition, the international literature often reported more total and externalizing problems in males and more internalizing problems in females (18), mirroring wider epidemiological data (15, 87). Instead, the gender moderated only Anxiety mean scores of the CBCL, where a higher percentage of girls in the samples corresponded to higher levels of Anxiety/Depression, in line with previous studies (18). For the remaining data, contrary to hypotheses and literature, there was no moderating role of gender on mean scores obtained on all the other ASEBA scales. These non-significant results may have several explanations. First, this outcome could be due to poor heterogeneity in the gender composition. Indeed, the pooled percentage of males and females was almost equal to 50% for most dimensions, except for anxiety/depression where females were slightly overrepresented, and a difference was found indeed. Second, as the age increased, anxiety decreased in males, suggesting a moderation role of gender in symptoms found in other studies (13, 18). Therefore, a future study could aim to perform a meta-analysis on gender differences observed in studies using the ASEBA to better address the issue of the identification of differences between girls and boys.
Participants age
In this review, age was not influential on the CBCL 6–18 scores, while international studies found that parents of older teenagers tend to assign higher scores on most scales (18). This discrepancy in results could be explained by a cultural dissimilarity or by differences between the two versions of the questionnaire, which should be further investigated. In addition, changes may have occurred in the last decade in parents’ assessment of difficulties in their teenagers. The explanation for this could be found in a cultural transition prompted by media, which has made parents more aware, and therefore more prepared, of problematic behaviors in their teenage children since middle school, regardless of their gender (88).
Instead, results obtained with the self-report YSR were more in line with the literature (18), confirming that older teenagers tend to report more total problems, more attention problems and lower anxiety than younger ones. In absence of previously published Italian data on YSR, these results are difficult to discuss in the Italian context, but they seem to suggest a certain homogeneity in the way Italian teenagers evaluate their difficulties. This could be ascertained with future dedicated studies.
Effects of studies’ characteristics
For the third research question, the effects of some studies’ characteristics on scores were examined.
Pre/post-pandemic studies
In light of recent literature findings suggesting an increase in emotional-behavioral difficulties after the COVID-19 pandemic (6), although not completely supported by Italian literature (89), this review aimed to analyze differences in studies published pre- or post-pandemic. Unfortunately, given that only four studies out of 34 were published post-pandemic (50, 53, 64, 67), it was impossible to carry out analyses helpful to increase the knowledge about the effect of the pandemic. This calls for more Italian research on the topic employing the ASEBA questionnaires so that future updates of this meta-analysis could respond to this part of the research question.
Publication year
Results partially confirm the literature reporting an increase in emotional-behavioral difficulties among teenagers over the last decades (5, 90). In contrast with previous research, no growth was revealed when informants were parents, and a general decrease in total problems and externalizing problems was observed when the inquired person was a teenager. On the other side, internalizing problems increased over years in line with the literature (9), but in form of depressive symptoms and somatic complaints rather than anxiety. This suggests a change in the form of expression of the illness which should be further investigated. An additional observation converging with previous studies consists in the increase of attentional problems, potentially due to a growth in screen use by children and adolescents in the last decades, particularly on mobile phones (91). Of note, even if results are not completely in line with worldwide epidemiological investigation, which reports an increase in more syndromes (91), these trends align with those observed in Northern-European countries (5). This pattern of results suggests framing the conclusions of the ASEBA Italian study conducted among adolescents within the European literature rather than the worldwide one. This should be done considering the peculiarities of European Countries in difficulties distribution and rating (87, 90).
Quality of studies
In line with the PRISMA 2020 guidelines and recent attention to the quality of the studies included in reviews, especially when meta-analytical findings were brought (36), this study includes a check of the effect of studies’ quality on results. These revealed that teenagers were rated with higher scores in studies of higher quality, except for the somatic complaints, which were less in higher-quality works. Although this evaluation may be affected by those who conduct it, it seems relevant that the scores on some scales vary according to the quality of the study. This is because it can indicate weaknesses and future lines of investigation on the goodness of the instrument, or in the research process. In this review, the included contributions obtained low to medium scores of quality (from 1 to 4 in a range 1–7), and funnel plots revealed a degree of study heterogeneity. This suggests improving the quality of Italian research with the ASEBA questionnaires. For instance, authors should improve the clarity and completeness of the study method and results reporting during the paper writing. In general, the conspicuous body of international methodological research on the ASEBA system seems to have poorly investigated the impact of the quality of the studies on outcomes, suggesting the implementation of research in this direction.
Trends of research on ASEBA problems and psychological/psychopathological outcomes
Results for the fourth research question highlighted that most of studies investigated relationships between adolescents’ emotional-behavioral problems and other outcomes, suggesting this as an interest of Italian researchers. The scope of this systematic review was to map major trends, and the included studies allowed to detect three major trends. Specifically, Italian contributions included in the systematic review seem to pay similar attention to the relationships of emotional-behavioral problems and both attachment and comorbid symptoms, following the international trends (18, 91, 92). In particular, Italian researchers employed the ASEBA questionnaires to check the effect of attachment insecurity (42, 44, 45, 52, 54, 64, 67, 72) and to explore the relationships between emotional-behavioral problems and comorbid symptoms of internet addiction and eating disorders (48, 50, 57, 67, 71, 81). This is in line with an international trend (93). Still, Italian studies contributed to community-based investigation on the role of parental features and other psychological aspects (60, 61, 69, 79, 83). Overall, Italian research trends that consider the ASEBA questionnaires follow organizational and research recommendations to design empirically grounded prevention (4, 18, 84, 94). Some of them also follow the Rescorla et al. (85) suggestions to go beyond the exclusive focus on internalizing and externalizing broad-band scales. In addition, they suggest to implement research on narrow-band scales (42, 49, 54, 67), and to include research on relationships between children problems and parental features (60, 61, 69, 79, 83). However, these results only aimed to be descriptive, and future international meta-analyses would address these topics to provide and empirically supported based to findings and suggestions of single studies.
Conclusion and implications for clinical practice
In sum, this systematic review investigates emotional-behavioral difficulties in Italian adolescents aged 11–18 years. The studies provide researchers and practitioners with pooled data which are useful to frame their findings with the ASEBA measures in the Italian context, and that are potentially helpful for cross-cultural comparisons.
First, the few differences related to gender and age suggest approaching males and females, regardless of age, with no expectations of the type of symptoms they might exhibit. At best, results on trends might suggest paying particular attention to the presence of depressive symptoms and somatic complaints, or attentional symptoms potentially prodromal of ADHD. However, this consideration should be accepted with great caution because this review mainly includes pre-pandemic studies, and it could therefore mainly draw the picture of Italian adolescents before the disease’s outbreak. Given that the literature suggests an increase in anxiety during the COVID-19 widespread that could not be substantiated due to a lack of contributions, more post-pandemic studies are expected for a more complete picture (6).
Further, given the comorbidities and associations reported in this review, practitioners detecting emotional-behavioral difficulties in community adolescents should be recommended to also screen for eating disorders and social media addiction subthreshold symptoms. This could be useful to perform more comprehensive prevention. In this regard, the results of this review may support the utility of using the ASEBA questionnaires to detect emotional-behavioral symptoms in community adolescents for preventive purposes, for example through school surveys.
Lastly, although this review did not investigate adolescent-parent agreement, discrepancies in scores suggest to practitioners to take into consideration the recommendation from the international ASEBA literature (84, 95). This refers to the use a multi-informant approach when possible. The aim is to depict a more precise picture of the adolescent’s situation. This is also done by reducing the probability of bias resulting from an underestimation of the problems by parents and an overestimation of the same by their teenage children. In this regard, although this review could not include data on TRF, practitioners wanting to use this teacher-report questionnaire should consider that parent and teachers’ ratings show discrepancies as well (95).
Limitations and future lines of research
As the first effort to synthesize data with the ASEBA questionnaires in Italy, this review has the strength to provide provisional parameters to contextualize single results in an Italian context. However, it also has many limitations that urge caution in the reliance on its results. First, the number of the included studies is limited, especially considering that 38 contributions were potentially eligible but it was impossible to isolate data on participants aged 11–18 years or on the scales. In addition, 10 contributions were excluded by the meta-analysis as necessary data could not be retrieved. Therefore, future Italian studies with ASEBA questionnaires should include means to contribute to this epidemiological effort. Moreover, the studies considered were of low to medium quality, limiting the soundness of our conclusions. Second, none of the retrieved articles employed the TRF, so this review could not provide synthetical data on it. This solicits more research with this questionnaire to collect data on adolescents’ problems at school, necessary to complete a picture of the mental health of the community Italian teenagers within and outside the family. For instance, this may hinder the advances of knowledge in specific fields of study such as distress expressed and experienced in the school’s context such as perpetration and victimization of bullying or social anxiety experienced with peers (96). Third, southern-east areas of the countries appear underrepresented, calling for more studies for more a comprehensive examination. In this regard, given that most contributions have local coverage or at best are multicentric in two or three cities, Italian researchers and institutions are called to a joint effort to coordinate epidemiological research with national reach. Further, the paucity of post-pandemic studies hindered the possibility to investigate changes in Italian adolescents’ mental health after the COVID pandemic, soliciting more publications on this topic.
Then, the conclusions we have drawn regarding emotional and behavioral problems in the population of Italian adolescents could not be fully appreciated without considering the clinical population. For instance, interesting studies highlighted the role of emotional and behavioral problems in vulnerable populations of adolescents with autism spectrum disorder (97) as well as the interplay of these problems with psychopathological variables typically involved in mental disorders (98). In this regard, the second part of this study, consisting of replicating this study on clinical samples, may be precious to better contextualize the data discussed here.
Moreover, we should note that the lack of significant results regarding the moderating role of gender may be accounted for by the lack of consideration of other potential confounding variables. For instance, non-binary gender and some cultural aspects such as religion have been showed to impact psychological outcomes in Italian adolescents (99, 100). From this perspective, these not documented variables may have introduced heterogeneity in our data and confounded the role of gender.
In addition, some choices applied to the search strategy may have limited the exhaustivity of the search. First, the use of age filters may have limited the number of records detectable and then retrieved. Second, the search for gray literature on Google Scholar should have been combined with other strategies as suggested by some authors (30, 101). Third, the choice of using quoted terms and not the MeSH term for “Italy” in PubMed may have affected the research results.
Another limitation is that this review did not investigate differences and discrepancies between CBCL and YSR. These emerged not only in means but also in moderation analyses, where several effects were found only on the YSR, e.g., age, publication year, and quality. In general, the YSR has been the object of fewer methodological studies compared to the other two measures. For this reason, future research should implement efforts to focus strengths and limits of this questionnaire, particularly in Italy where it appeared to be the most used in the included contributions.
Data availability statement
The original contributions presented in the study are included in the article/Supplementary material, further inquiries can be directed to the corresponding author.
Author contributions
CP: conceptualization, methodology, project administration, supervision, data curation, visualization, validation, writing – original draft, and writing – review and editing. SM: conceptualization, methodology, investigation, data curation, visualization, writing – original draft, and writing – review and editing. AF: visualization, validation, and writing – review and editing. VB: screening, investigation, and writing – review and editing. GR: methodology, project administration, supervision, investigation, data curation, visualization, validation, writing – original draft, and writing – review and editing. All authors contributed to the article and approved the submitted version.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyt.2023.1161917/full#supplementary-material
References
2. Otto, C, Reiss, F, Voss, C, Wüstner, A, Meyrose, AK, Hölling, H, et al. Mental health and well-being from childhood to adulthood: design, methods and results of the 11-year follow-up of the BELLA study. Eur Child Adolesc Psychiatry. (2021) 30:1559–77. doi: 10.1007/s00787-020-01630-4
3. American Psychiatric Association. Diagnostic and statistical manual of mental disorders. 5th ed (2013).
4. Achenbach, TM, Ivanova, MY, Rescorla, LA, Turner, LV, and Althoff, RR. Internalizing/externalizing problems: review and recommendations for clinical and research applications. J Am Acad Child Adolesc Psychiatry. (2016) 55:647–56. doi: 10.1016/j.jaac.2016.05.012
5. Blomqvist, I, Henje Blom, E, Hägglöf, B, and Hammarström, A. Increase of internalized mental health symptoms among adolescents during the last three decades. Eur J Public Health. (2019) 29:925–31. doi: 10.1093/eurpub/ckz028
6. Windarwati, HD, Lestari, R, Supianto, AA, Wicaksono, SA, Ati, NA, Kusumawati, MW, et al. A narrative review into the impact of COVID-19 pandemic on senior high school adolescent mental health. J Child Adolesc Psychiatr Nurs. (2022) 35:206–17. doi: 10.1111/jcap.12370
7. Freitag, CM, Boomsma, D, Glennon, JC, Franke, B, and Holtel, A. Focused issue on conduct disorder and aggressive behaviour. Eur Child Adolesc Psychiatry. (2018) 27:1231–4. doi: 10.1007/s00787-018-1216-y
8. Magklara, K, Giannopoulou, I, Kotsis, K, Tsalamanios, E, Grigoriadou, A, Ladopoulou, K, et al. Mental health of children and adolescents with pre-existing psychiatric and developmental disorders during the first pandemic-related lockdown: a cross-sectional study in Greece. Psychiatry Res Comm. (2022) 2:100034. doi: 10.1016/j.psycom.2022.100034
9. Bor, W, Dean, AJ, Najman, J, and Hayatbakhsh, R. Are child and adolescent mental health problems increasing in the 21st century? A systematic review. Aust N Z J Psychiatry. (2014) 48:606–16. doi: 10.1177/0004867414533834
10. Martinsone, B, Stokenberga, I, Damberga, I, Supe, I, Simões, C, Lebre, P, et al. Adolescent social emotional skills, resilience and behavioral problems during the COVID-19 pandemic: A longitudinal study in three European countries. Front Psychol. (2022) 13. doi: 10.3389/fpsyt.2022.942692
11. Bera, L, Souchon, M, Ladsous, A, Colin, V, and Lopez-Castroman, J. Emotional and behavioral impact of the COVID-19 epidemic in adolescents. Curr Psychiatry Rep. (2022) 24:37–46. doi: 10.1007/s11920-022-01313-8
12. Theberath, M, Bauer, D, Chen, W, Salinas, M, Mohabbat, AB, Yang, J, et al. Effects of COVID-19 pandemic on mental health of children and adolescents: a systematic review of survey studies. SAGE Open Med. (2022) 10:20503121221086712. doi: 10.1177/20503121221086712
13. Frigerio, A, Cattaneo, C, Cataldo, M, Schiatti, A, Molteni, M, and Battaglia, M. Behavioral and emotional problems among Italian children and adolescents aged 4 to 18 years as reported by parents and teachers. Eur J Psychol Assess. (2004) 20:124–33. doi: 10.1027/1015-5759.20.2.124
15. UNICEF. (2021). On my mind the state of the world’s children 2021 promoting, protecting and caring for children’s mental health.
16. Achenbach, TM. Integrative guide for the 1991 CBCL/4–18, YSR, and TRF profiles. Burlington, VT: University of Vermont, Department of Psychiatry (1991).
17. Achenbach, TM, and Rescorla, LA. Manual for the ASEBA school-age forms and profiles. Burlington, VT: University of Vermont, Research Center for Children, Youth, and Families (2001).
18. Rescorla, L, Ivanova, MY, Achenbach, TM, Begovac, I, Chahed, M, Drugli, MB, et al. International epidemiology of child and adolescent psychopathology II: integration and applications of dimensional findings from 44 societies. J Am Acad Child Adolesc Psychiatry. (2012) 51:1273–1283.e8. doi: 10.1016/j.jaac.2012.09.012
19. Bordin, IA, Rocha, MM, Paula, CS, Teixeira, MCT, Achenbach, TM, Rescorla, LA, et al. Child behavior checklist (CBCL), youth self-report (YSR) and Teacher's report form (TRF): an overview of the development of the original and Brazilian versions. Cad Saude Publica. (2013) 29:13–28. doi: 10.1590/S0102-311X2013000100004
20. Achenbach, TM. DSM-oriented guide for the Achenbach system of empirically based assessment (ASEBA), vol. 38. Burlington: University of Vermont Research Center for Children, Youth, and Families (2013).
21. Frigerio, A, Rucci, P, Goodman, R, Ammaniti, M, Carlet, O, Cavolina, P, et al. Prevalence and correlates of mental disorders among adolescents in Italy: the PrISMA study. Eur Child Adolesc Psychiatry. (2009) 18:217–26. doi: 10.1007/s00787-008-0720-x
22. Effatpanah, M, Moharrami, M, Damavandi, GR, Aminikhah, M, Nezhad, MH, Khatami, F, et al. Association of internet addiction with emotional and behavioral characteristics of adolescents. Iran J Psychiatry. (2020) 15:55–66.
23. Flaherty, EG, Thompson, R, Litrownik, AJ, Zolotor, AJ, Dubowitz, H, Runyan, DK, et al. Adverse childhood exposures and reported child health at age 12. Acad Pediatr. (2009) 9:150–6. doi: 10.1016/j.acap.2008.11.003
24. Kobak, R, Zajac, K, and Smith, C. Adolescent attachment and trajectories of hostile–impulsive behavior: implications for the development of personality disorders. Dev Psychopathol. (2009) 3:839–51. doi: 10.1017/S0954579409000455
25. World Health Organization (WHO). International classification of diseases, eleventh revision (ICD-11). (2019/2021). Available at: https://icd.who.int/browse11
26. Walsh, D, McCartney, G, Smith, M, and Armour, G. Relationship between childhood socioeconomic position and adverse childhood experiences (ACEs): a systematic review. J Epidemiol Community Health. (2019) 73:1087–93. doi: 10.1136/jech-2019-212738
27. Ashraff, S, Siddiqui, MA, and Carline, TE. The psychosocial impact of diabetes in adolescents: a review. Oman Med J. (2013) 28:159–62. doi: 10.5001/omj.2013.46
28. Paine, AL, Fahey, K, Anthony, RE, and Shelton, KH. Early adversity predicts adoptees’ enduring emotional and behavioral problems in childhood. Eur Child Adolesc Psychiatry. (2021) 30:721–32. doi: 10.1007/s00787-020-01553-0
29. Page, MJ, McKenzie, JE, Bossuyt, PM, Boutron, I, Hoffmann, TC, Mulrow, CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. (2021) 372:n71. doi: 10.1136/bmj.n71
30. Haddaway, NR, Collins, AM, Coughlin, D, and Kirk, S. The role of Google scholar in evidence reviews and its applicability to Grey literature searching. PloS One. (2015) 10:e0138237. doi: 10.1371/journal.pone.0138237
31. Wells, GA, Shea, B, O'Connell, D, Peterson, J, Welch, V, Losos, M, et al. The Newcastle-Ottawa scale (NOS) for assessing the quality of nonrandomised studies in meta-analyses. (2011).
32. O'Driscoll, C, Laing, J, and Mason, O. Cognitive emotion regulation strategies, alexithymia and dissociation in schizophrenia, a review and meta-analysis. Clin Psychol Rev. (2014) 34:482–95. doi: 10.1016/j.cpr.2014.07.002
33. Modesti, PA, Reboldi, G, Cappuccio, FP, Agyemang, C, Remuzzi, G, Rapi, S, et al. Panethnic differences in blood pressure in Europe: a systematic review and meta-analysis. PloS One. (2016) 11:e0147601. doi: 10.1371/journal.pone.0147601
34. Balduzzi, S, Rücker, G, and Schwarzer, G. How to perform a meta-analysis with R: a practical tutorial. Evid Based Ment Health. (2019) 22:153–60. doi: 10.1136/ebmental-2019-300117
35. Rosenthal, R. Writing meta-analytic reviews. Psychol Bull. (1995) 118:183–92. doi: 10.1037/0033-2909.118.2.183
36. Cooper, H, and Hedges, LV. The handbook of research synthesis. New York, USA: Russell Sage Foundation (1994).
37. Borenstein, M. Effect sizes for continuous data In: H Cooper, LV Hedges, and JC Valentine, editors. The handbook of research synthesis and meta-analysis. New York, USA: Russell Sage Foundation (2009). 221–35.
38. Hedges, LV, and Pigott, TD. The power of statistical tests for moderators in meta-analysis. Psychol Methods. (2004) 9:426–45. doi: 10.1037/1082-989X.9.4.426
39. Egger, M, Davey Smith, G, Schneider, M, and Minder, C. Bias in meta-analysis detected by a simple, graphical test. BMJ (Clinical research ed). (1997) 315:629–34. doi: 10.1136/bmj.315.7109.629
40. Duval, S, and Tweedie, R. Trim and fill: a simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics. (2000) 56:455–63. doi: 10.1111/j.0006-341x.2000.00455.x
41. Battistutta, S, Carrozzi, M, Aliverti, R, Montico, M, and Zin, R. Chronic tension-type headache in adolescents. Clinical and psychological characteristics analyzed through self- and parent-report questionnaires. J Pediatr Psychol. (2009) 34:697–706. doi: 10.1093/jpepsy/jsn102
42. Bizzi, F. La qualità dell’attaccamento nei bambini con disturbi da Sintomi Somatici e disturbi correlati. Psicol Clin dello Svilupp. (2019) 1:139. doi: 10.1449/93137
43. Bizzi, F, and Pace, CS. Attachment representations and emotion regulation strategies in parents of children with disruptive behaviour disorders. Mediterr J Clin Psic. (2019) 7:1–16. doi: 10.6092/2282-1619/2019.7.2219
44. Bizzi, F, Charpentier Mora, S, Ensink, K, Cavanna, D, and Borelli, J. Does Children’s Mentalizing mediate the role of attachment and psychological maladjustment in middle childhood? J Child Fam Stud. (2020) 29:1793–803. doi: 10.1007/s10826-020-01701-9
45. Bizzi, F, Della Vedova, AM, Prandi, E, Cavanna, D, and Manfredi, P. Attachment representations to parents and emotional-behavioral problems: a comparison between children with type 1 diabetes mellitus and healthy children in middle childhood. Clin Child Psychol Psychiatry. (2021) 26:393–405. doi: 10.1177/1359104520987871
46. Calderoni, S, Fantozzi, P, Balboni, G, Pagni, V, Franzoni, E, Apicella, F, et al. The impact of internalizing symptoms on autistic traits in adolescents with restrictive anorexia nervosa. Neuropsychiatr Dis Treat. (2015) 11:75–85. doi: 10.2147/NDT.S73235
47. Calvo, V, Bianco, F, Benelli, E, Sambin, M, Monsurrò, MR, Femiano, C, et al. Impact on children of a parent with ALS: a case-control study. Front Psychol. (2015) 6:288. doi: 10.3389/fpsyg.2015.00288
48. Cerruti, R, Spensieri, V, Presaghi, F, Valastro, C, Fontana, A, and Guidetti, V. An exploratory study on internet addiction, somatic symptoms and emotional and behavioral functioning in school-aged adolescents. Clin Neuropsychiatry. (2017) 14:374–83.
49. Chiesi, F, Dellagiulia, A, Lionetti, F, Bianchi, G, and Primi, C. Using item response theory to explore the psychometric properties of the Italian version of the child and adolescent mindfulness measure (CAMM). Mind. (2017) 8:351–60. doi: 10.1007/s12671-016-0604-y
50. Cimino, S, and Cerniglia, L. The capacity to be alone moderates psychopathological symptoms and social networks use in adolescents during the COVID-19 pandemic. Int J Environ Res Public Health. (2021) 18:11033. doi: 10.3390/ijerph182111033
51. Costabile, A, Musso, P, Iannello, NM, Servidio, R, Bartolo, MG, Palermiti, AL, et al. Adolescent psychological well-being, radicalism, and activism: the mediating role of social disconnectedness and the illegitimacy of the authorities. J Res Adolesc. (2021) 31:25–33. doi: 10.1111/jora.12590
52. Costantino, E, Limonta, A, Maggiolini, A, and Crugnola, RC. Attaccamento e problemi emotivo-comportamentali in adolescenza. Infanzia e adolescenza. (2011) 10:3–15. doi: 10.1710/647.7546
53. Crescentini, C, Feruglio, S, Matiz, A, Paschetto, A, Vidal, E, Cogo, P, et al. Stuck outside and inside: an exploratory study on the effects of the COVID-19 outbreak on Italian parents and Children's internalizing symptoms. Front Psychol. (2020) 11:586074. doi: 10.3389/fpsyg.2020.586074
54. De Santis, S, Falgares, G, and Kopala-Sibley, DC. The relationship between attachment styles and internalizing/externalizing problems: the mediating role of self-criticism. Curr Psychol. (2021) 40:2355–65. doi: 10.1007/s12144-019-00174-4
55. Feo, P, Di Gioia, S, Carloni, E, Vitiello, B, Tozzi, AE, and Vicari, S. Prevalence of psychiatric symptoms in children and adolescents one year after the 2009 L'Aquila earthquake. BMC Psychiatry. (2014) 14:270. doi: 10.1186/s12888-014-0270-3
56. Frigerio,. (2019). L’utilizzo elettronico dei Media in un campione di bambini ed adolescenti italiani, di età compresa tra i 6 e i 18 anni, e la sua associazione con i problemi emotivo-comportamentali.
57. Gatta, M, Dal Zotto, L, Schiff, S, Svanellini, L, Lai, J, Salis, M, et al. Consumo di sostanze alcoliche e vulnerabilità psicopatologica in adolescenza. Gior Neuropsich Età Evol. (2012) 32:197–203.
58. Guidetti, G, Rabaglietti, E, and Converso, D. Experience of attachment to school: the relevance of a person-centred approach for identifying adjustment difficulties and gender-and age-related differences during early adolescence. J Psychol Educ. (2017) 25:39–60.
59. Gugliandolo, MC, Costa, S, Cuzzocrea, F, Larcan, R, and Petrides, KV. Trait emotional intelligence and behavioral problems among adolescents: a cross-informant design. Pers Individ Differ. (2015) 74:16–21. doi: 10.1016/j.paid.2014.09.032
60. Kapetanovic, S, Rothenberg, WA, Lansford, JE, Bornstein, MH, Chang, L, Deater-Deckard, K, et al. Cross-cultural examination of links between parent-adolescent communication and adolescent psychological problems in 12 cultural groups. J Youth Adolesc. (2020) 49:1225–44. doi: 10.1007/s10964-020-01212-2
61. Lisi, G, Raballo, A, Ribolsi, M, Niolu, C, Siracusano, A, and Preti, A. Aberrant salience in adolescents is related to indicators of psychopathology that are relevant in the prodromal phases of psychosis. Early Interv Psychiatry. (2021) 15:856–64. doi: 10.1111/eip.13022
62. Malagoli, C, and Usai, MC. WM in adolescence: what is the relationship with emotional regulation and behavioral outcomes? Front Psychol. (2018) 9:844. doi: 10.3389/fpsyg.2018.00844
63. Malagoli, C, Cerro, PF, Vecchiato, C, and Usai, MC. Cognitive and emotional regulation in adolescents and young women with eating disorders. EWD. (2021) 26:375–83. doi: 10.1007/s40519-020-00859-x
64. Manna, G, Musso, P, Kopala-Sibley, DC, Cassibba, R, and Falgares, G. The moderating effect of attachment styles on the relationships between maltreatment experiences and internalizing and externalizing problems among adolescents: implications for custody issues. J Fam Trauma Child Cust Child Dev. (2020) 17:161–88. doi: 10.1080/2lobal04586.2020.1767013
65. Mascheretti, S, Marino, C, Simone, D, Quadrelli, E, Riva, V, Cellino, MR, et al. Putative risk factors in developmental dyslexia: a case-control study of Italian children. J Learn Disabil. (2015) 48:120–9. doi: 10.1177/0022219413492853
66. Medda, E, Alessandri, G, Delfino, D, Fagnani, C, Ferri, M, Violani, C, et al. Adolescents self-reported sleep quality and emotional regulation: a discordant twin study. Ann Ist Super Sanita. (2019) 55:118–23. doi: 10.4415/ann_19_02_03
67. Muzi, S, Sansò, A, and Pace, CS. What’s happened to Italian adolescents during the COVID-19 pandemic? A preliminary study on symptoms, problematic social media usage, and attachment: relationships and differences with pre-pandemic peers. Front Psych. (2021) 12:590543. doi: 10.3389/fpsyt.2021.590543
68. Nobile, M, Greco, A, Perna, G, Colombo, P, Bianchi, V, Bellina, M, et al. Effect of the serotonin transporter gene and of environment on the continuity of anxiety and depression traits throughout adolescence. Epidemiol Psychiatr Sci. (2014) 23:399–409. doi: 10.1017/S2045796013000565
69. Operto, FF, Craig, F, Peschechera, A, Mazza, R, Lecce, PA, and Margari, L. Parenting stress and emotional/behavioral problems in adolescents with primary headache. Front Neurol. (2018) 8:749. doi: 10.3389/fneur.2017.00749
70. Oppo, A, Schweiger, M, Ristallo, A, Presti, G, Pergolizzi, F, and Moderato, P. Mindfulness skills and psychological inflexibility: two useful tools for a clinical assessment for adolescents with internalizing behaviors. J Child Fam Stud. (2019) 28:3569–80. doi: 10.1007/s10826-019-01539-w
71. Pace, CS, and Muzi, S. Binge-eating symptoms, emotional-behavioral problems and gender differences among adolescents: a brief report. Mediterr J Clin. (2019) 7:9. doi: 10.6092/2282-1619/2019.7.2161
72. Pace, CS, Muzi, S, and Steele, H. Adolescents’ attachment: content and discriminant validity of the friends and family interview. J Child Fam Stud. (2020) 29:1173–86. doi: 10.1007/s10826-019-01654-8
73. Raffagnato, A, Iannattone, S, Tascini, B, Venchiarutti, M, Broggio, A, Zanato, S, et al. The COVID-19 pandemic: a longitudinal study on the emotional-behavioral sequelae for children and adolescents with neuropsychiatric disorders and their families. Int J Environ Res Public Health. (2021) 18:9880. doi: 10.3390/ijerph18189880
74. Riva, V, Marino, C, Giorda, R, Molteni, M, and Nobile, M. The role of DCDC2 genetic variants and low socioeconomic status in vulnerability to attention problems. Eur Child Adolesc Psychiatry. (2015) 24:309–18. doi: 10.1007/s00787-014-0580-5
75. Rothenberg, WA, Di Giunta, L, Lansford, JE, Lunetti, C, Fiasconaro, I, Basili, E, et al. Daily associations between emotions and aggressive and depressive symptoms in adolescence: the mediating and moderating role of emotion dysregulation. J Youth Adolesc. (2019) 48:2207–21. doi: 10.1007/s10964-019-01071-6
76. Scaini, S, Centorame, G, Lissandrello, F, Sardella, S, Stazi, MA, Fagnani, C, et al. The role of genetic and environmental factors in covariation between anxiety and anger in childhood. Eur Child Adolesc Psychiatry. (2021) 30:607–17. doi: 10.1007/s00787-020-01543-2
77. Schweiger, M, Ristallo, A, Oppo, A, Pergolizzi, F, Presti, G, and Moderato, P. Ragazzi in lotta con emozioni e pensieri: la validazione della versione italiana dell’ avoidance and fusion questionnaire for youth (I-AFQ-Y) [youths struggling with emotions and thoughts: validation of the Italian version of the avoidance and fusion questionnaire for youth (I-AFQ-Y)]. Psicoterapia Cognitiva e Comportamentale. (2017) 23:141–62.
78. Spatola, CAM, Rende, R, and Battaglia, M. Genetic and environmental influences upon the CBCL/6-18 DSM-oriented scales: similarities and differences across three different computational approaches and two age ranges. Eur Child Adolesc Psychiatry. (2010) 19:647–58. doi: 10.1007/s00787-010-0102-z
79. Tagliabue, S, Olivari, MG, Wahn, EH, Maridaki-Kassotaki, K, Antonopoulou, K, and Confalonieri, E. Retrospective paternal and maternal parenting styles in Greece, Italy, and Sweden: invariance, validity, and level differences in the PSDQ. Eur J Psychol Assess. (2018) 34:399–408. doi: 10.1027/1015-5759/a000355
80. Thommessen, S, Laghi, F, Cerrone, C, Baiocco, R, and Todd, B. Internalizing and externalizing symptoms among unaccompanied refugee and Italian adolescents. Child Youth Serv Rev. (2013) 35:7–10. doi: 10.1016/j.childyouth.2012.10.007
81. Troncone, A, Chianese, A, Zanfardino, A, Cascella, C, Confetto, S, Piscopo, A, et al. Disordered eating behaviors among Italian adolescents with type 1 diabetes: exploring relationships with parents’ eating disorder symptoms, externalizing and internalizing behaviors, and body image problems. J Clin Psychol Med Settings. (2020) 27:727–45. doi: 10.1007/s10880-019-09665-9
82. Urgesi, C, Fornasari, L, Perini, L, Canalaz, F, Cremaschi, S, Faleschini, L, et al. Visual body perception in anorexia nervosa. Int J Eat Disord. (2012) 45:501–11. doi: 10.1002/eat.20982
83. Vismara, L, Sechi, C, and Lucarelli, L. Fathers’ and mothers’ depressive symptoms: internalizing/externalizing problems and dissociative experiences in their adolescent offspring. Curr Psychol. (2022) 41:247–57. doi: 10.1007/s12144-019-00566-6
84. Achenbach, TM. International findings with the Achenbach system of empirically based assessment (ASEBA): applications to clinical services, research, and training. Child Adolesc Psychiatry Ment Health. (2019) 13:30–10. doi: 10.1186/s13034-019-0291-2
85. Rescorla, LA, Althoff, RR, Ivanova, MY, and Achenbach, TM. Effects of society and culture on parents’ ratings of children’s mental health problems in 45 societies. Eur Child Adolesc Psychiatry. (2019) 28:1107–15. doi: 10.1007/s00787-018-01268-3
86. Achenbach, TM, Rescorla, LA, and Ivanova, MY. International epidemiology of child and adolescent psychopathology I: diagnoses, dimensions, and conceptual issues. J Am Acad Child Adolesc Psychiatry. (2012) 51:1261–72. doi: 10.1016/j.jaac.2012.09.010
87. Global Burden of Disease (GBD) study. (2019). Data resources. Available at: https://ghdx.healthdata.org/gbd-2019
88. Sanders, MR, Montgomery, DT, and Brechman-Toussaint, ML. The mass media and the prevention of child behavior problems: the evaluation of a television series to promote positive outcomes for parents and their children. J Child Psychol Psychiatry. (2000) 41:939–48. doi: 10.1111/1469-7610.00681
89. Pace, CS, Rogier, G, and Muzi, S. How are the youth? A brief-longitudinal study on symptoms, alexithymia and expressive suppression among Italian adolescents during COVID-19 pandemic. Int J Psychol. (2022) 57:700–8. doi: 10.1002/ijop.12866
90. Castelpietra, G, Knudsen, AKS, Agardh, EE, Armocida, B, Beghi, M, Iburg, KM, et al. The burden of mental disorders, substance use disorders and self-harm among young people in Europe, 1990–2019: findings from the global burden of disease study 2019. Lancet Reg Health Eur. (2022) 16:100341. doi: 10.1016/j.lanepe.2022.100341
91. Tamana, SK, Ezeugwu, V, Chikuma, J, Lefebvre, DL, Azad, MB, Moraes, TJ, et al. Screen-time is associated with inattention problems in preschoolers: results from the CHILD birth cohort study. PloS One. (2019) 14:e0213995. doi: 10.1371/2Fjournal.pone.0213995
92. Madigan, S, Brumariu, LE, Villani, V, Atkinson, L, and Lyons-Ruth, K. Representational and questionnaire measures of attachment: a meta-analysis of relations to child internalizing and externalizing problems. Psychol Bull. (2016) 142:367–99. doi: 10.1037/bul0000029
93. Cataldo, I, Lepri, B, Neoh, MJY, and Esposito, G. Social media usage and development of psychiatric disorders in childhood and adolescence: a review. Front Psychol. (2021) 11:508595. doi: 10.3389/fpsyt.2020.508595
94. World Health Organization. (2019). World health statistics overview 2019: Monitoring health for the SDGs, sustainable development goals (no. WHO/DAD/2019.1). World Health Organization. Available at: https://apps.who.int/iris/rest/bitstreams/1237162/retrieve
95. Rescorla, LA, Bochicchio, L, Achenbach, TM, Ivanova, MY, Almqvist, F, Begovac, I, et al. Parent–teacher agreement on children's problems in 21 societies. J Clin Child Adolesc Psychol. (2014) 43:627–42. doi: 10.1080/15374416.2014.900719
96. Bianchi, D, Lonigro, A, Baiocco, R, Baumgartner, E, and Laghi, F. Social anxiety and peer communication quality during adolescence: the interaction of social avoidance, empathic concern and perspective taking. Child Youth Care Forum. (2020) 49:853–76. doi: 10.1007/s10566-020-09562-5
97. Laghi, F, Trimarco, B, Di Norcia, A, Lonigro, A, Longobardi, E, Bechini, A, et al. Internalizing and externalizing behaviors and close relationships in siblings of adolescents with autism spectrum disorder. Vulnerable Child Youth Stud. (2023) 18:169–81. doi: 10.1080/17450128.2022.2106000
98. Lonigro, A, Longobardi, E, and Laghi, F. The interplay between expressive suppression, emotional self-efficacy and internalizing behavior in middle adolescence. Child Youth Care Forum. (2023) 52:253–65. doi: 10.1007/s10566-022-09685-x
99. Baiocco, R, Ioverno, S, Lonigro, A, Baumgartner, E, and Laghi, F. Suicidal ideation among Italian and Spanish young adults: the role of sexual orientation. Arch Suicide Res. (2015) 19:75–88. doi: 10.1080/13811118.2013.833150
100. Baiocco, R, Crea, G, Pistella, J, Ioverno, S, Tanzilli, A, Rosati, F, et al. Attitude toward Christianity, sexual orientation, and parental religiosity in a sample of Italian adolescents. J Beliefs Values. (2018) 39:298–303. doi: 10.1080/13617672.2017.1382647
Keywords: internalizing problems, externalizing problems, child behavior checklist 6–18 (CBCL 6–18), youth self-report 11–18 (YSR 11–18), adolescents
Citation: Pace CS, Muzi S, Frigerio A, Morganti W, Bianchi V and Rogier G (2023) Twenty years of emotional-behavioral problems of community adolescents living in Italy measured through the Achenbach system of empirically based assessment (ASEBA): a systematic review and meta-analysis. Front. Psychiatry. 14:1161917. doi: 10.3389/fpsyt.2023.1161917
Edited by:
Eoin McElroy, Ulster University, United KingdomReviewed by:
Alejandro De La Torre-Luque, Complutense University of Madrid, SpainFiorenzo Laghi, Sapienza University of Rome, Italy
Roberto Baiocco, Sapienza University of Rome, Italy
Copyright © 2023 Pace, Muzi, Frigerio, Morganti, Bianchi and Rogier. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Cecilia Serena Pace, Y2VjaWxpYS5wYWNlQHVuaWdlLml0