- 1Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
- 2Department of Pediatric and Adolescent Medicine, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
- 3Institute of Medical Statistics and Computational Biology, Faculty of Medicine, University of Cologne, Cologne, Germany
Introduction: The SARS-CoV-2 pandemic has significantly impacted children and adolescents, leading to mental health challenges. Knowledge on their resources and difficulties is crucial and there is a need for valid instruments to assess their psychosocial condition especially in this exceptional situation. We assessed psychopathological symptoms using the SDQ during the pandemic, comparing to pre-pandemic data. Our study aims to understand adolescents’ strengths and difficulties amidst COVID-19, evaluating the SDQ’s utility in crisis settings.
Methods: Within the German school-based surveillance study (“B-Fast”), we assessed behavioral strengths and difficulties in 664 adolescents aged 11–17 years during the peak of the German COVID-19 pandemic using the validated Strengths and Difficulties Questionnaire (SDQ) for both external and self-assessed data collection. Data were collected between November 2020 and April 2021. We compared self-assessed SDQ-scores to pre-pandemic data from a comparable sample and examined adolescent classification as “normal” or “borderline/abnormal” based on both external and self-assessed SDQ subscale scores using established cut-off values. Additionally, we conducted sex and rater-based score comparisons.
Results: In our study, we observed a significant worsening of “Emotional Symptoms” compared to pre-pandemic levels, while “Conduct Problems” and “Prosocial Behavior” showed improvement. Variations in classification to “normal” and “abnormal” emerged when applying German versus British cut-off values. Females scored higher on “Emotional Symptoms” while males scored higher on “Hyperactivity Symptoms.” Correlations between external and self-assessed SDQ ratings ranged from 0.43 (p < 0.001) for “Prosocial Behavior” among girls to 0.62 (p < 0.001) for “Peer Problems” among boys, indicating moderate to high consistency.
Discussion/conclusion: Our study contributes to understanding the psychosocial impact of the COVID-19 pandemic on German adolescents. Compared to other symptoms, we observed a particular worsening in “Emotional Symptoms” based on our data. Despite the moderate correlation between parental and self-reported evaluations, there appears to be a certain discrepancy in the perception of adolescent quality of life. Therefore, it seems prudent to assess both the external and self-reported evaluations and amalgamate the results from both parties to obtain a comprehensive problem profile of the individual. These findings underscore the importance of using country-specific cutoff values and reaffirm the utility of the SDQ as a valuable assessment tool, even within the unique circumstances posed by a pandemic.
Introduction
Since its outbreak and global spread, the SARS-CoV-2-pandemic has been a major challenge to the world’s population and a major burden to health, social and economic systems worldwide, especially threatening vulnerable groups, such as children and adolescents (1). While it is currently believed that COVID-19 infections among them mostly result in mild courses with few complications (which is not yet conclusively understood and currently still under investigation), numerous studies have demonstrated the devastating indirect effects of this pandemic on the well-being of children and adolescents. (2–14). For example, In the nationwide representative COPSY study, the mental health and quality of life of children and adolescents during the pandemic were examined and compared with pre-pandemic data. Results indicated a high level of distress, diminished quality of life, and a significant increase in mental health issues (11–13). These findings align with a systematic review conducted by Loades and colleagues (7), which explored the repercussions of social isolation on children’s mental health during the COVID-19 pandemic in several countries. The review revealed elevated levels of depression and anxiety persisting even beyond the period of isolation. Similarly, Fong and Iarocci (5) emphasized the substantial negative impact of COVID-19 and related social isolation/quarantining practices on child anxiety, post-traumatic stress disorders and fear symptoms. Potential reasons for these severe impacts of the pandemic on children, adolescents and their families include the drastic mitigation measures that severely limit social and educational opportunities for personal development, constant fear for the own health and that of parents and loved ones, potentially threatening economic consequences and the loss of a predetermined daily structure (15–17).
A Lancet article by Jiao et al. (18) delved into the implications of extended home confinement and school closures during the COVID-19 pandemic on children’s mental health. It highlights concerns about increased anxiety, depression, and psychological distress among children due to disrupted routines and limited social interactions. Drawing on evidence from previous outbreaks, the study emphasized the urgent need for targeted interventions to address mental health concerns during public health emergencies. Additionally, it underscored the critical role of parents, schools, and communities in supporting children’s mental well-being during crises.
It has been shown that during COVID-19 pandemic a significant increase of psychological distress, Covid-19 anxiety syndrome, loneliness, fatigue, and worry has been observed across different populations (19–22). Overall however, several studies so far during the SARS-CoV-2-pandemic in children and adolescents focused on physical health or measures of quality of life (11) but still less on psychopathological symptoms. To fill this gap, we conducted a dimensional approach to assess the frequency and number of psychopathological symptoms with the SDQ-questionnaire, which also delves into aspects of psychopathology and offers self-assessed as well as external ratings. This approach was deemed important, as the WHO reports increased rates of psychiatric disorders (23). Good agreement between an SDQ assessment and the respective clinical diagnoses has already been demonstrated, in principle making the SDQ a useful screening tool for emotional and behavioral strengths and difficulties in children and adolescents (24). We wanted to find out whether the SDQ, instead of the lengthy Child Behavior Checklist (CBCL) questionnaire, is also suitable for use during a pandemic, assessing to what extent it can effectively serve as a time-efficient and cost-effective tool to serve as a proxy for potential psychopathological symptoms. Furthermore, differentiated knowledge in terms of a profile of psychopathological aspects is needed. This allows an assessment of how various domains of psychopathology were affected by the pandemic stress. The COSMO study (12) has reported important data about increased emotional problems in children and adolescents during the SARS-Cov-2 pandemics using the SDQ, however, no data on other psychopathological dimensions or consequences for how many subjects are detected as “abnormal” were reported in this study.
More specifically, the study at hand aims to examine how suitable the SDQ is to measure psychopathological symptoms among children and adolescents aged 11–17 years during the SARS-CoV-2 pandemic. Further, with the data of a convenience sample, the study aims to convey an impression on children’s and adolescents’ strengths and difficulties during the pandemic. To do so we are (1) providing a description of their SDQ-scores, highlighting the strengths and difficulties faced by the adolescents in the cohort. In addition, we are (2) using the externally- and self-assessed ratings for comparative analyses. This includes the comparison of (a) these SDQ-scores with normative pre-pandemic data, (b) the application of different country-specific cut-off-values to the results for a classification to normal and borderline/abnormal, (c) outcomes of male and female participants across the different SDQ subscales of the Questionnaire separately for external and self-ratings and (d) results of the external and self-assessed SDQ ratings separately for males and females. All results are interpreted and contextualized against the backdrop of previous knowledge about the psychological situation of adolescents in order to assess the validity of the SDQ during global crises.
Methods
The National Research Network of the university hospitals in Germany initiated the B-Fast Project with the goal to collect and bundle pandemic information and knowledge to contribute to the management and control of the SARS-CoV-2 pandemic, especially in institutions of children’s everyday life. The project received funding from the Federal Ministry of Education and Research. The study was approved by the ethics committee of the medical faculty of the University of Cologne and the respective ethics committees of all participating study sites and is registered with the German Clinical Trials Register (http://www.drks.de/DRKS00023911).
The project was divided into several work packages and application areas. Participants and their parents were asked to fill in a questionnaire focusing on potential behavioral strengths and difficulties of the adolescents (SDQ).
In the school and day care-centers project, COVID-19-tests were carried out at five locations (Düsseldorf, Heidelberg, Homburg, Cologne, Munich) in a total of 14 institutions. The project was implemented in 2 phases of 3 weeks each in the period from September 2020 to March 2021.
At the beginning of test phase 1 (September–December) and test phase 2 (January–March) the SDQ-questionnaire was distributed. The SDQ was used to assess psychopathological symptoms. The questionnaires were answered by the parents of children and adolescents aged 2–17 (parent ratings) and to the adolescents aged 11–17 (self-ratings). The questionnaires could be filled in as online or paper-pencil versions.
Population
Study sample
The participating facilities were selected at the five participating locations. School selection aimed to cover a variety of population densities and social settings, not to be population-representative. Furthermore, the site selection was intended to reflect differences in the various German school types as well as German federal structural differences. Site recruitment required approval of communities, school boards and local health authorities.
Students needed written consent of the legal guardians. Participation was voluntary and consent could be withdrawn at any time. Adolescents aged 11–17 years who had a valid1 self-assessed SDQ-score as well as a valid externally assessed SDQ-score by one respective parent were included in our study population. To be considered valid, at least 80% of the (externally or self-assessed) SDQ-questionnaire needed to be completed.
No incentives were offered for participation. While n = 4,866 students were eligible for the B-FAST study, n = 1,536 had no informed consent, resulting in n = 3,386 students to be enrolled in the study. In total, there were n = 3,970 participants from 14 primary and secondary schools enrolled in the main study, including students, parents and staff.
From the total study-population, n = 1,023 students filled in the self-assessed SDQ-questionnaire and n = 1,605 parents filled in the externally assessed SDQ-questionnaire. For our analyses, we only included adolescents between the age of 11 and 17 with a self-assessed SDQ-score as well as the corresponding externally assessed SDQ-score. After data cleaning, our final sample included n = 664 children. From these, there were n = 385 female, n = 278 male and n = 1 child with none specified gender. A flowchart to visualize this inclusion process can be found in Figure 1.
Strengths and difficulties questionnaire
The main outcome of our analysis, the behavioral strengths and difficulties of adolescents in Germany, was assessed via the SDQ. It is a validated and widely applied instrument to identify children and adolescents at risk for behavioral and mental health problems via a questionnaire that can be completed by either the child or adolescent themselves (self-assessed) or by a respective parent or teacher (externally assessed) (25). In the following, the term “externally assessed” is used in the sense of “parental assessed.”
The SDQ is composed of the following five subscales: Conduct Problems, Emotional Symptoms, Hyperactivity Symptoms, Peer Problems, and Prosocial Behavior. All subscales contain 5 questions each to be answered on a 3 step Likert scale (0 = not true; 1 = somewhat true; 2 = certainly true) (26, 27).
Statistical analyses
Preceding the main analyses, we provide descriptive statistics of relevant covariates, namely age, gender and type of school, socioeconomic status. The type of school refers to the school types of the German school system. School education at “Hauptschule” and “Mittelschule” lasts 9 years and qualifies students for vocational training afterwards. Schooling at “Realschule” lasts 10 years and is designed for slightly academically higher-achieving students. Students at “Gymnasium” attend school for 12–13 years and graduate with the university entrance qualification (“Abitur”), which enables them to pursue further studies at universities or colleges. Admission to “Realschule” and “Gymnasium” is restricted by academic performance during elementary school. “Gemeinschaftsschulen” are a hybrid model where all students, regardless of their academic performance, learn together in common class structures. The school level refers to the year in which the respective student is currently in his/her school. Lower level consists of the years 5–6, middle level of the years 7–9 and finally high level of the years 10–12.
In a first step, each subscale was analyzed individually, with the respective five items being added together, resulting in a value range of each subscale between 0 and 10, with higher values indicating more problems. The total score (“Total Problem Score”) is calculated by adding up the values of all subscales, except the Prosocial Behavior subscale. This scale ranges from 0 to 40 and can also be interpreted independently. These scores were used for the following analyses. We compared our data to normative data from the pre-pandemic situation. These German norm values stem from the KIGGS study (28). The German KIGGS study is a cohort-sequential study that gathered comprehensive data on the health status of children and adolescents in Germany. It was part of the German health-monitoring system established at the Robert Koch Institute, Berlin, on behalf of the German Federal Ministry of Health (29). The data used for establishing German norm values by Hölling et al. for the self-assessed SDQ and for our comparison is from KiGGS wave 1, which took place between 2003 and 2006 and involved a total of 17.641 adolescents and children and their parents. Here 6.726 participants aged 11–17 years were involved. As we did not have access to the full data set, the data was simulated based on Hölling et al. (30). This enabled a comparison of our data dimensionally to the German normative data. To do so, a descriptive analysis was conducted, presenting the arithmetic means, standard deviation (SD), and the 95% confidence interval (95%CI). This was solely performed for the self-assessed data as Hölling does not provide normative data for the externally assessed values. In addition, we classified resulting scores into the categories “normal” “borderline” and “abnormal” by applying the German bandings provided by Hölling (30) to the self- assessed data as well as for the externally assessed data provided by Woerner et al. (31) and compared the results to the classification based on the United Kingdom bandings provided by Goodman (25, 32). Comparisons between male and female participants’ values of the externally assessed SDQ-scores were conducted by using the Mann–Whitney U-test presenting the median, the interquartile range (IQR), arithmetic mean, confidence interval and the p-value. Similarly, we compared external and self-assessed ratings separately for male and female participants by calculating Spearman’s correlation. Finally, as a result of the previous steps, we present the arithmetic means and 95%CI of all (sub)scales separately for participants attending Realschule or Gymnasium (school types), respectively.
The simulation of the data of the KiGGS study was performed with R, Version 4.1.2. All other analyses were performed using SPSS, Version 29.
Results
The adolescents were on average 13.44 years old and fairly evenly distributed in terms of age groups (11–13 years: 54.8%; 14–17 years: 45.2%). Slightly more girls than boys participated (58.0%). The majority of our study participants attended “Gymnasium” (69.3%), i.e., had taken the highest possible educational path. In our sample, this was followed by “Realschule” (21.8%), which is the second highest educational path in this age group. “Hauptschule” and “Mittelschule” together accounted for only 4.4% of our cohort. “Gemeinschaftsschule” was even less represented at 0.6% (Tables 1, 2).
Table 1. Sample characteristics: cross-sectional population of students with both self-assessed and externally assessed (via parent) SDQ-score from November 2020 to April 2021 (n = 664).
Table 2. SDQ-values in simulated pre-pandemic sample versus B-fast sample during the pandemic (self-report, 11–17 years).
A visualization of the comparison between SDQ-values in children and adolescents before the pandemic vs. our population during the pandemic (self-report, 11–17 years) can be found in Figure 2.
Regarding self-assessed ratings on the subscale Emotional Symptoms the pandemic-cohort is worse off than the pre-pandemic study cohort (mean = 2.89 vs. mean = 2.43). However, on the subscales Conduct Problems, Hyperactivity and Prosocial Behavior (higher values on the subscale prosocial behavior indicate a higher social competence, i.e., resources not difficulties), the pre-pandemic population rated themselves more negative than our population.
Table 3 displays the differences in results using different cut-off-values for the self-report, using German norm values based on Hölling et al. (30) and British norm values based on Goodman (25).
Table 3. Bandings of raw scores of self-assessed SDQ-scores using normative German data (Hölling) (30) and normative British data (Goodman) (25).
We found the bandings to be the same on the subscales Conduct Problems and Hyperactivity as well as on the subscale Peer Problems. On the subscales where the groupings differed, namely on the Total Problem Score, the subscale Emotional symptoms and the subscale Prosocial Behavior, we observed a larger proportion of cases labeled as “normal” when using the British bandings. Consequently, we saw a higher number of cases in the categories “borderline” and “abnormal,” when using the German bandings.
Table 4 displays the differences in results for the externally assessed report, using the German norm values based on Woerner et al. (31), and the British norm values based on Goodman (25).
Table 4. Bandings of raw scores of externally assessed SDQ-scores using normative German data (Woerner) (31) and normative British data (Goodman) (25).
We found the bandings to be the same on the subscales Emotional Symptoms, Hyperactivity and Prosocial Behavior. Due to different cut-offs on the Total Problem Score, we found more cases in the category “normal” and fewer cases in the categories “borderline” and “abnormal,” when using the British bandings. Also, the subscales Conduct Problems and Peer Problems use different cut-off values based on the branding, therefore we saw a larger proportion of cases in the category “normal” and a smaller proportion of cases in the category “borderline” and “abnormal” when using German bandings.
As shown in Table 5, when comparing scores between male (n = 278) and female participants (n = 385) separately for externally and self-assessed data, differences were statistically significant for the external ratings in three of the six (sub-)scales (Emotional Symptoms, Hyperactivity, Prosocial Behavior), while this was the case for four (sub)scales in the self-assessed ratings (Emotional Symptoms, Peer Problems, Prosocial Behavior, Total Problem Score). For example, on the subscale Peer Problems, sex-specific differences were statistically significant in the self-assessed but not in the external ratings (p-value 0.02 vs. 0.94), whereas it was the other way around for Hyperactivity symptoms (p-value 0.838 vs. 0.001). On the latter scale, parents rated boys more negatively than they did for girls. On the subscale Prosocial Behavior both, the externally and self-assessed scores, showed more positive ratings for girls than for boys (p-value parental assessed: 0.006; self-assessed: 0.001).
Table 5. Comparison of males and females on the self- and externally-reported SDQ-scores via Mann–Whitney U-test.
The correlation coefficients between external and self-assessed ratings (Table 6) overall show a moderate to high correlation (between 0.43 for Prosocial Behavior among girls and 0.62 for peer problems among boys) with a higher consistency for boys (on average 0.55 vs. 0.49). The correlation was statistically significant in all cases.
The school-specific presentation of arithmetic means for all scales consistently show higher values on the problem scores (see Appendix). This particularly becomes obvious in the total score 9.79 versus 6.95 (external report) and 11.67 versus 9.54 (self-report) for adolescents attending Realschule vs. Gymnasium, respectively.
Discussion
Our main findings were (1) that in our sample, the subscale affected the most during the pandemic was the Emotional Problems subscale. In contrast, an amelioration on the subscales Conduct Problems and Prosocial Behavior was observed. We furthermore found that (2) country-specific normative data seem to be important. Our data indicated that increased emotional problems would not be detected applying other European (British) norms. Thirdly, the detailed problem profile showed sex-specific differences and differences between adolescents attending different types of school. While we found a moderate to good correlation between self-ratings and external ratings in the SDQ, our data show that both ratings should be included to obtain reliable and valid results. The SDQ is sensitive to sex and rater effects.
The present study aimed to show a dimensional problem profile of adolescents during the COVID-19 pandemic and thereby provide information on how suitable the SDQ is to measure the emotional situation of an adolescent population during a global crisis. Therefore, we used the SDQ to investigate dimensional psychopathological symptoms instead of quality of life or frequencies of categorical psychiatric disorders in a subgroup of adolescents 1 year into the SARS-CoV-2-pandemic in Germany. Both the students and their parents completed the questionnaire on psychosocial health. We observed a deterioration in our cohort on the self-assessed subscale Emotional Symptoms compared to the pre-pandemic population of the KiGGS study population (29). Similarly, comparing the classification of our sample to the classification of the pre-pandemic sample using the German cut-off-values provided by Hölling (30) for the subscale Emotional Symptoms we found a larger number of cases in the category “abnormal” (15.7% vs. 7.5%). These results are in line with a previous nationwide representative study performed during the SARS-CoV-2-pandemic showing that two thirds of the participating children and adolescents are highly burdened by the pandemic. They experienced significantly lower health related quality of life, more mental health problems, and higher anxiety levels (33). Taking into consideration that hyperactivity is more genetically determined, it is not surprising that no statistically significant changes occur on this scale before and during the pandemic. On the subscale “Conduct Problems,” we observed an improvement that is not entirely explicable based on our dataset; however, it may be attributed to alterations in daily routines (such as school closures and increased time spent at home), which potentially resulted in stress reduction for certain adolescents.
In contrast, using the bandings provided by Goodman (25), the deterioration during the SARS-CoV-2-pandemic was less accurately captured for our sample: only 9.7% are classified as “abnormal.” As a methodological consideration, the results therefore also show how different cut-offs lead to different classifications and underline the need of using country specific cut-off values (30).
Importantly, as Robert Goodman stated: “The main implication is that users probably should not be too focused on whether the score is just this side or just the other side of an arbitrary boundary. We may need to use fairly arbitrary cutoffs in terms of rules such as that above a score of X we will carry out more detailed screening, but that sort of pragmatic rule should not blind us to the fact that one point above threshold and one point below threshold actually have almost identical implications.”
Several other authors (3–11, 33) have also shown the deterioration of the mental health situation of adolescents in Germany and elsewhere. Ravens Sieberer, for example, included internationally established and validated instruments for measuring the health-related quality of life (KIDSCREEN-10), mental health problems (SDQ), anxiety (SCARED), and depression (CES-DC) (33). The deterioration of the mental health situation is not only pictured by German authors but also internationally. For example, in two Chinese studies, one in which data of Chinese primary school students were collected on depressive and anxious symptoms, non-suicidal self-injury, suicide ideation, suicide plan, and suicide attempt (34). The other, using a questionnaire, which was completed by parents, incorporating the Diagnostic and Statistical Manual of Mental Disorders (DSM-5) criteria commonly used for a cross-cultural assessment of anxiety disorders, including depression (18). Also, on a systematic review conducted by an international team from Canada, Pakistan and Australia who included 18 articles in their review with the overall finding that Children and adolescents are more likely to experience high rates of depression and anxiety during the pandemic (4).
However, on two subscales (Conduct Problems, Prosocial Behavior) our specific cohort appeared to be better off than the pre-pandemic population (30).
Bringing together our results with other studies conducted during the pandemic in Germany using the SDQ (9), our study offers further knowledge concerning mental health problems of adolescents. It does not only give insight into the externally assessed data but also self-assessed data of the adolescent. While the pre-pandemic Germany-wide BELLA study reported that 17.7% of all 7–17-year-olds are at risk for mental problems on the Total Problem Score of the SDQ (9), the COPSY study showed that this proportion of 7-17-year-olds at risk increased drastically to 30.3% (11). However, the COPSY study particularly focused on quality of life by using the KIDSCREEN and used the SDQ only to display the Total Problem Score, symptoms of depression and anxiety were generated by using different screening methods (SCARED, CES-DC, PHQ-2) (11). Our specific findings not only add knowledge regarding dimensional aspects with the full profile of the SDQ of adolescents’ well-being and psychopathology. They also give information about the consistency of ratings by parents and by the adolescents themselves. On the subscale Emotional Symptoms, for example the externally and the self-assessed SDQ-scores did not greatly deviate from each other. This confirms the existing evidence according to which externally- assessed and self-assessed SDQ-scores usually agree better as the child gets older (35, 36). The fact that we solely included adolescents, but not younger children may have contributed to this finding.
Also, equally high results for German children and adolescents were reported by the Corona Snapshot Monitoring (COSMO) study, a serial cross-sectional study designed to assess the psychosocial condition of Germans during the SARS-CoV-2-pandemic (12). Here, also approximately one-third of all under-aged children was found to be at risk for Emotional Symptoms on the SDQ scale. Still, these results were also well above pre-pandemic levels.
In contrast, the overall SDQ-scores of our cohort were more consistent with the pre-pandemic scores. For example, in the externally assessed report, merely 19% (German banding) of our cohort were classified as “at risk” on the Total Problem Score, which is rather consistent with the pre-pandemic levels of the BELLA study (9). This is also true for most externally assessed SDQ-subscale scores in our study. Except for Emotional Symptoms, 80.9–89.1% (German bandings) of all adolescents were not at risk (category “normal”), reflecting the pre-pandemic SDQ levels.
Regarding sex differences on the self- and externally assessed perceptions of adolescent mental health during the pandemic, our results are mostly consistent with previous studies (37, 38). Concerning Emotional Symptoms, girls seem to be slightly worse off than boys. For internalizing symptoms, females compared to males have been found to be more likely to react with anxiety (37). It has also been observed in a previous study that females were more likely to show symptoms of depression and anxiety than males during the SARS-CoV-2-pandemic (38). Males in our cohort were rated worse than the females solely on the externally assessed scale Hyperactivity-Symptoms. This might be due to the fact that boys are more likely to stand out with symptoms of hyperactivity (39, 40) and that these symptoms are usually more obvious and conspicuous making them more consistently discernible by parents (41, 42). On the same subscale the self-assessed scores for boys and girls demonstrate greater comparability as girls showed higher values in the self-ratings compared to their parents’ ratings. There is a lot of evidence supporting higher hyperactivity among boys than among girls (39), leading to the conclusion that self-ratings for hyperactivity might not be reliable.
However, a similar picture with self-ratings resulting in higher values than external ratings particularly in females, could be observed for emotional symptoms (2.36 vs. 3.55) and peer problems (1.62 vs. 2.22). This pattern is in line with previous literature, which indicates that self-ratings tend to reflect more problematic perceptions compared to external ratings (25, 30, 43), highlighting the importance of surveying adolescents themselves, as parents may not be aware of everything. Consequently, this not only makes our data plausible and is a confirmation of previous findings from pre-pandemic times. Furthermore, according to our data, this pattern seems to have persisted during the pandemic, even though adolescents spent significantly more time at home during this period.
In attempting to elucidate the observed sex differences, it is imperative to consider pre-pandemic research findings, emphasizing that these disparities are not solely pandemic-specific. These antecedent studies generally corroborate our observations regarding sex disparities amidst the pandemic. Numerous investigations support the differential manifestation of ADHD and anxiety disorders in boys and girls. Biologically, variations in neurobiological functioning and hormonal regulation are posited as potential contributing factors. Moreover, gender-specific social dynamics and patterns of upbringing are proposed to exert influence over the prevalence of these psychiatric conditions (44–47).
We found the SDQ to be a reliable tool to measure strengths and difficulties of adolescents during a crisis such as a global pandemic. From our data, it seems that adolescent-centered interventions should focus on emotional and psychosomatic but also externalizing difficulties and should consider that males and females might react differently to stressful situations and show different symptoms. In the light of the children and adolescents-focused mental health surveillance program planned by the central German public health institute, the Robert Koch Institute (RKI) (48), these findings could contribute to a potential starting-point to draw meaningful conclusions for a mental health monitoring strategy in future crisis situations. Also, we found no existing normative German data to sufficiently compare parents and their children using the SDQ. We merely found normative German data for the self-assessed SDQ and in another study conducted on another population normative German data for the externally assessed SDQ. Therefore, our findings help to show that there are corresponding normative German data on the self- and the externally assessed SDQ missing. We recommend conducting a representative study to generate normative data for both the externally and self-assessed SDQ-scores.
In addition, our study also provides insight into who can be reached with surveillance studies in schools during a time of crisis. Vulnerable groups seem to be insufficiently addressed by these participation offers and thus are hardly included, which leads to a major bias conflict of such study endeavors. In this respect, our experiences should provide an impulse to develop strategies for data collection at schools in order to prevent this problem in the future and to be able to represent the German general population more reliably.
Strengths and limitations
This study, despite its well-designed multicenter efforts of study facilities, universities and research institutes, has some limitations. Thus, it is likely that a selection bias of the participants led to a systematic bias of the study cohort, where the considered adolescents seem to be more educated, urban and financially better off than the German average. The SDQ-Questionnaire is available in over 80 languages; however, in this study it was solely administered in German. Consequently, the cohort is likely to have a lower proportion of participants with migration background compared to the general population. In addition, the uneven geographic distribution of study participants was influenced by the distribution of study centers. For example, no data collection took place at schools in northern or eastern Germany. Other potential homogeneities within our study sample, such as specific participation motivation or beliefs, could not be accounted for at all.
Therefore, the external validity of our results is restricted and can only be transferred to the general population in a limited way. Furthermore, as a cross-sectional approach, this study represents only a snapshot of the mental situation of adolescents during the SARS-CoV-2-pandemic. Furthermore, the cross-sectional design is a limitation of this study. It stems from the primary focus of the overarching B-Fast study, which was primarily concerned with testing strategies within schools. However, our paper effectively leveraged secondary outcomes from the main study to present a valuable snapshot of the mental well-being of adolescents during the SARS-CoV-2-pandemic.
In our sample social distancing seems to lead to reduced conduct problems or hyperactive behavior at school. This might be in part due to a selection bias in our cohort. The specific distribution of students across school institutions suggests that there is some middle-class bias in our study population. Good parental support and sufficiently large houses with gardens mitigate short-term negative effects of social distancing. In the 2018/2019 Germany-wide quota for the different school types, students of “Gymnasium” make up the largest share on average across Germany, but they only do so between 35% (49) and around 50% including “Fachhochschulreife” (=higher education entrance qualification for universities of applied sciences) (50), which is considerably less than in our study cohort. Certain social disparities are known to exist with regard to school transfer to a secondary school, so that children from financially stronger, more educationally advantaged families have a greater chance of attending “Gymnasium,” i.e., the highest possible educational path, than children from working-class families, even with the same aptitude (51). It can therefore be assumed that our cohort belongs to middle class at an above-average rate and is better off financially, socially and educationally than the average German population.
In terms of geographic distribution, it is striking that 69.9% of the participants were based in Cologne, 28.1% in Munich. Thus, our cohort is also more urban and metropolitan than the German average.
Evidence shows that socioeconomic factors such as lower income (52), migration status (9), or single parent status (53–56) are correlated with higher stressors and correspondingly poorer general mental health during the pandemic. These vulnerable groups were probably very underrepresented in our sample, which may have influenced our results. Therefore, our specific findings concerning Conduct Problems and Prosocial Behavior and those concerning scales with no changes might partly be related to the selection bias comprising the external validity of the study. More specifically, our cohort was less affected by the pandemic situation or it was better protected by resources and protective factors (e.g., financial stability and social support system). However, the deterioration on the subscale Emotional Symptoms is unlikely to be explained by the selection bias. It remains open whether in a representative sample, the deterioration on this subscale would be even stronger or whether this subscale mirrors in particular the problems of adolescents with a higher SES.
Conclusion
This study offers a noteworthy glimpse into the strengths and challenges experienced by adolescents in Germany during the first year of the SARS-CoV-2-pandemic. By delineating distinct problem profiles for boys and girls, we observed a remarkable impact on emotional symptoms, while hyperactivity, largely determined by genetic factors, showed less susceptibility to the pandemic’s effects. In addition, as methodological implications, the study underscores the importance of utilizing both self-reported and external assessments and emphasizes the necessity of employing country-specific cut-off values. Moreover and importantly, it reaffirms the utility of the SDQ as a valuable assessment tool, even within the unique circumstances posed by a pandemic.
Health and practical implications:
• The effort to collect both, external and self-assessed questionnaires, is worthwhile.
• The SDQ provides a comprehensive overview of psychiatric symptoms and effectively captures their changes within the context of the SARS-CoV2-pandemic. Therefore, the SDQ is a valid tool for assessing psychiatric symptoms during a pandemic.
• In our sample we saw a deterioration on the subscale emotional symptoms. The focus of a potential therapy could be directed towards addressing these symptoms. This might include approaches such as psychotherapy, cognitive-behavioral techniques and mindfulness-based interventions, emotion regulation training, and family therapy which have shown promise in targeting these needs. Further, using more specific questionnaires can enhance the assessment of symptoms, enabling clinicians to tailor interventions more effectively and to improve research. Gender specific differences should be considered in psychiatric treatment.
Data availability statement
The original contributions presented in the study are included in the article/Supplementary material, further inquiries can be directed to the corresponding author: c3RlcGhhbi5iZW5kZXJAdWsta29lbG4uZGU=.
Author contributions
JL: Writing – original draft, Writing – review & editing, Conceptualization, Formal analysis, Methodology, Supervision. JK: Writing – original draft, Writing – review & editing, Methodology. JD: Writing – review & editing. JF: Writing – review & editing, Data curation, Formal analysis, Methodology. SB: Writing – review & editing, Supervision, Conceptualization, Funding acquisition, Writing – original draft.
Funding
The author(s) declare financial support was received for the research, authorship, and/or publication of this article. This publication was created within the framework of coverCHILD (https://coverchild.de/) [75], coverCHILD is part of the “Network of University Medicine (NUM),” funded by the Federal Ministry of Education and Research (BMBF) (“NUM 2.0” grant no: 01KX2121).
Acknowledgments
The authors thank the participating institutions for smooth cooperation in the context of conducting the study. We especially acknowledge the study participants’ willingness to take part in the “B-Fast-Study”. We furthermore express our heartfelt thanks to our colleagues Caroline Jung-Sievers, Hannah Schillok, Michaela Coenen, Eva Rehfuessen, Birte Schulte, who provided advice and support in conducting the study or drafting this paper.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
The author(s) declared that they were an editorial board member of Frontiers, at the time of submission. This had no impact on the peer review process and the final decision.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpubh.2024.1357766/full#supplementary-material
References
1. Krishnaratne, S, Pfadenhauer, LM, Coenen, M, Geffert, K, Jung-Sievers, C, Klinger, C, et al. Measures implemented in the school setting to contain the COVID-19 pandemic: a scoping review. Cochrane Database Syst Rev. (2020) 12:CD013812. doi: 10.1002/14651858.CD013812
2. Racine, N, McArthur, BA, Cooke, JE, Eirich, R, Zhu, J, and Madigan, S. Global prevalence of depressive and anxiety symptoms in children and adolescents during COVID-19: a meta-analysis. JAMA Pediatr. (2021) 175:1142–50. doi: 10.1001/JAMAPEDIATRICS.2021.2482
3. Imran, N, Aamer, I, Sharif, MI, Bodla, ZH, and Naveed, S. Psychological burden of quarantine in children and adolescents: a rapid systematic review and proposed solutions. Pak J Med Sci. (2020) 36:1106–16. doi: 10.12669/PJMS.36.5.3088
4. Meherali, S, Punjani, N, Louie-Poon, S, Abdul Rahim, K, das, JK, Salam, RA, et al. Mental health of children and adolescents amidst COVID-19 and past pandemics: a rapid systematic review. Int J Environ Res Public Health. (2021) 18:3432. doi: 10.3390/IJERPH18073432
5. Fong, VC, and Iarocci, G. Child and family outcomes following pandemics: a systematic review and recommendations on COVID-19 policies. J Pediatr Psychol. (2020) 45:1124–43. doi: 10.1093/JPEPSY/JSAA092
6. Panda, PK, Gupta, J, Chowdhury, SR, Kumar, R, Meena, AK, Madaan, P, et al. Psychological and behavioral impact of lockdown and quarantine measures for COVID-19 pandemic on children, adolescents and caregivers: a systematic review and meta-analysis. J Trop Pediatr. (2021) 67:fmaa122. doi: 10.1093/TROPEJ/FMAA122
7. Loades, ME, Chatburn, E, Higson-Sweeney, N, Reynolds, S, Shafran, R, Brigden, A, et al. Rapid systematic review: the impact of social isolation and loneliness on the mental health of children and adolescents in the context of COVID-19. J Am Acad Child Adolesc Psychiatry. (2020) 59:1218–1239.e3. doi: 10.1016/J.JAAC.2020.05.009
8. Singh, S, Roy, D, Sinha, K, Parveen, S, Sharma, G, and Joshi, G. Impact of COVID-19 and lockdown on mental health of children and adolescents: a narrative review with recommendations. Psychiatry Res. (2020) 293:113429. doi: 10.1016/J.PSYCHRES.2020.113429
9. Ravens-Sieberer, U, Kaman, A, Erhart, M, Devine, J, Schlack, R, and Otto, C. Impact of the COVID-19 pandemic on quality of life and mental health in children and adolescents in Germany. Eur Child Adolesc Psychiatry. (2021) 1:879–89. doi: 10.1007/S00787-021-01726-5
10. Ravens-Sieberer, U, Kaman, A, Erhart, M, Otto, C, Devine, J, Löffler, C, et al. Quality of life and mental health in children and adolescents during the first year of the COVID-19 pandemic: results of a two-wave nationwide population-based study. Eur Child Adolesc Psychiatry. (2021) 32:575–88. doi: 10.1007/S00787-021-01889-1
11. Ravens-Sieberer, U, Kaman, A, Otto, C, Adedeji, A, Napp, AK, Becker, M, et al. Mental health and psychological burden of children and adolescents during the first wave of the COVID-19 pandemic—results of the COPSY study. Bundesgesundheitsbl Gesundheitsforsch Gesundheitsschutz. (2021) 64:1512–21. doi: 10.1007/s00103-021-03291-3
12. Rathgeb, C, Schillok, H, Voss, S, Coenen, M, Schulte-Körne, G, Merkel, C, et al. Emotional situation of children and adolescents during the COVID-19 pandemic in Germany: results from the COVID-19 snapshot monitoring study (COSMO). Int J Environ Res Public Health. (2022) 19:2698. doi: 10.25646/7174
13. Rabe, JE, Schillok, H, Merkel, C, Voss, S, Coenen, M, de Bock, F, et al. Belastung von Eltern mit Kindern im Schulalter während verschiedener Phasen der COVID-19-Pandemie in Deutschland: Eine Analyse der COVID-19-Snapshot-Monitoring-(COSMO-)Daten. Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz. (2021) 64:1500–11. doi: 10.1007/S00103-021-03453-3
14. Tsai, F-Y, Schillok, H, Coenen, M, Merkel, C, and Jung-Sievers, Con behalf of the COSMO Study Group. The well-being of the German adult population measured with the WHO-5 over different phases of the COVID-19 pandemic: an analysis within the COVID-19 snapshot monitoring study (COSMO). Int J Environ Res Public Health. (2022) 19, 19:3236. doi: 10.3390/ijerph19063236
15. Zhang, J, Lu, H, Zeng, H, Zhang, S, Du, Q, Jiang, T, et al. The differential psychological distress of populations affected by the COVID-19 pandemic. Brain Behav Immun. (2020) 87:49–50. doi: 10.1016/J.BBI.2020.04.031
16. Holmes, EA, O'Connor, RC, Perry, VH, Tracey, I, Wessely, S, Arseneault, L, et al. Multidisciplinary research priorities for the COVID-19 pandemic: a call for action for mental health science. Lancet Psychiatry. (2020) 7:547–60. doi: 10.1016/S2215-0366(20)30168-1
17. Clemente-Suárez, VJ, Dalamitros, AA, Beltran-Velasco, AI, Mielgo-Ayuso, J, and Tornero-Aguilera, JF. Social and psychophysiological consequences of the COVID-19 pandemic: an extensive literature review. Front Psychol. (2020) 11:3077. doi: 10.3389/FPSYG.2020.580225/BIBTEX
18. Jiao, WY, Wang, LN, Liu, J, Fang, SF, Jiao, FY, Pettoello-Mantovani, M, et al. Behavioral and emotional disorders in children during the COVID-19 epidemic. J Pediatr. (2020) 221:264–266.e1. doi: 10.1016/j.jpeds.2020.03.013
19. Ewid, M, Amal, Y, Billah, SMB, Kalou, Y, Zitoun, OA, Alnaser, AR, et al. Impact of the COVID-19 pandemic on the psychological status of undergraduate medical students in Saudi Arabia: a cross-sectional double-scale study. Medicine (Baltimore). (2023) 102:e33487. doi: 10.1097/MD.0000000000033487
20. Brailovskaia, J, Miragall, M, Margraf, J, Herrero, R, and Baños, RM. The relationship between social media use, anxiety and burden caused by coronavirus (COVID-19) in Spain. Curr Psychol. (2022) 41:7441–7. doi: 10.1007/s12144-021-01802-8
21. Mansueto, G, Palmieri, S, Marino, C, Caselli, G, Sassaroli, S, Ruggiero, GM, et al. The Italian COVID-19 anxiety syndrome scale: investigation of the COVID-19 anxiety syndrome and its association with psychological symptoms in an Italian population. Clin Psychol Psychother. (2022) 29:1972–90. doi: 10.1002/cpp.2767
22. Romanazzo, S, Mansueto, G, and Cosci, F. Anxiety in the medically ill: a systematic review of the literature. Front Psych. (2022) 13:873126. doi: 10.3389/fpsyt.2022.873126
23. Available at:https://www.who.int/news/item/02-03-2022-covid-19-pandemic-triggers-25-increase-in-prevalence-of-anxiety-and-depression-worldwide. (Accessed March 02, 2022)
24. Goodman, R. Psychometric properties of the strengths and difficulties questionnaire. J Am Acad Child Adolesc Psychiatry. (2001) 40:1337–45. doi: 10.1097/00004583-200111000-00015
25. Goodman, R. The strengths and difficulties questionnaire: a research note. J Child Psychol Psychiatry. (1997) 38:581–6. doi: 10.1111/J.1469-7610.1997.TB01545.X
26. He, JP, Burstein, M, Schmitz, A, and Merikangas, KR. The strengths and difficulties questionnaire (SDQ): the factor structure and scale validation in U.S. adolescents. J Abnorm Child Psychol. (2013) 41:583–95. doi: 10.1007/S10802-012-9696-6
27. Nijenhuis, ERS. The scoring and interpretation of the SDQ-20 and SDQ-5. Act Nerv Super. (2010) 52:24–8. doi: 10.1007/BF03379561
28. Hölling, H, Schlack, R, Petermann, F, Ravens-Sieberer, U, and Mauz, EKiGGS Study Group. Psychische Auffälligkeiten und psychosoziale Beeinträchtigungen bei Kindern und Jugendlichen im Alter von 3 bis 17 Jahren in Deutschland - Prävalenz und zeitliche Trends zu 2 Erhebungszeitpunkten (2003-2006 und 2009-2012): Ergebnisse der KiGGS-Studie - Erste Folgebefragung (KiGGS Welle 1). Bundesgesundheitsbl Gesundheitsforsch Gesundheitsschutz. (2014) 57:807–19. doi: 10.1007/S00103-014-1979-3
29. Kurth, BM, Kamtsiuris, P, Hölling, H, Schlaud, M, Dölle, R, Ellert, U, et al. The challenge of comprehensively mapping children’s health in a nationwide health survey: Design of the German KiGGS-study. BMC Public Health. (2008) 8:196. doi: 10.1186/1471-2458-8-196
30. Becker, A, Wang, B, Kunze, B, Otto, C, Schlack, R, Hölling, H, et al. Normative data of the self-report version of the German strengths and difficulties questionnaire in an epidemiological setting. Z Kinder Jugendpsychiatr Psychother. (2018) 46:523–33. doi: 10.1024/1422-4917/a000589
31. Woerner, W, Becker, A, and Rothenberger, A. Normative data and scale properties of the German parent SDQ. Eur Child Adolesc Psychiatry. (2004, 2004) 13:II3–II10. doi: 10.1007/s00787-004-2002-6
32. Youth in Mind. (2022). Scoring the Strengths & Difficulties Questionnaire for Age 4–17 or 18+. Available at:https://sdqinfo.org/py/sdqinfo/b3.py?language=Englishqz(UK). (Accessed March 15, 2022)
33. Ravens-Sieberer, U, Kaman, A, Erhart, M, Devine, J, Schlack, R, and Otto, C. Impact of the COVID-19 pandemic on quality of life and mental health in children and adolescents in Germany. Eur Child Adolesc Psychiatry. (2022) 31:879–89. doi: 10.1007/s00787-021-01726-5
34. Zhang, L, Zhang, D, Fang, J, Wan, Y, Tao, F, and Sun, Y. Assessment of mental health of Chinese primary school students before and after school closing and opening during the COVID-19 pandemic. JAMA Network. (2020) 3:–e2021482. doi: 10.1001/jamanetworkopen.2020.21482
35. Rey, JM, Schrader, E, and Morris-Yates, A. Parent-child agreement on children’s behaviours reported by the child behaviour checklist (CBCL). J Adolesc. (1992) 15:219–30. doi: 10.1016/0140-1971(92)90026-2
36. van Roy, B, Groholt, B, Heyerdahl, S, and Clench-Aas, J. Understanding discrepancies in parent-child reporting of emotional and behavioural problems: effects of relational and socio-demographic factors. BMC Psychiatry. (2010) 10:1–12. doi: 10.1186/1471-244X-10-56
37. Güzelsoy, N, Ravens-Sieberer, U, Westenhöfer, J, Devine, J, Erhart, M, Hölling, H, et al. Risks and resources for depressive symptoms and anxiety in children and adolescents during the COVID-19 pandemic – results of the longitudinal COPSY-study. Front Psychiatry. (2022) 13:901783. doi: 10.3389/fpsyt.2022.901783
38. Arcand, M, Bilodeau-Houle, A, Juster, R-P, and Marin, M-F. Sex and gender role differences on stress, depression, and anxiety symptoms in response to the COVID-19 pandemic over time. Front Psychol. (2023) 14:1166154. doi: 10.3389/fpsyg.2023.1166154
39. Mohammadi, M-R, Zarafshan, H, Khaleghi, A, Ahmadi, N, Hooshyari, Z, Mostafavi, S-A, et al. Prevalence of ADHD and its comorbidities in a population-based sample. J AttenDisord. (2021) 25:1058–67. doi: 10.1177/1087054719886372
40. Huss, M. Attention-deficit hyperactivity disorder: risk factors, protective factors, health supply, quality of life. A brief review. Bundesgesundheitsbl Gesundheitsforsch Gesundheitsschutz. (2008) 51:602–5. doi: 10.1007/s00103-008-0538-1
41. Verhulst, FC, and van der Ende, J. Agreement between parents’ reports and adolescents’ self-reports of problem behavior. J Child Psychol Psychiatry. (1992) 33:1011–23. doi: 10.1111/J.1469-7610.1992.TB00922.X
42. van Roy, B, Grøholt, B, Heyerdahl, S, and Clench-Aas, J. Self-reported strengths and difficulties in a large Norwegian population 10–19 years. Eur Child Adolesc Psychiatry. (2006) 15:189–98. doi: 10.1007/S00787-005-0521-4
43. Vugteveen, J, de Bildt, A, and Timmerman, ME. Normative data for the self-reported and parent-reported strengths and difficulties questionnaire (SDQ) for ages 12–17. Child Adolesc Psychiatry Ment Health. (2022) 16:1–13. doi: 10.1186/s13034-021-00437-8
44. Loke, H, Harley, V, and Lee, J. Biological factors underlying sex differences in neurological disorders. Int J Biochem Cell Biol. (2015) 65:139–50. doi: 10.1016/j.biocel.2015.05.024
45. Babinski, DE. Sex differences in ADHD: review and priorities for future research. Curr Psychiatry Rep. (2024) 26:1–6. doi: 10.1007/s11920-024-01492-6
46. May, T, Adesina, I, McGillivray, J, and Rinehart, NJ. Sex differences in neurodevelopmental disorders. Curr Opin Neurol. (2019) 32:622–6. doi: 10.1097/WCO.0000000000000714
47. Williamson, D, and Johnston, C. Gender differences in adults with attention-deficit/hyperactivity disorder: a narrative review. Clin Psychol Rev. (2015) 40:15–27. doi: 10.1016/j.cpr.2015.05.005
48. Thom, J, Mauz, E, Peitz, D, Kersjes, C, Aichberger, M, Baumeister, H, et al. Establishing a mental health surveillance in Germany: development of a framework concept and indicator set. J Health Monit. (2021):6, 34–63. doi: 10.25646/8861
49. Datenreport (2021). Kapitel 3 Bildung - Statistisches Bundesamt. Available at:https://www.destatis.de/DE/Service/Statistik/Campus/Datenreport/Downloads/datenreport-2021-kap-3. (Accessed Mar 15, 2022)
50. Deutsches Zentrum für Hochschul- und Wissenschaftsforschung. (2024). Berechnungen; Statistisches Bundesamt. Available at:https://www.datenportal.bmbf.de/portal/de/Tabelle-2.5.85.html. (Accessed February 14, 2024).
51. Baumert, J, Maaz, K, Gresch, C, and McElvany, N (2010). Der Übergang von der Grundschule in die weiterführende Schule: Leistungsgerechtigkeit und Regionale, Soziale und Ethnisch-Kulturelle Disparitäten. In: Bildungsforschung Band 34. Bundesministerium für Bildung und Forschung (Hrsg.).
52. Huebener, M, Waights, S, Spiess, CK, Siegel, NA, and Wagner, GG. Parental well-being in times of Covid-19 in Germany. Rev Econ Househ. (2021) 19:91–122. doi: 10.1007/S11150-020-09529-4
53. Cusinato, M, Iannattone, S, Spoto, A, Poli, M, Moretti, C, Gatta, M, et al. Stress, resilience, and well-being in Italian children and their parents during the COVID-19 pandemic. Int J Environ Res Public Health. (2020) 17:1–17. doi: 10.3390/IJERPH17228297
54. Marchetti, D, Fontanesi, L, Mazza, C, di Giandomenico, S, Roma, P, and Verrocchio, MC. Parenting-related exhaustion during the Italian COVID-19 lockdown. J Pediatr Psychol. (2020) 45:1114–23. doi: 10.1093/JPEPSY/JSAA093
55. Stormacq, C, van den Broucke, S, and Wosinski, J. Does health literacy mediate the relationship between socioeconomic status and health disparities? Integrative review. Health Promot Int. (2019) 34:e1–e17. doi: 10.1093/heapro/day062
Keywords: COVID-19 pandemic, adolescents, mental health, SDQ-questionnaire, crisis, mental health assessment
Citation: Loy JK, Klam J, Dötsch J, Frank J and Bender S (2024) Exploring adolescent mental health during the COVID-19 crisis – strengths and difficulties. Front. Public Health. 12:1357766. doi: 10.3389/fpubh.2024.1357766
Edited by:
Renaud Becquet, Bordeaux Population Health Research Centre (Inserm, IRD, Bordeaux University), FranceReviewed by:
Georgia Nektaria Porfyri, National and Kapodistrian University of Athens, GreeceGiuseppe Battaglia, University of Palermo, Italy
Giovanni Mansueto Mansueto, Maastricht University, Netherlands
Copyright © 2024 Loy, Klam, Dötsch, Frank and Bender. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Stephan Bender, c3RlcGhhbi5iZW5kZXJAdWsta29lbG4uZGU=
†These authors have contributed equally to this work