School Disengagement and Mental Health Service Intensity Need Among Clinically Referred Students Utilizing the interRAI Child and Youth Mental Health Assessment Instrument

Although mental health challenges are widespread, impacting 1 in 5 children and youth, only 25% of these young people receive the required mental health supports. Unmet mental health needs are strongly associated with functional impairments including poor self-care, interpersonal challenges, and school difficulties among young people. School disengagement, or a student's lack of involvement in education through interest, curiosity, motivation, and active participation, is associated with a wide array of detrimental outcomes including chronic mental health difficulties, conduct and delinquent behaviors, criminal justice involvement, and unemployment in adolescence and adulthood. Disengagement observed within the school setting may be indicative of underlying mental health challenges and reflective of service intensity need. The current study extends the literature by examining the relationship between school disengagement and mental health service intensity need among 14,750 clinically referred students across elementary and secondary school utilizing the interRAI Child and Youth Mental Health instrument. Findings indicated that more than 25% of clinically referred students were at heighted risk for school disengagement and required high-intensity services. Further, mental health service intensity need was positively associated with risk of school disengagement among students, along with the specific reason for referral (i.e., psychiatric symptoms, harm to self, harm to others, or addiction or dependency), after controlling for sex and age. Implications of the findings are explored within the context of the school setting and future directions are suggested.

Introduction

An estimated 1.2 million Canadian children and youth experience significant mental illness with clinically significant impairments in functioning requiring treatment (1). Despite a significant number of children and youth demonstrating functional limitations across settings, an alarming number of young people and their families continue to have unmet mental health needs (2, 3). Challenges exist in mental health care for young people across Canada with respect to access to timely and effective treatment as well as coordination of services across sectors [i.e., education, social services, medical, and community-based services; (4, 5)]. Identifying those young people in need of support services and making available the necessary treatments is important to promote positive immediate and life-long outcomes for all Canadians. Certainly, determining the intensity and nature of mental health services required to support a young person and his or her family is a difficult and yet critical step in offering timely and effective treatment opportunities. Although it is widely accepted that mental health challenges are associated with negative educational outcomes, service intensity need has yet to be explored in relation to academic outcomes [e.g., (6)]. Early identification of children and youth in need of mental health services and providing timely access to appropriate treatments is important to promote educational success.

Mental Health and School Problems

Mental health concerns exhibited by children and youth such as anxiety, attention deficit/hyperactivity disorder, depression, conduct disorder, eating disorders, and suicidal ideation and attempts, are associated with negative educational outcomes (7). A review of the literature on the impact of mental health on school success revealed that “poor academic functioning and inconsistent school attendance are early signs of emerging or existing mental health problems during childhood and adolescence” [(8), p. 189]. Research has consistently demonstrated that mental health challenges can contribute to poor academic achievement, school disengagement, school refusal, and school dropout [e.g., (9–16)].

School problems during childhood and adolescence have been associated with significant negative outcomes. Indeed, early school refusal behaviors, such as school disengagement, increases the risk for later criminal activity, substance use, and school dropout (17). A substantial number of youth involved in the criminal justice system have experienced academic failure, school refusal, school exclusion, and early termination of secondary education (18). A longitudinal study that followed 585 children from age 5 to 27 years old demonstrated that individuals who drop out of secondary school are four times more likely to experience negative outcomes such as being arrested, fired, reliant on government assistance, using illicit substances, and having poor health by 27 years of age (19). Additionally, secondary school dropouts are 24 times more likely to experience as many as four or more of the stated negative outcomes (19). When considering adult outcomes, individuals who dropped out of secondary school make up disproportionately higher percentages of prison inmates as compared to those who completed secondary school (20). Notably, when young people who dropout of secondary school received treatment for behavioral, emotional, or substance use problems before the age 24 years, a reduction in the number of expected negative outcomes has been observed (19). Early identification and timely provision of treatment for children and youth requiring intervention services may reduce the likelihood for the manifestation of acute distress requiring crisis supports both immediately and later in life [e.g., (5, 21)].

Estimated Value of Services

Significant costs are associated with mental health challenges and delinquency including criminal activity, substance use, and school dropout. Previously, Cohen (22) estimated that typical societal costs for a career criminal, ($1.3–$1.5 million USD), a heavy drug user ($370,000–$970,000 USD), and a high-school dropout ($243,000–$388,000 USD). When taken together, Cohen (22) estimated that the monetary value of saving a high-risk youth was ~$2.3 million USD. Updated estimates of the monetary value of saving a high-risk 14-year-old from a life of negative outcomes range from $2.6 to $5.3 million USD (23). Ultimately, delinquency, including school refusal and school dropout can be both detrimental for individuals and their families as well as expensive for society [e.g., (2, 20)].

Costs associated with supporting children and youth presenting with various mental health challenges has been examined (24). According to the findings, significant discrepancies in expenditures associated with specific diagnoses exist likely because of inconsistent samples and methods for assessing the monetary costs of treatment and the accumulated consequences of unmet treatment needs. Nonetheless, it is clear that when young people do not receive adequate support and treatment, there is an increased likelihood of experiencing significant negative outcomes (i.e., health, mental health, quality of life, unemployment, and poor income), ultimately increasing long-term societal costs (24).

Service Utilization

Although the first onset of many mental health issues is typically between childhood and early adulthood, children and youth do not always receive the necessary treatment to prevent life-course persistent and chronic mental health problems (2, 25, 26). Research indicates that up to 75% of Canadian children and youth with mental health challenges do not receive required mental health services (2). Early research on patterns of service utilization for addressing mental health challenges among young people indicated that sociodemographic factors, parental attitudes, and the intensity of a child's illness significantly influence service use across settings [i.e., mental health, general health, and school; (27)]. The education system is uniquely situated to identify and support children and youth who are experiencing mental health distress and functional limitations. Not surprisingly, schools were revealed as the main point of entry to mental health services for children and youth (4). The second most common point of entry to mental health services for children up to 13 years old was identified as the specialty mental health sector and for youth 14–16 years old was the juvenile justice system (4). First episode of mental health service utilization among young people tends to “increase in early to middle childhood, stabilize, then increase again in early adolescence” (28). Externalizing behaviors were most predictive of first time service use in middle childhood; however, combined externalizing and internalizing presentation predicted first time service use during adolescence (28).

Parental and adolescent problem recognition are an important step toward service utilization for addressing mental health challenges [for a review see (29)]. Indeed, caregivers play an important role in supporting young people in accessing and participating in mental health interventions (30). Parental beliefs that their child needs help is a critical predictor of service use (27). Parents are more likely to seek services when their child's problems are more severe and persistent, including the presence of comorbidity (29). Additionally, medical issues and school problems were revealed to increase parental help seeking behaviors for young people (29). Consistently, children and youth who acknowledge their experience of psychological distress and related impairments are more likely to seek services (29). Gender differences in help-seeking behaviors were revealed such that males were more likely to access services during childhood and early adolescence, whereas females were more likely to access services in late adolescence (29).

Current Study

School disengagement, that is a student's lack of meaningful involvement in education as represented by low interest, curiosity, motivation for learning, is associated with varying degrees of challenges for students within the school setting (31). The current study presents a first look at the association between service intensity need and school disengagement among clinically referred students. A strong positive relationship between school disengagement and service intensity need was expected such that students who were disengaged in school were expected to require high-intensity services (i.e., requiring three or more of the following mental health services: inpatient admission; formal care provided by a psychiatrist, psychologist, psychometrist, social worker, child protection worker, or case management; or intervention for life skills training, social skills, crisis management, family functioning, anger management, family preservation, behavior management, family support, and medication management) compared to those students who were engaged in school. Consistent with previously noted age and sex-based findings, it was anticipated that the association between school disengagement and service intensity need at the time of intake to clinical services may differ based on age and sex. Further, primary concerns for referral to mental health services (i.e., psychiatric symptoms, harm to self, harm to others, addiction, or dependency) were investigated to offer insights for triaging purposes.

Methods

Participants

Archival interRAI Child and Youth Mental Health Assessment [ChYMH; (32)] data collected at seventy community mental health agencies in the Province of Ontario, Canada between November 2012 and May 2019 were utilized for this study. A convenience sample of 14,750 clinically referred young children (n = 1,700; ages 4–7 years old), school-aged children (n = 4,396; ages 8–11 years old), and youth (n = 8,654; ages 12–18 years old) who accessed mental health services was investigated. Participants in this study accessed services through self-referral and referral by healthcare professionals (e.g., family physician or pediatrician), schools, or mental health professionals (e.g., counselor or social worker). The total sample was comprised of English-speaking male (56.2%) and female (43.8%) children and youth ranging in age from 4 to 18 years old (M_age= 12.23, SD_age= 3.52) who were formally enrolled in schooling (i.e., part-time or full-time). Students were identified as: (a) attending preschool, homeschool, regular classroom with no extra supports; (b) regular classroom with extra support (e.g., classroom, workload, or testing accommodations or modifications such as additional time to complete assessments, oral testing, frequent breaks, withdrawal from class for extra help completing work, one to one support, assistance with personal needs such as feeding or dressing), or; (c) a specialized classroom program (e.g., intellectual, learning, or behavioral needs; vocational training; education within a treatment facility). Refer to Table 1 for more detailed participant characteristics.

TABLE 1

Table 1. Sample demographic information by age group.

Procedure and Ethical Considerations

Trained assessors (including nurses, psychologists, psychiatrists, social workers, child and youth workers, case managers, and speech and language pathologists) collected data as part of typical clinical practice using a 60–90-min semi-structured interview with the child or youth, caregivers, and collateral contacts (e.g., teachers and therapists) along with any information available with respect to medical and education records. All participants are assigned a case record number upon completion of the assessment tool and no identifying information (e.g., names, full birthday, and postal code) are stored on the interRAI secure server. Data collection using the ChYMH is ongoing across the Province and has been approved by the university ethics review committee.

Measures

The interRAI Child and Youth Mental Health Assessment [ChYMH]

The interRAI ChYMH (32) is a comprehensive assessment tool designed to identify clinically relevant elements pertaining to the specific needs of school-age children and youth (i.e., medical, psychological, social, behavioral, environmental, strengths, and risk). As part of the Child and Youth suite of interRAI assessment tools, instruments within the Child and Youth suite of instruments are being utilized both nationally and internationally. A variety of scales and algorithms are embedded within the instrument to provide tracking indices for measuring symptom severity and to generate data-driven risk assessments across domains (e.g., self-harm, harm to others, and service intensity need). Further, numerous care planning protocols highlighting areas of imminent concern or risk are produced upon completion of the interRAI ChYMH to support clinicians in tracking client progress and in developing adaptive treatment plans. Additional literature with respect to the interRAI assessment can be found on the interRAI website (www.interrai.org). Scales and algorithms developed specifically for the Child and Youth suite of instruments have demonstrated robust psychometric properties including strong inter-rater reliability, internal consistency, as well as substantial face validity, content validity, criterion validity, and discriminant validity [e.g., (33–42)]. Several items, scales and a recently published algorithm from the interRAI ChYMH suite were included in the current research to investigate factors associated with the risk for school disengagement among clinically referred children and youth.

School Disengagement

School disengagement among students was evaluated using an eight-item scale, School Disengagement Scale (SDeS), including elements of behavioral, emotional, and cognitive disengagement¹. The presence (0 = no, 1 = yes) of the items were recorded by assessors (i.e., increased lateness or absenteeism, poor productivity or disruptiveness at school, conflict with school staff, current removal from school due to disruptive behavior, strong persistent dissatisfaction with school, current refusal to attend school, expresses intent to quit school, and poor overall academic performance). The standardized Cronbach's alpha based on the polychoric correlation matrix for the eight items of the SDeS was 0.86, suggesting good reliability. Items were summed and ranged from zero to eight with higher scores indicating an increased risk of school disengagement. Validation research suggests that optimal sensitivity (56.9–76.2%) and specificity (74.1–86.4%) for predicting poor academic performance in the last 6 months is achieved when the cut-off score on the SDeS is two (43?). As such, all students in the present study with SDeS scale scores of two or greater were identified as being at risk for school disengagement. Those students with SDeS scale scores of zero or one were identified as being engaged in school.

Service Intensity Need

Reflecting the intensity and nature of services required to support children and youth seeking mental health services, the Resource Intensity for Children and Youth (RIChY) algorithm was used in this present study (42). The RIChY algorithm is an empirically based decision-support tool composed of 25 individual items, three scales (i.e., Anxiety, Parenting Strengths, Family Functioning), and two decision-support algorithms (i.e., Self-Harm, Harm to Others) from the ChYMH assessment. Based on critical indicators from the interRAI ChYMH assessment tool, an individual's level of risk is determined using the RIChY to suggest priority for intensive service needs. Variability in critical indicators of service need due to the age of a young person led to the development of three independent but related age-based RIChY decision trees (i.e., 4–7 years old, 8–11 years old, and 12–18 years old). The terminal nodes of the RIChY decision tree range from zero to five, where higher nodes are indicative of higher service intensity need. Strong psychometric properties and clinical applicability have been demonstrated for the RIChY algorithm for its use with children and youth accessing mental health services (42). Notably, children and youth accessing outpatient services scored significantly lower on the RIChY algorithm as compared to children and youth accessing inpatient services (42). Consistent with the published optimal cut-off score for predicting service intensity need, students with RIChY terminal nodes of three or greater were identified as requiring high-intensity services (42). Those students with RIChY terminal nodes of two or less were identified as requiring low-intensity services. Additional information about the RIChY algorithm is available in the identified publication.

Data Analysis

First descriptive statistics were conducted for all variables using means, standard deviations, and range for the continuous variables and percentage for the categorical variables. Bivariate analyses were conducted to determine the independent associations between school disengagement and service intensity needs with age, gender, and reason for referral. Finally, multivariate binary logistic regression modeling was conducted to examine service intensity need as a function of school disengagement, reason for referral (i.e., psychiatric symptoms, harm to self, harm to others, and addiction), and demographic variables (age and sex) with separate models for each of the investigated age groups (i.e., young children, school-age children, and youth). Notably, addiction as the reason for referral was only computed for youth (age 12–18 years). Variables were considered significant if the p-value was <0.05. Odds ratios and 95% CI are reported in Table 4. Assumptions testing were conducted for each analysis to control for threats to statistical conclusions.

Results

School Disengagement and Service Intensity Need

Findings indicated that 45.9% of students were identified as at risk for school disengagement (young children: 42.1%; school-age children: 47.6%; youth: 45.9%) and 45.5% of students were identified as requiring high-intensity service needs (young children: 23.6%; school-age children: 41.4%; youth: 51.9%) at the time of intake into clinical care. Within this sample, 26.1% of the students (young children: 16.2%; school-age children: 26.3%; youth: 28.0%) were identified as being disengaged in school and as requiring high-intensity service needs. The relationship between school disengagement and service intensity need was examined using separate chi-square analyses for each of the investigated age groups (i.e., young children, school-age children, and youth).

Findings presented in Table 2 revealed that service intensity need was significantly related to school disengagement with low to moderate effects for each of the investigated age groups (i.e., young children, school-age children, and youth). Sex differences in the relationship between service intensity need and school disengagement are also presented in Table 2. As expected, findings indicated that students who require low-intensity services were more likely to also to be engaged in school; conversely, those students who require high-intensity services were more likely to be disengaged in school. Further, sex differences are present in the relationship between school disengagement and service intensity need; however, this relationship is more stable for male students across development as compared to female students.

TABLE 2

Table 2. Chi-square comparison of service intensity need and risk for school disengagement by sex and age.

Reason for Referral and School Disengagement

As presented in Table 3, the relationship between reason for referral and school disengagement was examined for each of the investigated age groups (i.e., young children, school-age children, and youth) revealing low to moderate effects. As expected, findings indicated that the specific reason for referral (i.e., psychiatric symptoms, harm to self, harm to others, and addiction or dependency) was uniquely related to the likelihood that students experienced school disengagement.

TABLE 3

Table 3. Chi-square comparison for school disengagement and reason for referral.

Multivariate Analyses

Table 4 presents the results of multivariate binary logistic regression modeling. Each model examined service intensity need as a function of school disengagement, the reason for referral, and demographic variables (age and sex). Separate models examined these relationships for each of the investigated age groups (i.e., young children, school-age children, and youth) and reason for referral (psychiatric symptoms, harm to self, harm to others, and addiction). The model with addiction was computed only for youth (age 12–18 years).

TABLE 4

Table 4. Multivariate binary logistic regression models for service intensity need as a function of school disengagement, reason for referral, sex and age.

As seen in Table 4, in multivariate models, among young children aged 4–7 years, those with high (vs. low) school disengagement and any reason for referral were more likely in odds to require high-intensity services. In particular, young children referred for harm to self were more than three times likely in odds, and those referred for harm to others were more than six times more likely in odds, to require high-intensity services compared to young children with no such referral concerns. In addition, among young children, younger males (compared to females) were more likely in odds to require high-intensity services.

Next, in children aged 8–11 years, those with high (vs. low) school disengagement and any reason for referral were more likely in odds to require high-intensity services. Specifically, school-aged children referred for harm to self were more than two times likely in odds, and those referred for harm to others were more than three times more likely in odds to require high-intensity services compared to school-aged children with no such referral concerns. In this group, females and males had the same likelihood in odds to require high-intensity services. Older children were more likely in odds to require high-intensity services than their younger counterparts within this age range.

Finally, among youth, those with high (vs. low) school disengagement and any reason for referral were more likely in odds to require high-intensity services. In this group, youth referred for harm to self were more than five times more likely in odds, youth referred for harm to others were more than four times more likely in odds, and youth referred for addiction were more than two times more likely in odds to require high-intensity services, compared to youth with no such referral concerns. Notably, in this group, females were more likely in odds to require high-intensity services than males. Older children were more likely in odds to require high-intensity services than younger youth.

Discussion

Although it is widely accepted that mental health challenges are associated with negative educational outcomes, service intensity need has yet to be explored in relation to school engagement problems among clinical samples of students. The current study contributes to the literature by presenting a first look at the association between school disengagement and service intensity need among clinically referred young children, school-age children, and youth. As predicted, school disengagement was found to be associated with high-intensity service needs. Indeed, students who were at highest risk for school disengagement were ~2–4 times more likely in odds to require high-intensity services. The strength of this relationship differed by age [i.e., young children (4–7 years), school-age children (8–11 years), and youth (12–18 years)] such that young children who were at high risk for school disengagement were more likely to require high-intensity services as compared to their youth counterparts. Further, sex differences indicated that male students who were at high risk for school disengagement were two to three times more likely in odds to require high-intensity services while female students who were at risk for school disengagement were two to seven times more likely in odds to require high-intensity services. The relationship between school disengagement and service intensity need was more stable for male students as compared to female students. Results indicated that young female children who were at heighted risk for school disengagement were found to be almost seven times more likely in odds to require high-intensity services as compared their matched male peers who were only three times more likely in odds to require high-intensity services. Young girls who require high-intensity services is rare, but when this occurs, it is quite significant and highly associated with school disengagement. Interestingly, among school-age children and youth, the likelihood for male and female students to be disengaged in school and require high-intensity services was similar. When investigating service intensity need as a function of school disengagement, reason for referral (i.e., psychiatric symptoms, harm to self, harm to others, and addiction or dependency), and demographic variables (age and sex), similar findings were revealed. Indeed, students of all ages who were identified as being disengaged in school (i.e., as compared to engaged) were more likely in odds to require high-intensity services. Specifically, referral for psychiatric symptoms was associated with two times increased odds for requiring high-intensity services among all students. Further, referral for harm to self was associated with two to five times increased odds for requiring high-intensity services, while referral for harm to others was associated with three to six times increased odds for requiring high-intensity services. Finally, referral for addiction or dependency was associated with two times increased odds for requiring high-intensity services among youth. Findings are considered within the context of the school setting and future directions are suggested.

Research suggests that the severity of presenting concerns is typically associated with the intensity of individualized treatment approaches such that young people who are experiencing more severe distress are more likely to be involved with psychiatric or multidisciplinary supports (3). In this study, students who were at heightened risk for school disengagement, thus experiencing significant challenges within the school setting, were found to be more likely to require high-intensity services. The proportion of students identified as being disengaged in school and requiring high-intensity services increased with age. That is, among clinically referred students, 26% of school-age children and 28% of youth were identified as being disengaged in school and requiring high-intensity services as compared to only 16% of young children. Understandably, young people often rely heavily on their parents for accessing mental health treatment and research suggests that service utilization by children and youth is associated with the health-seeking behaviors of the adults in their household (44). An early study investigating unmet mental health service needs in community samples of children and adolescents revealed that economic disadvantage, parental psychopathology, poor school grades, and parent-reported barriers were key problems for accessing services (45).

It has also been found that parental psychopathology is associated with increased service utilization and expenditures for children and youth, even after controlling for parental service utilization (44, 46). For example, parental depression is associated with increased emergency department use and consultations with general practitioners as well as outpatient and inpatient services by children and youth (44). An investigation of predictors for mental health service utilization among a sample of adolescent males revealed that diagnoses of attention deficit hyperactivity disorder (ADHD) and oppositional defiant disorder (ODD) among adolescent males, as well as parental substance use disorders (i.e., paternal alcohol disorder and maternal amphetamine use disorder) predicted increased mental health service utilization (47). Previous research suggests that young people who acknowledge their distress and related functional impairments are more likely to seek services (29, 45).

Help seeking behaviors associated with mental health services among adolescents and young adults were revealed to be hindered by “perceived stigma and embarrassment, difficulties recognizing symptoms, and a preference for self-reliance” (48). Research consistently indicates that stigma associated with mental illness and mental health treatments can significantly impact an individual's willingness to access and fully participate in treatment services (49). Among 1,092 young Canadians ages 15–24 years old presenting with a mood, anxiety, or substance-related disorders, it was demonstrated that individuals most likely to access mental health services were female, living alone, experiencing challenges in social situations, and presenting with mood disorders or chronic illness (50). Harm to self and others as well as substance use represent forms of maladaptive coping. In the current study, referral for each form of maladaptive coping (i.e., harm to self, harm to others, and addiction or dependency) was found to increase the likelihood for school disengagement for all students.

The education system has been identified as the main point of entry to mental health services for children and youth (4). School staff are uniquely positioned to support students through referrals to more intensive school and community based services. Exploration of the effectiveness of universal screeners as completed by school staff vs. traditional classroom-referral methods for identifying at-risk students revealed that many students requiring mental health support are overlooked when universal screeners are not utilized (51). As indicated in the present study, psychiatric symptoms as well as harm to self and others were related to school engagement problems for all students. Interestingly, although findings revealed that general referrals for psychiatric symptoms increased the likelihood for school disengagement by two to four times across age groups, the likelihood for high service need only increased by about 1.5 times. Consistently, in an investigation of educators' ability to recognize students with mental health concerns within the classroom, teachers were found to be significantly less likely to accurately identify students exhibiting moderate or subclinical mental health symptoms (52). Within the school setting, teachers can consistently detect students exhibiting severe externalizing and internalizing problems (52).

Given the nature of behavioral problems across settings, referral for harm to others was therefore expected to be associated with school engagement problems as well as higher intensity service needs for all students. Findings from the present study revealed strong associations between referral for harm to others, school disengagement, and service intensity need such that students referred for harm to others were between two to three times more likely in odds to be disengaged in school and between four to six times more likely in odds to require high-intensity services compared to students with no such referral concerns. Notably, younger children (ages 4–7 years) who were referred for harm to others were revealed to be at the greatest risk, followed by youth (ages 12–18 years) and finally school-aged children (ages 8–11 years). This is consistent with previous research which indicates that young children are most often referred for externalizing problems such as aggressive and disruptive behaviors whereas youth are referred more for both internalizing and externalizing disorders (28). Further, young children are highly dependent on their caregivers which necessitates significant caregiver involvement in accessing and participating in intervention services. Although the education system is the first most common point of entry to mental health services for children and youth, the second most common point of entry to mental health services for children up to 13 years old is the specialty mental health sector and for youth 14–16 years old was the juvenile justice system (4). In the present study, it may be that older students are just as likely to require high-intensity service needs for harm to others behaviors, however, these students may be involved in services from other sectors (e.g., youth justice) and thus not included in our clinically referred sample.

Results indicated that referral for harm to self was associated with risk of school disengagement and service intensity need. Specifically, students referred for harm to self were between two to three times more likely in odds to be disengaged in school and between two to five times more likely in odds to require high-intensity services compared to students with no such referral concerns. Notably, younger children (ages 4–7 years) who were referred for harm to self were more likely to experience school disengagement meanwhile youth (ages 12–18 years) who were referred for harm to self were more likely to require high-intensity services. Students who are engaging in self-harm require intensive services and support across settings. Within the classroom, self-harm among young students may be more obvious or disruptive in nature as compared to youth who may use adaptive strategies to conceal their self-harming behaviors. As such, school disengagement and self-harm among young students might be more easily detected. Indeed, youth who engage in self-harming behaviors may in fact be high-achieving students with perfectionistic tendencies who are engaged in school, but are struggling with mental health functioning outside of the classroom setting (53, 54). Relatedly, Splett et al. (52) found that teachers rated externalizing behaviors to be more severe and detrimental for the student than internalizing symptoms which may help to explain why self-harm behaviors go unnoticed until the student reaches a point of requiring significant support and intervention.

Of concern particularly among youth, referral for addiction or dependency was found to be associated with an increased likelihood in odds by two times for school disengagement as well as an increased likelihood in odds by two times for requiring high-intensity services as compared to their non-substance addicted counterparts. Although experimentation with risky behaviors such as substance use is common among adolescents, regular substance use can jeopardize an adolescent's physical and mental health and well-being especially given that adolescent substance use is a significant predictor of substance abuse in adulthood (6, 12). Further, substance using teens are at a greater risk for both immediate and long-term consequences such as psychopathology, emotional distress, cognitive impairments, and substance-induced psychosis [e.g., (55, 56)]. Youth who are dependent on substances tend to have significant challenges with managing their drug related behaviors which can interfere with their education. Indeed, directly as related to school outcomes, substance using youth are not able to fully participate in their learning if they are under the influence during school or homework hours. Present findings highlight that drug and addiction education is important among school-age children and youth to reduce the likelihood of addiction and dependency problems which can impact adaptive functioning later in life.

Summary

Taken together, findings from the current study extend previous research to highlight the relationship between risk of school disengagement and mental health service intensity need among clinically referred students across elementary and secondary school. Indeed, one in four clinically referred students were found to be at risk for school disengagement and requiring high-intensity service needs. School engagement problems within the school setting may be an indicator of underlying mental health problems. School staff are uniquely positioned to support students through early identification and referrals to school and community level supports and services. Significant age and sex differences in the relationship between school disengagement and high-intensity service need suggest the requirement of focused triaging protocols to support students at various stages in development.

Limitations

Despite the large sample size and use of the interRAI ChYMH, known to be a highly reliable and valid multisource clinician-rated comprehensive assessment tool, the present study should be considered together with its limitations. All participants in the present study were accessing services at a community or inpatient mental health agency, and consequently, generalization of these findings to school-based populations is limited. The examination of school disengagement longitudinally, and prior to referrals to community agencies, would be beneficial to enhance prevention measures to reduce discontinued pursuits to educational attainment. Additionally, racial and cultural information was not obtained and, as a result, examination of these variables in relation to service utilization could not be conducted. Such data will be important to examine to improve social justice, equity as well as the importance of multi-culturally attentive processes and procedures when delivering mental health services.

Clinical Implications and Future Directions

This research highlights the necessity for early identification and providing timely access to intervention as a method to improve the lives of those at risk for mental health and school problems. Early identification and timely provision of treatment for children and youth requiring mental health services may reduce the likelihood for the manifestation of acute distress requiring crisis supports as well as life-long consequences [e.g., (5, 21)]. Many mental health supports and treatments are provided within the education system; however, the education system is not an appropriate venue to provide all types of treatments required to address psychopathology (e.g., psychiatric intervention, family support, and trauma-focused intervention). Thus, it is critical that sectors involved in supporting children and youth work together in their approach to mental health screening and assessment to foster improved mental health and well-being and to maximize reductions in the negative outcomes that may otherwise be experienced (57). Continuity of care across sectors, namely education, mental health, and medical health services, is essential for ensuring that children and youth demonstrating mental health challenges are provided with appropriate services in a timely manner (4, 24). Implementation of a standardized assessment-to-intervention system within the educational system, the most common point of entry into mental health services, could ultimately improve our mental health delivery system. Such an approach supports early intervention while also facilitating service integration through the use of a common language across service providers, improved triaging and prioritization, and enhanced use of quality data for decision making at a system level². Through the identification of risk and resilience factors, early identification of at-risk students could reduce the likelihood of long-lasting detrimental impacts of school disengagement, resulting in improved outcomes and reducing negative sequalae throughout the lifespan.

Data Availability Statement

The datasets presented in this article are not readily available to protect the privacy of participants. Requests to access the datasets should be directed to the corresponding author.

Ethics Statement

Western University's ethics board granted approval for the secondary analysis of data collected in various agencies throughout the Province of Ontario (REB #106415).

Author Contributions

JA and SS devised the main conceptual ideas for this study, carried out analyses and interpretation of findings, and prepared the manuscript. NL provided data analytical support during revisions for publication. All authors agree to its submission for publication.

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

The Handling Editor JF declared a past co-authorship/collaboration with one of the authors SS.

Publisher's Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Footnotes

1. ^Klassen JA, Hamza CA, Stewart SL. interRAI's Child and Youth School Disengagement Scale (SDeS): Validation of a New Scale to Measure School Disengagement Among Children and Youth (manuscript in preparation).

2. ^Stewart L, Toohey A. Screening and assessment of mental health problems in students: utilizing an integrated assessment-to-intervention approach to enhance integrated care. In: Andrews J, Shaw S, Domene J, McMorris C, eds. School, Clinical, and Counseling Psychology: Mental Health Assessment, Prevention, and Intervention. Berlin: Springer (under review).

References

1. Kirby M, Keon WJ. Out of the Shadows at Last: Transforming Mental Health, Mental Illness, and Addiction Service in Canada. Ottawa, ON: Senate of Canada, Standing Committee on Social Affairs, Science and Technology (2006).

Google Scholar

2. Waddell C, McEwan K, Shepherd CA, Offord DR, Hua JM. A public health strategy to improve the mental health of Canadian children. Can J Psychiatry. (2005) 50:226–33. doi: 10.1177/070674370505000406

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Sareen J, Cox BJ, Afifi TO, Yu BN, Stein MB. Mental health service use in a nationally representative Canadian survey. Can J Psychiatry. (2005) 50:753–61. doi: 10.1177/070674370505001204

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Farmer EM, Burns BJ, Phillips SD, Angold A, Costello EJ. Pathways into and through mental health services for children and adolescents. Psychiatric Serv. (2003) 54:60–6. doi: 10.1176/appi.ps.54.1.60

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Gandhi S, Chiu M, Lam K, Cairney JC, Guttmann A, Kurdyak P. Mental health service use among children and youth in Ontario: population-based trends over time. Can J Psychiatry. (2016) 61:119–24. doi: 10.1177/0706743715621254

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Henry KL, Knight KE, Thornberry TP. School disengagement as a predictor of dropout, delinquency, and problem substance use during adolescence and early adulthood. J Youth Adolesc. (2012) 41:156–66. doi: 10.1007/s10964-011-9665-3

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Canadian Mental Health Association. Mental Illnesses in Children and Youth. (2014). Available online at: https://cmha.bc.ca/documents/mental-illnesses-in-children-and-youth-2/ (accessed August 20, 2018).

Google Scholar

8. DeSocio J, Hootman J. Children's mental health and school success. J Sch Nurs. (2004) 20:189–96. doi: 10.1177/10598405040200040201

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Breslau J, Miller E, Breslau N, Bohnert K, Lucia V, Schweitzer J. The impact of early behavior disturbances on academic achievement in high school. Pediatrics. (2009) 123:1472–6. doi: 10.1542/peds.2008-1406

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Breslau J, Lane M, Sampson N, Kessler RC. Mental disorders and subsequent educational attainment in a US national sample. J Psychiatr Res. (2008) 42:708–16. doi: 10.1016/j.jpsychires.2008.01.016

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Haight CM, Chapman GV, Hendron M, Loftis R, Kearney CA. Evaluation of a truancy diversion program at nine at-risk middle schools. Psychol Sch. (2014) 51:779–87. doi: 10.1002/pits.21775

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Hemphala M, Hodgins S. Do psychopathic traits assessed in mid-adolescence predict mental health, psychosocial, and antisocial, including criminal outcomes, over the subsequent 5 years? Can J Psychiatry. (2014) 59:40–9. doi: 10.1177/070674371405900108

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Lee T, Cornell D, Gregory A, Fan X. High suspension schools and dropout rates for black and white students. Educ Treat Child. (2011) 34:167–92. doi: 10.1353/etc.2011.0014

CrossRef Full Text | Google Scholar

14. Quiroga CV, Janosz M, Lyons JS, Morin AJS. Grade retention and seventh grade depression symptoms in the course of school dropout among high-risk adolescents. Psychology. (2012) 3:749–55. doi: 10.4236/psych.2012.329113

CrossRef Full Text | Google Scholar

15. Stewart SL, Klassen JA, Hamza CA. Emerging mental health diagnoses and school disengagement: an examination among clinically referred children and youth. Exceptional Educ Int. (2016) 26:5–20. doi: 10.5206/eei.v26i2.7738

CrossRef Full Text | Google Scholar

16. Verweij KJH, Agrawal AC, Martin NG, Lynskey MT. Is the relationship between early-onset cannabis use and educational attainment causal or due to common liability? Drug Alcohol Depend. (2013) 133:580–6. doi: 10.1016/j.drugalcdep.2013.07.034

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Jones D, Dodge KA, Foster EM, Nix R. Early identification of children at risk for costly mental health service use. Prevent Sci. (2002) 3:247–56. doi: 10.1023/A:1020896607298

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Christle CA, Jolivette K, Nelson CM. Breaking the school to prison pipeline: identifying school risk and protective factors for youth delinquency. Exceptionality. (2005) 13:69–88. doi: 10.1207/s15327035ex1302_2

CrossRef Full Text | Google Scholar

19. Lansford JE, Dodge KA, Pettit GS, Bates JE. A public health perspective on school dropout and adult outcomes: a prospective study of risk and protective factors from age 5 to 27 years. J Adolesc Health. (2016) 58:652–8. doi: 10.1016/j.jadohealth.2016.01.014

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Cataldi EF, KewalRamani A. High School Dropout and Completion Rates in the United States: 2007 Compendium Report. NCES 2009-064. Washington, DC: National Center for Education Statistics (2009).

Google Scholar

21. Kieling C, Baker-Henningham H, Belfer M, Conti G, Ertem I, Omigbodun O, et al. Child and adolescent mental health worldwide: evidence for action. Lancet. (2011) 378:1515–25. doi: 10.1016/S0140-6736(11)60827-1

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Cohen MA. The monetary value of saving a high risk youth. J Quant Criminol. (1998) 4:5–33. doi: 10.1023/A:1023092324459

CrossRef Full Text | Google Scholar

23. Cohen MA, Piquero AR. New evidence on the monetary value of saving a high risk youth. J Quant Criminol. (2009) 25:25–49. doi: 10.1007/s10940-008-9057-3

CrossRef Full Text | Google Scholar

24. Beecham J. Annual research review: child and adolescent mental health interventions: a review of progress in economic studies across different disorders. J Child Psychol Psychiatry. (2014) 55:714–32. doi: 10.1111/jcpp.12216

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Kessler RC, Berglund P, Demler O, Jin R, Merikangas KR, Walters EE. Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the National Comorbidity Survey Replication. Arch Gen Psychiatry. (2005) 62:593–602. doi: 10.1001/archpsyc.62.6.593

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Kessler RC, Amminger GP, Aguilar-Gaxiola S, Alonso J, Lee S, Ustun TB. Age of onset of mental disorders: a review of recent literature. Curr Opin Psychiatry. (2007) 20:359–64. doi: 10.1097/YCO.0b013e32816ebc8c

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Zahner GE, Daskalakis C. Factors associated with mental health, general health, and school-based service use for child psychopathology. Am J Public Health. (1997) 87:1440–8. doi: 10.2105/AJPH.87.9.1440

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Erath SA, Keiley MK, Pettit GS, Lansford JE, Dodge KA, Bates JE. Behavioral predictors of mental health service utilization in childhood through adolescence. J Dev Behav Pediatrics. (2009) 30:481. doi: 10.1097/DBP.0b013e3181c35938

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Zwaanswijk M, Verhaak PF, Bensing JM, Van der Ende J, Verhulst FC. Help seeking for emotional and behavioural problems in children and adolescents. Europ Child Adolesc Psychiatry. (2003) 12:153–61. doi: 10.1007/s00787-003-0322-6

PubMed Abstract | CrossRef Full Text | Google Scholar

30. Logan DE, King CA. Parental facilitation of adolescent mental health service utilization: a conceptual and empirical review. Clin Psychol Sci Pract. (2001) 8:319–33. doi: 10.1093/clipsy.8.3.319

CrossRef Full Text | Google Scholar

31. Fredricks JA, Blumenfeld PC, Paris AH. School engagement: potential of the concept, state of the evidence. Rev Educ Res. (2004) 74:59–109. doi: 10.3102/00346543074001059

CrossRef Full Text | Google Scholar

32. Stewart SL, Hirdes JP, Curtin-Telegdi N, Perlman C, MacLeod K, Ninan A, et al. InterRAI Child and Youth interRAI Child and Youth Mental Health (ChYMH) Assessment Form and User's Manual: For use with In-Patient and Community-Based Assessments. Version 9.3. Washington, DC: interRAI (2015).

Google Scholar

33. Hirdes JP, van Everdingen C, Ferris J, Franco-Martin M, Fries BE, Heikkilä J, et al. The interRAI suite of mental health assessment instruments: an integrated system for the continuum of care. Front Psychiatry. (2020) 10:1–30. doi: 10.3389/fpsyt.2019.00926

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Lau C, Stewart SL, Saklofske DH, Hirdes J. Scale development and psychometric properties of internalizing symptoms: the interRAI child and youth mental health internalizing subscale. Psychiatry Res. (2019) 278:235–41. doi: 10.1016/j.psychres.2019.06.013

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Lau C, Stewart SL, Saklofske DH, Tremblay PF, Hirdes J. Psychometric evaluation of the interRAI child and youth mental health disruptive/aggression behaviour scale (DABS) and hyperactive/distraction scale (HDS). Child Psychiatry Hum Dev. (2018) 49:279–89. doi: 10.1007/s10578-017-0751-y

PubMed Abstract | CrossRef Full Text | Google Scholar

36. Stewart SL, Babcock SE. interRAI child and youth mental health-screener (ChYMH-S): a psychometric evaluation and validation study. Child Psychiatry Hum Dev. (2020) 51:769–80. doi: 10.1007/s10578-020-01003-7

PubMed Abstract | CrossRef Full Text | Google Scholar

37. Stewart SL, Babcock SE, Li Y, Dave HP. A psychometric evaluation of the interRAI Child and Youth Mental Health instruments (ChYMH) anxiety scale in children with and without developmental disabilities. BMC Psychiatry. (2020) 20:1–14. doi: 10.1186/s12888-020-02785-9

PubMed Abstract | CrossRef Full Text | Google Scholar

38. Stewart SL, Celebre A, Hirdes JP, Poss JW. Risk of suicide and self-harm in kids: the development of an algorithm to identify high-risk individuals within the children's mental health system. Child Psychiatry Hum Dev. (2020) 51:913–24. doi: 10.1007/s10578-020-00968-9

PubMed Abstract | CrossRef Full Text | Google Scholar

39. Stewart SL, Celebre A, Hirdes JP, Poss JW. Risk of Injury to Others: The Development of an Algorithm to Identify Children and Youth at High Risk for Aggressive Behavior (2020).

Google Scholar

40. Stewart SL, Hamza CA. The child and youth mental health assessment (ChYMH): An examination of the psychometric properties of an integrated assessment developed for clinically referred children and youth. BMC Health Serv Res. (2017) 17:82. doi: 10.1186/s12913-016-1970-9

PubMed Abstract | CrossRef Full Text | Google Scholar

41. Stewart SL, Morris JN, Asare-Bediako YA, Toohey A. Examining the structure of a new pediatric measure of functional independence using the interRAI child and youth mental health assessment system. Dev Neurorehabil. (2019) 23:526–33. doi: 10.1080/17518423.2019.1698070

PubMed Abstract | CrossRef Full Text | Google Scholar

42. Stewart SL, Poss JW, Thornley E, Hirdes JP. Resource intensity for children and youth: the development of an algorithm to identify high service users in children's mental health. Health Services Insights. (2019) 12:930. doi: 10.1177/1178632919827930

PubMed Abstract | CrossRef Full Text | Google Scholar

43. Stewart SL, Klassen J, Tohvner GC. Validation of the interRAI risk of school disruption scale: a measurement of school disengagement and disruption. Pers Individ Dif. (2016) 101:518. doi: 10.1016/j.paid.2016.05.311

CrossRef Full Text | Google Scholar

44. Dreyer K, Williamson RA, Hargreaves DS, Rosen R, Deeny SR. Associations between parental mental health and other family factors and healthcare utilisation among children and young people: a retrospective, cross-sectional study of linked healthcare data. BMJ Paediatr Open. (2018) 2:266. doi: 10.1136/bmjpo-2018-000266

PubMed Abstract | CrossRef Full Text | Google Scholar

45. Flisher AJ, Kramer RA, Grosser RC, Alegria M, Bird HR, Bourdon KH, et al. Correlates of unmet need for mental health services by children and adolescents. Psychol Med. (1997) 27:1145–54. doi: 10.1017/S0033291797005412

PubMed Abstract | CrossRef Full Text | Google Scholar

46. Olfson M, Marcus SC, Druss B, Pincus HA, Weissman MM. Parental depression, child mental health problems, and health care utilization. Medical Care. (2003) 41:716–21. doi: 10.1097/01.MLR.0000064642.41278.48

PubMed Abstract | CrossRef Full Text | Google Scholar

47. Cornelius JR, Pringle J, Jernigan J, Kirisci L, Clark DB. Correlates of mental health service utilization and unmet need among a sample of male adolescents. Addict Behav. (2001) 26:11–9. doi: 10.1016/S0306-4603(00)00075-7

PubMed Abstract | CrossRef Full Text | Google Scholar

48. Gulliver A, Griffiths KM, Christensen H. Perceived barriers and facilitators to mental health help-seeking in young people: a systematic review. BMC Psychiatry. (2010) 10:1–9. doi: 10.1186/1471-244X-10-113

PubMed Abstract | CrossRef Full Text | Google Scholar

49. Corrigan P. How stigma interferes with mental health care. Am Psychol. (2004) 59:614. doi: 10.1037/0003-066X.59.7.614

PubMed Abstract | CrossRef Full Text | Google Scholar

50. Bergeron E, Poirier LR, Fournier L, Roberge P, Barrette G. Determinants of service use among young Canadians with mental disorders. Can J Psychiatry. (2005) 50:629–36. doi: 10.1177/070674370505001009

PubMed Abstract | CrossRef Full Text | Google Scholar

51. Eklund K, Renshaw TL, Dowdy E, Jimerson SR, Hart SR, Jones CN, et al. Early identification of behavioral and emotional problems in youth: universal screening versus teacher-referral identification. The Calif Sch Psychol. (2009) 14:89–95. doi: 10.1007/BF03340954

CrossRef Full Text | Google Scholar

52. Splett JW, Garzona M, Gibson N, Wojtalewicz D, Raborn A, Reinke WM. Teacher recognition, concern, and referral of children's internalizing and externalizing behavior problems. School Ment Health. (2019) 11:228–39. doi: 10.1007/s12310-018-09303-z

CrossRef Full Text | Google Scholar

53. Hoff ER, Muehlenkamp JJ. Nonsuicidal self-injury in college students: the role of perfectionism and rumination. Suicide Life Threat Behav. (2009) 39:576–87. doi: 10.1521/suli.2009.39.6.576

PubMed Abstract | CrossRef Full Text | Google Scholar

54. Klassen J. Students adrift: An examination of school disengagement among clinically referred children and youth. (London: Doctoral dissertation, Western University), (Electronic Thesis and Dissertation Repository) (2021).

Google Scholar

55. Levine A, Clemenza K, Rynn M, Lieberman J. Evidence for the risks and consequences of adolescent cannabis exposure. J Am Acad Child Adolesc Psychiatry. (2017) 56:214–25. doi: 10.1016/j.jaac.2016.12.014

PubMed Abstract | CrossRef Full Text | Google Scholar

56. Lubman DI, Cheetham A, Yücel M. Cannabis and adolescent brain development. Pharmacol Therap. (2015) 148:1–16. doi: 10.1016/j.pharmthera.2014.11.009

PubMed Abstract | CrossRef Full Text | Google Scholar

57. Tobon JI, Reid GJ, Brown JB. Continuity of care in children's mental health: parent, youth and provider perspectives. Community Ment Health J. (2015) 51:921–30. doi: 10.1007/s10597-015-9873-5

PubMed Abstract | CrossRef Full Text | Google Scholar