- 1Department of Psychiatry and Behavioral Sciences, Duke Center for Autism and Brain Development, Duke University, Durham, NC, United States
- 2Department of Psychiatric and Behavioral Sciences, Duke University, Durham, NC, United States
- 3Division of Behavioral Medicine and Clinical Psychology, Cincinnati Children’s Hospital Medical Center, Cincinnati, OH, United States
- 4Department of Pediatrics, University of Cincinnati College of Medicine, Cincinnati, OH, United States
- 5Neurology Division, Cincinnati Children’s Hospital Medical Center, Cincinnati, OH, United States
Introduction: Autistic children and adolescents frequently experience emotion dysregulation, or difficulties with appropriately modifying their emotional reactions. Caregivers of autistic teens frequently seek psychotherapy support for navigating challenges associated with emotion dysregulation. During the COVID-19 pandemic, access to clinical services became limited, with interventions halted or transitioned into a telehealth format.
Methods: This study evaluates the feasibility, acceptability, and initial efficacy of a telehealth adaptation to an existing intervention for emotion dysregulation for children and teens with autism, Regulating Together. A within-subjects trial was conducted for Child (ages 8-12) and Teen groups (ages 13-18). The trial consisted of a 5-week-control lead-in period, a 5-week-intervention, and 5-and 10-weeks-post-intervention follow-ups.
Results: Twenty-eight youth with ASD + ED (n=13 Child and n=15 Teens, 71% male) participated. We observed a 93% retention rate across both groups. Improvements were found in reactivity, irritability, emotion and behavioral regulation, and flexibility immediately post-intervention and 10-weeks post-intervention in both groups. Additional improvements in dysphoria, cognitive regulation, and emotional control were observed in teens.
Discussion: Our results suggest promising improvements in ED through telehealth delivery of an emotion regulation intervention in autistic children and adolescents, along with possible improvements in accessibility of this intervention.
Introduction
Autistic children and adolescents frequently engage in interventions for behavioral challenges, such as tantrums, self- and other-directed aggression (1) and emotional difficulties, such as anxiety and depression. The COVID-19 pandemic impacted children’s and adolescent’s mental and behavioral health in a number of ways, including increased depression and anxiety, regardless of pre-existing psychiatric diagnoses (2). In addition, behavioral therapies during this time were often halted thus leaving these behavioral challenges unaddressed or delivered via telehealth, which at the time had not been thoroughly assessed for efficacy. Therefore, examining the feasibility, acceptability, and initial efficacy of emotion regulation therapies delivered via telehealth during this the COVID-19 pandemic may provide useful information for the continued use of telehealth as a means of improving emotion regulation in autistic children and adolescents.
Emotion dysregulation (ED) refers to the difficulties with modulating a response to expressing emotions in a contextually appropriate manner (3). ED can be characterized by increased reactivity, irritability, and challenges with calming oneself after becoming upset. ED is often observed in many psychiatric conditions like anxiety disorders (4) and depression (5). It has been hypothesized that the rigidity and emotional intensity that occurs in ED could be a contributor to the difficulties that autistic individuals face, such as disrupted social interactions and opportunities (3).
The COVID-19 pandemic and nation-wide lockdown disrupted everyone’s lifestyle in a variety of ways. These challenges disproportionally affected children with ASD, with one study finding up to 59% of autistic children (age 2-1 M=9.12) showed worsened psychiatric problems or new psychiatric diagnosis according to parent report in May of 2020 (6). For many families, interventions and therapies and stable social environments like school and extracurricular activities were cancelled. These disruptions could have potential long-term effects on a child’s development (7).
As a result of the COVID-19 pandemic, healthcare has adapted to include more telehealth options. These opportunities not only benefit individuals who cannot attend in-person appointments due to health concerns, but they also make healthcare more accessible, such as to those in rural areas where local resources are limited (8). Evidence suggests that the transition to telehealth at this time improved patient attendance and resulted in improvement in mental health symptoms in a predominantly low-income and racially diverse population (9). Similar success has been observed in telehealth for rural families of autistic children. In a study of a parent-mediated intervention (COMPASS for Hope) administered in a telehealth setting for families in rural and urban areas, the researchers found higher parent competence was associated with fewer child behavioral problems (10). This was similar to the results of the same intervention in face-to-face environments (10). This suggests that this therapy and possibly others could be effective across platforms (10).
In order to address the need for autism specific ED interventions, Shaffer et al. (11) developed Regulating Together (RT), an outpatient intervention training both autistic individuals and their caregivers on emotion regulation strategies. The curriculum was developed for two development age groups, children (8-12 years old) and teens (13-18 years old). In the pilot within subjects trial, RT was found to improve reactivity, emotion regulation knowledge, and flexibility across both age groups both immediately post intervention and up to 10 weeks after the intervention concluded (11). However, due to the onset of the COVID-19 pandemic, ongoing trials for RT transitioned to a telehealth format.
The current study aims to evaluate the feasibility, acceptability, and initial efficacy of RT in a telehealth modality for improving emotion regulation in autistic youths. Due to the previous success of RT and the promising results of telehealth interventions for individuals with ASD, we hypothesize that the telehealth delivery of RT will improve emotion regulation, as seen by increased flexibility as well as decreased reactivity, emotional dysphoria, and irritability. We also hypothesize that participants would show overall improvements in youth functioning according to the caregiver report.
Methods
Participants
Twenty-eight autistic participants between the ages of 8-18 years participated in an intervention study which utilized a within-subjects design. The intervention enrollment consisted of two Child groups (n=13) and two Teen groups (n=15). Demographics are presented in Table 1.
Participants were recruited from multiple sources, including internal hospital clinics and community partners (e.g., schools, local autism agencies). Due to the telehealth format of the intervention, youth were recruited nationally through sharing the flyer with autism clinics outside our hospital. Consistent with prior RT groups (11), youth were eligible for study if they were between the ages 8–18 years, had a diagnosis of autism documented by a provider, had an IQ > 65, had their primary spoken language as English and spoke with functional verbal communication, commensurate with appropriateness to receive an ADOS-2 Module 3 or 4 (12), were willing to take a break from or keep other interventions stable, keep medication stable, and have at least one caregiver willing to participate in the intervention. A diagnosis of autism was confirmed through a medical and behavioral history interview and expert clinical diagnosis. Due to the COVID-19 pandemic, adaptations to the inclusion criteria included: participants who had any cognitive testing and/or an ADOS-2 completed within the past year and met diagnostic criteria for autism. Emotion dysregulation inclusion criteria were based on prior scores established by our group (20) the Aberrant Behavior Checklist, Second Edition (ABC-2; (13) was used, such that youth were eligible if a) they had scores of ≥ 10 on the irritability or hyperactivity subscales. To ensure safety for all study participants, any aggression toward other youth that resulted in injury in the past 2 weeks resulted in exclusion from the study. Of the children screened, there were ultimately two children who did not meet the inclusion criteria, one from the child group due to low ABC score and one from the teen group due to low IQ score (not included in the enrollment numbers above).
Intervention
The intervention study protocol followed prior RT groups (11), such that all study participants completed a 5-week control lead-in period (T1-T5), a 5-week active intervention period (T5-T10) and follow up assessments at 5-weeks (T15) and 10-weeks (T20) post intervention completion. IRB approval was obtained from Cincinnati Children’s Hospital Medical Center, and all participants provided consent or assent, with caregivers providing consent for all participant younger than 18 years. Families received compensation commensurate with the time commitment for each study visit. The groups occurred after school in the early evening (between 4-6:30 EST), although it is important to note that youth were recruited from across the United States and resided in different time zones. Families adjusted their personal schedules to attend the groups as needed. The Child groups occurred in 2020 from June-July for the first round and October-November for the second round. Teen groups occurred in August-September 2020 and February-March 2021. The majority of youth across the second round of child and both teen rounds were back attending in person school at the time of the study completion.
The telehealth RT program was offered in two different formats depending on the child’s age. For the Child group, caregivers participated in a live, telehealth group sessions receiving the caregiver material twice weekly for 80 minutes across 5 weeks for a total of 10 sessions. They then facilitated recorded videos of the intervention one-on-one with their children before the next session. The video recordings included PowerPoint presentations with voice over by a psychologist, teaching the material in the same way as in person, with pauses for the caregivers to complete worksheets or discuss the topic further with their child. Each video took between 35-60 minutes for families to complete depending on how much discussion they had or how long the activities took the child to complete. Children and caregivers received workbooks in the mail before the start of the group with all the materials they needed over the course of the curriculum. The videos were posted after each caregiver group on the Play Posit platform, which tracked completion of viewing of the video. The children joined the last 10-15 minutes of each group to practice relaxation and briefly review the material. The Teen version included 60-minute live, telehealth caregiver group sessions followed by 60-minute live, telehealth adolescent group sessions. Caregivers were nearby during live adolescent sessions when needed to help ensure attention, but privacy was maintained as much as possible. They met twice weekly for 5 weeks (10 sessions). Teens and their caregivers received workbooks in the mail prior to the start of group with all materials included for the curriculum. PowerPoint presentations were used by the leader to help the teens focus and process the material and to match the in-person format, which delivers the intervention verbally with paired visuals. There was one psychologist who led both the caregiver and teen groups. A graduate student served as an assistant in the Teen groups. Details on the intervention components of RT are available in Shaffer et al. (11). Differences between the in-person and telehealth modalities are listed in Table 2.
Feasibility and acceptability
Feasibility was measured via attendance and retention across the study. Acceptability was measured via youth self-ratings of how much they learned and how they felt in each session. Self-ratings of learning were scored on a 5-point Likert scale from 1 = Nothing to 5 = Very Much. Self-ratings of feelings were also measures on a 5-point Likert scale from 1 = Calm and in Control to 5 = Out of Control. Self-ratings of feelings were completed after the second session for teens and fourth session for children, concordant with in session teaching of the rating scale.
Caregiver satisfaction
Caregivers were asked to report their satisfaction with the intervention by answering five questions on a 5-point Likert scale anchors for each are included by each question. These questions asked caregivers about how much they learned (5 = Learned a great deal, 1 = Learned nothing), how satisfied they were with the material (5 = Very Satisfied, 1 = Very Dissatisfied), how confident they feel in managing their child’s behaviors (5 = Very Confident, 1 = Very Unconfident), how well they can implement the skills (5 = Very Well, 1 = Not at all), and how well their child is implementing the skills taught in the group (5 = Very Well, 1 = Not at all).
Measures
A comprehensive assessment battery was collected to examine the efficacy of RT delivered through telehealth. Demographics of study participants and their families were collected through interviews and surveys. All measures were used in the primary RT evaluation (11) and are described below. The measures were completed during a telehealth meeting with the study coordinator or clinician on screen with the family to provide instructions, answer questions, and make sure the same respondent completed the measures each time. Links were sent to families ahead of the appointment so they could complete the measures on their own screen. If they did not have access to a screen and struggled with completion on their phone, the coordinator could read the questions and mark answers for the family. This was a rare occurrence and the majority of families completed measures on their own screens.
Vineland scales of adaptive behavior, third edition (Vineland-3)
The Vineland Scales of Adaptive Behavior, Third Edition (Vineland-3) is a standardized measure of adaptive behavior that assesses skills across the following domains: Communication, Daily Living Skills, and Socialization domains. It also provides an overall Adaptive Behavior Composite score. The Vineland-3 was used at screening to characterize the overall functioning of participants. Caregivers completed the Parent form.
Primary and secondary outcome measures
The aberrant behavior checklist - irritability
The Aberrant Behavior Checklist [ABC-2 (13)] is a caregiver-report questionnaire comprised of 58 items. There are five subscales of the ABC-2: Irritability, Social Withdrawal/Lethargy, Stereotypy, Hyperactivity, and Inappropriate Speech. Caregivers rate the severity of behaviors on a 4-point Likert scale ranging from 0 = Not a Problem to 3 = the Problem is Severe in degree. The ABC-2 was collected for both study inclusion and a primary study outcome.
The emotion dysregulation inventory
The Emotion Dysregulation Inventory [EDI (14)] is a caregiver report questionnaire that consists of two scales: Reactivity (EDI-R), and Dysphoria (EDI-D). The EDI-R subscale was collected to serve as the primary outcome measure for this study.
The clinical global impressions scale-improvement
The Clinician Global Impressions - Improvement [CGI-I; (15)] is a clinician-rated measure that assesses response to intervention. This measure was completed by an independent and trained clinician at T5, T10, T15 and T20. The CGI-I is scored on a 7-point scale ranging from 1 = Very Much Improved to 7 = Very Much Worse. CGI-S, but not CGI-I, was completed at T1. CGI-I was not completed at T1 due to it being an improvement measure based on ratings and clinical information gathered for CGI-S. Consistent with our published pilot of RT in person (11), the CGI-I clinician (LS) was a psychologist who completed reliability training with gold standard vignettes. She was not involved in the treatment and was aware that this was a within-subjects trial. The CGI-I rating was completed per standard administration with a parent interview regarding global changes observed in different environments with specific emphasis on changes in emotion dysregulation (e.g., changes in severity, duration, and frequency of outbursts; changes in handling triggers).
Flexibility scale
The Flexibility Scale [FS (16)] is a caregiver report measure that assesses flexibility in autistic youth. Caregivers score responses on a 4-point Likert scale ranging from 0 = No to 3 = Always. This measure was collected as a secondary outcome measure. Subscales on this measure include: Social Flexibility, Transitions/Change, Generativity, and Total.
Behavioral rating inventory of executive functioning
The Behavioral Rating Inventory of Executive Functioning [BRIEF-2 (17)] is caregiver-report measure consisting of 86 items. Caregivers rate their child’s behavior on a 3-point Likert scale ranging from 1 = Never to 3 = Often. Raw scores are then converted to T-scores for the individual scales and standard scores for the Indexes, which include: Behavior Regulation Index (BRI), Cognitive Regulation Index (CRI), Emotional Regulation Index (ERI), and an overall Global Executive Composite (GEC). The ERI was selected as a secondary outcome measure for the present study.
Statistical analysis
Primary analysis
Repeated measures ANOVA was utilized to analyze our outcome variables involving data from the 5-week control period (T1-T5), through the intervention period (T5-T10), and the final post intervention outcome period, (T5-T20). Outcome measures included the EDI-R and EDI-D, ABC-2, BRIEF-2, and the Flexibility Scale. All participants (Child & Teen) were analyzed together for the primary analyses. Due to the pilot nature of this study, corrections for multiple comparisons were not conducted. Generalized linear mixed models were examined with various distributions and within subject covariance structures. The models chosen exhibited reasonable fit using the corrected Akaike Information Criterion as well as displaying good profiles of the studentized residuals.
Secondary analysis
Individual timepoints were examined as a secondary analysis.
Demographic analyses
Means and standard deviations were calculated for demographic data including: age, gender, parental education, race, ethnicity, and co-occurring psychiatric diagnoses.
Results
Feasibility
Out of all participants enrolled, one child dropped out of the study during the control lead-in period and one teen dropped during the intervention period due to difficulty paying attention in the telehealth format. We thus demonstrate a retention rate of 93% over the course of the entire study for both the Child and Teen groups. For the intervention phase specifically, there was a 96% retention rate. For the Child group, caregiver attendance to the live sessions was 94% and completion of the videos for the children (as measured in Play Posit platform) was 98%. For the Teen group, there was a 94% attendance rate for caregivers and teens. Compared to our in-person RT data, telehealth RT had better retention (93%>87%) and attendance (94%>82%). The telehealth format appeared to be more feasible and accessible for families compared to in person attendance, even when in person feasibility was acceptable.
Acceptability
In the Child group, participants rated that they learned the most in Sessions 7 (Positive and Negative Thoughts, M = 4.5), 2 (Relaxation, M = 4.2), and 8 (Cognitive Flexibility, M = 4.25). Overall, the children rated themselves calm at the end of viewing the videos (M = 1.25-1.8) (as shown in Figure 1A). For the Teens, they rated that they learned the most in Session 1 (Relaxation, M= 4), Session 4 (Distress Tolerance, M = 4), and Session 5 (Problem Sizes & Positive Thoughts, M = 4). Teens similarly rated themselves as having low levels of arousal at the end of each group (M = 1.4-1.9) with the exception of Session 2 when they learned the 5-point scale for the first time (as shown in Figure 1B). Several teens rated themselves as a 5, which was not consistent with their presentation in group, and it is possible they misunderstood the direction of the scale. For all future sessions, the anchors of the scale were clearly labeled at the bottom.
Figure 1. (A, B) These figures depict Child and Teen self-rating of their learning and emotion across sessions 1-9. Emotion ratings began in Session 4 for the Child Group and Session 2 for the Teen Group.
Caregiver satisfaction
Immediately following the group, caregivers reported high levels of satisfaction with the telehealth format of RT. In particular, caregivers reported that they were satisfied with the group (M = 4.65, SD = 0.49), that they learned skills from the group (M = 4.38, SD = 0.57), that they feel confident managing their child’s behavior (M = 3.69, SD = 1.01), and that they think they are implementing the skills well (M = 3.58, SD = 0.76). Parents reported the least amount of confidence in their child implementing the skills (M = 2.96, SD = 0.66).
Adverse events
There were no reported behavior changes for youth in the Child or Teen samples and there were no inpatient hospitalizations over the course of the study for participants. There were no reported instances of emotional outbursts during the telehealth sessions.
Primary outcome measures
Results comparing individual time periods by age groups are presented in Table 3. Results from each age group separately are presented in Table 4.
Emotion dysregulation inventory reactivity and dysphoria
In the Child group for the EDI-R, a statistically significant difference was observed by time point (F(4,40.67) = 3.45, p = 0.016). No significant change in scores was observed during the 5-week control lead-in period (p = 0.846, d = 0.05). Improvement on EDI-R from the start of the intervention (T5) to post-intervention (T10) was observed (p = 0.009, d = 0.86). Significant improvement on the EDI-R also was found from intervention start to both 5 weeks (T15) (p = 0.007, d = 0.99) and at the 10-week follow-up (T20) for the child group (p = 0.005, d = 1.13) (Figure 2).
Figure 2. This figure depicts the significant difference on EDI-R across time points (T1, T5, T10, T15, and T20) in Child and Teen groups. Stars depict significance at the 0.05 level.
In the Teen group, a statistically significant difference was observed in EDI-R by time point (F(4,35.24) = 5.07, p = 0.0025). No significant change in score during the 5-week control lead-in period (T1-T5) (p = 0.950, d = 0.01) was observed. Improvement on the EDI-R from intervention start (T5) to post-intervention (T10) was observed (p = 0.023, d = 0.45). There was not a significant difference from intervention start to 5 Weeks post-intervention (T15)(p = 0.092, d = 0.38) but there was a significant reduction in EDI-R scores between intervention start and 10 weeks post-intervention (T20)(p < 0.001, d= 0.84) (as shown in Figure 3).
Figure 3. This figure depicts the significant difference on EDI-D across time points (T1, T5, T10, T15, and T20) in Child and Teen groups. Stars depict significance at the 0.05 level.
For the Child group there were not significant differences in EDI-D (F(4,33.01) = 4.17, p = 0.0077) between any of the time points. However, in the Teen group (F(4,41.46) = 2.05, p = 0.1004) there were significant differences between the intervention start (T5) and post-intervention (T10) (p = 0.004, d = 0.78), 5 weeks post-intervention (T15) (p = 0.008, d = 0.24), and 10 weeks post-intervention (T20) (p = 0.001, d = 0.55), such that teens experienced a decrease in dysphoria subsequent to completing the group. There was no significant change in score between the lead-in period (T1-T5) for the teens (p = 0.385, d = 0.47) (as shown in Figure 3).
ABC irritability subscale
For the Child group we found a statistically significant difference in the ABC Irritability subscale by time point (F(4,34.97) = 4.22, p = 0.007). No change in scores during the 5-week control lead-in period (p = 0.374, d = 0.28) were observed. Improvement in the ABC Irritability subscale from intervention start (T5) to post-intervention (T10) was observed (p = 0.003, d = 0.70), as was significant reduction in irritability from intervention start to both the 5 week (T15) (p = 0.006, d = 0.85) and 10 week follow-up (T20) (p=0.003, d = 1.20) (shown in Figure 4).
Figure 4. This figure depicts the significant difference on ABC Irritability subscale across time points (T1, T5, T10, T15, and T20) in Child and Teen groups. Stars depict significance at the 0.05 level.
For the Teen group we found a statistically significant difference in the ABC Irritability subscale by time point (F(4,35.45) = 5.90, p = 0.001). Significant improvement, or change in score, during the 5-week control lead-in period (T1-T5) was observed (p = 0.009, d = 0.47). There was also improvement on the ABC Irritability subscale from intervention start (T5) to post-intervention (T10) (p = 0.009, d = 0.41). There was not a significant difference from intervention start to 5 Weeks post-intervention (T15) (p = 0.051, d = 0.36) but there was a significant reduction in irritability observed between intervention start and 10 weeks post-intervention (T20) (p =0.01, d = 0.79) (as shown in Figure 4).
Secondary outcome measures
BRIEF
For the Child group, statistically significant changes were observed by time point on the BRIEF ERI (F(4, 28.68) = 3.70, p=0.015) and BRI (F(4, 31.07) = 4.19, p=0.0079), and the GEC (F(4, 38.7) = 3.01, p = 0.0294), such that children showed fewer emotion regulation, cognitive regulation challenges after completing the group, and better general executive functioning skills. No significant changes were observed by timepoint in the ECI (F(4,31.18) = 2.20, p = 0.0918) or CRI in the Child group (F(4,38.46) = 2.30, p = 0.0759).
For the Teen group, statistically significant changes were demonstrated by time point on the ERI (F(4, 38.57) = 9.69, p < 0.0001), the BRI (F(4, 37.69) = 12.34, p < 0.0001), the ECI (F(4,39.24) = 10.27, p < 0.0001), the CRI (F(4, 37.27) = 5.17, p = 0.002), and the GEC (F(4, 37.95) = 9.42, p < 0.0001). This indicates that teens showed fewer emotion regulation, behavior regulation, emotional control, and cognitive regulation challenges after completing the group, and better general executive functioning skills.
Further analyses are presented in Table 3 and change post-intervention are shown in Figure 5.
Figure 5. This figure depicts the significant difference on BRIEF- Emotion Regulation Index (ERI) across time points (T1, T5, T10, T15, and T20) in Child and Teen groups. Stars depict significance at the 0.05 level.
Flexibility scale
In the Child group, a statistically significant change by time point was observed on the FS Total point (F(4,33.51) = 4.34, p = 0.0062), shown in Figure 6. Statistically significant changes by time point were also found on the following subscales: Social Flexibility (F(4,29.00) = 2.97, p = 0.0357), Transitions/Change (F(4,33.32) = 7.76, p = 0.002), and Generativity (F(4,44.17) = 3.18, p = 0.0222), such that children showed better social flexibility, better adaptability to transitions and changes, and better ability to generate ideas after completing the group.
Figure 6. This figure depicts the significant difference on Flexibility-Total across time points (T1, T5, T10, T15, and T20) in Child and Teen groups. Stars depict significance at the 0.05 level.
In the Teen group, a statistically significant change in the FS Total score was observed by time point (F(4,37.81) = 14.53, p= 0.0001), shown in Figure 6). Significant changes by time point were also observed Social Flexibility (F(4,38.86) = 2.84, p = 0.0372) and Transitions/Change (F(4,34.46) = 13.41, p < 0.0001) subscales, such that teens demonstrated better social flexibility and better adaptability to transitions after completing the group. However, in the Teen group the Generativity subscale presented no significant changes (F(4,49.99) = 1.23, p = 0.3111). Further analyses are presented in Table 3.
Clinical global impression – improvement
On the CGI-I for the Child group, statistically significant improvement was observed by time point (F(3,28.62) = 15.54, p < 0.0001). On the CGI-I for the Teen group there was significant improvement by time point (F(3,22.89) = 24.60, p<0.0001). The most significant improvement was observed between the beginning to the end of the intervention T5 and T10, as well as with the two follow-up time points (T5 and T15, and T5 and T20) for both groups. Further analyses are presented in Table 3.
Discussion
For families and individuals with ASD or other psychiatric conditions, telehealth options for interventions can increase ease and access (8). When RT was originally tested in person, it demonstrated significant improvement in emotion regulation based on parent report and reduced psychiatric hospitalization rates (11). Overall, children and teens participating in the RT telehealth format demonstrated similar significant improvements in their emotion regulation and reductions in irritability.
Specifically, in both age groups we observed statistically significant improvement on both our primary measures of ED, suggesting RT delivered through telehealth showed preliminary efficacy at reducing reactivity and irritability in autistic youth. Notably, for both of these primary outcome measures there was stability in the lead in period which suggests the improvement is in response to the intervention and not a result of the passage of time. Also, the continued improvement at the 5- and 10-week follow-up suggests continued benefit, or maintenance of positive effects, from the intervention across time. Additionally, the Teen group showed significant improvement on the dysphoria scale of the EDI, a finding that was not observed in the Child group. One potential explanation for this difference is the already lower EDI-D ratings for the Child group compared to the Teen group. Additionally, because the two groups differed slightly in material, the Teen intervention may have had a bigger impact on emotional dysphoria than the Child intervention. Both age groups also showed improvements on the CGI-I suggesting not only improvement based on parent report but also clinician ratings.
We also saw significant changes in executive functioning as measured by the BRIEF for both age groups. For the Child group, significant improvement in emotion regulation, behavior regulation, and general executive skills were reported immediately post intervention and at the 10-week follow-up. Similar results also occurred in the Teen group, with additional improvements in cognitive regulation and emotional control noted both immediately after the completion of the intervention as well as weeks after completing the group. In terms of flexibility, parents of the child group noted significant improvement overall and on two subscales. While there was a significant difference in the lead-in period on the Transitions subscale this difference was negative suggesting a worsening of transitional flexibility prior to intervention, making this improvement more remarkable. For teens, caregivers noted improvements in all subscales aside from generativity. Together, this suggests that telehealth RT may not only help reduce core ED symptoms, but also broader aspects known to be related to ED.
We also examined differences between the two groups. Across several measures, teens showed greater improvements compared to children. These improvements were shown on the dysphoria subscale of the EDI and on the Emotional Control and Cognitive Regulation subscales of the BRIEF. These results should be viewed in light of the in-person intervention results, in which teens did not show these same gains. Evidence suggests that resistance to attending sessions is particularly tenuous for adolescents, which may impede participation in intervention (18). Thus, our findings of good attendance rates and significant emotion regulation improvement in this population indicate that RT may be especially beneficial for adolescents when it is delivered through telehealth.
Limitations
As discussed in the original study (11), the primary limitation of the current study is the within-subject study design as opposed to a RCT. Although an RCT would be ideal to test the effectiveness of an intervention this study design is an important step to evaluate initial efficacy of this intervention especially in the telehealth format. Telehealth interventions are an emerging area for autistic youths, and thus this examination still provides an important contribution to the field (19). Another previously discussed limitation is the primary use of caregiver report to measure outcomes. Future research could include child report as well as other quality-of-life measures to get a more holistic evaluation of intervention’s effectiveness. The findings should also be considered in light of global events occurring at the time, namely the COVID-19 pandemic. Contemporaneous research suggests that autistic youths experienced even greater psychological distress as a result of the pandemic (6), and therefore the availability of an intervention may have been particularly helpful for these participants. The rapid adjustment to telehealth necessitated a number of changes to our typical protocol, including relaxed inclusion criteria. Further, children were experiencing a global crisis that may have had an impact on their emotion regulation skills regardless of an intervention. An additional limitation includes the lack of diversity in the study sample. Although national recruitment was completed, the sample was primarily non-Hispanic, white families with higher socioeconomic status and education levels. Future studies should focus on more diverse recruitment as well as facilitators and barriers to participation for diverse families and our team is currently conducting a trial with a focus on diverse recruitment to Regulating Together (ClinicalTrials.gov ID NCT05803369). Finally, again because of the nature of the COVID-19 pandemic, typical phenotyping measures were not available, including cognitive scores and autism diagnostic measures. It will be helpful for future studies to provide thorough phenotyping in order to better understand response to the intervention.
Conclusion
Emotion regulation research is critical due to its perceived connection between behavioral concerns, social adaptability and overall well-being in individuals with ASD. Additionally, creating high-quality, effective telehealth interventions for autistic youths and their families is necessary to ensure mental health care is equitable and accessible. The results from this study support our hypotheses that the telehealth format of Regulating Together would improve emotion regulation and overall function as observed in both age groups, with a particular benefit noted for adolescents. These findings are very promising for individuals and families with ASD and ED especially those that require telehealth settings in order to receive intervention, thereby potentially improving access to care, and require further examination with a larger, more diverse sample.
Data availability statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Ethics statement
This study involving humans was approved by Cincinnati Children’s Hospital IRB. The studies were conducted in accordance with the local legislation and institutional requirements. Written informed consent for participation in this study was provided by the participants’ legal guardians/next of kin and written assent was provided for youth ages 11 and older.
Author contributions
MC: Formal analysis, Methodology, Supervision, Writing – original draft, Writing – review & editing. MW: Formal analysis, Visualization, Writing – original draft, Writing – review & editing. LS: Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Writing – review & editing. DR: Conceptualization, Data curation, Investigation, Methodology, Writing – review & editing. PH: Formal analysis, Validation, Writing – original draft, Writing – review & editing. RS: Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Validation, Writing – original draft, Writing – review & editing.
Funding
The author(s) declare financial support was received for the research, authorship, and/or publication of this article. This study was funded by the Cincinnati Children’s Hospital Place Outcomes Award.
Acknowledgments
Thank you to all of the families who have participated in the Regulating Together telehealth pilot trial. Without your commitment to your children, we would not have been able to do this research. Thank you to the students and coordinators who assisted with this project, especially to Shelley Randall and Mya Jones and to our telehealth department at Cincinnati Children’s Hospital who assisted with the rapid transition to telehealth delivery during the pandemic.
Conflict of interest
Authors RS and LS receive compensation for Regulating Together intervention training to providers.
The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
1. Samson AC, Hardan AY, Podell RW, Phillips JM, Gross JJ. Emotion regulation in children and adolescents with autism spectrum disorder. Autism Res. (2015) 8:9–18. doi: 10.1002/aur.1387
2. Marchi J, Johansson N, Sarkadi A, Warner G. The impact of the COVID-19 pandemic and societal infection control measures on children and adolescents' mental health: A scoping review. Front Psychiatry. (2021) 12:711791. doi: 10.3389/fpsyt.2021.711791
3. Cai RY, Hardan AY, Phillips JM, Frazier TW, Uljarević M. Brief report: emotion regulation influences on internalizing and externalizing symptoms across the normative-clinical continuum. Front Psychiatry. (2021) 1079. doi: 10.3389/fpsyt.2021.693570
4. Mennin DS. Emotion regulation therapy: An integrative approach to intervention-resistant anxiety disorders. J Contemp Psychother. (2006) 36:95–105. doi: 10.1007/s10879-006-9012-2
5. Kumar S, Feldman G, Hayes A. Changes in mindfulness and emotion regulation in an exposure-based cognitive therapy for depression. Cogn Ther Res. (2008) 32:734–44. doi: 10.1007/s10608-008-9190-1
6. Vasa RA, Singh V, Holingue C, Kalb LG, Jang Y, Keefer A. Psychiatric problems during the COVID-19 pandemic in children with autism spectrum disorder. Autism Res. (2021) 14:2113–9. doi: 10.1002/aur.v14.10
7. Bellomo TR, Prasad S, Munzer T, Laventhal N. The impact of the COVID-19 pandemic on children with autism spectrum disorders. J Pediatr Rehabil Med. (2020) 13:349–54. doi: 10.3233/PRM-200740
8. Hepburn SL, Blakeley-Smith A, Wolff B, Reaven JA. Telehealth delivery of cognitive-behavioral intervention to youth with autism spectrum disorder and anxiety: A pilot study. Autism. (2016) 20:207–18. doi: 10.1177/1362361315575164
9. Frank HE, Grumbach NM, Conrad SM, Wheeler J, Wolff J. Mental health services in primary care: Evidence for the feasibility of telehealth during the COVID-19 pandemic. J Affect Disord Rep. (2021) 5:100146. doi: 10.1016/j.jadr.2021.100146
10. Dahiya AV, Ruble L, Kuravackel G, Scarpa A. Efficacy of a telehealth parent training intervention for children with autism spectrum disorder: Rural versus urban areas. Evidence-Based Pract Child Adolesc Ment Health. (2022) 7:41–55. doi: 10.1080/23794925.2021.1941431
11. Shaffer RC, Schmitt LM, Reisinger DL, Coffman M, Horn P, Goodwin MS, et al. Regulating together: Emotion dysregulation group intervention for ASD youth and their caregivers. J Autism Dev Disord. (2023) 53:1942–62. doi: 10.1007/s10803-022-05461-x
12. Lord C, Luyster RJ, Gotham K, Gutherie W. Autism Diagnostic and Observation Schedule. 2nd ed. Torrance, CA: ADOS-2 (2012).
14. Mazefsky CA, Yu L, White SW, Siegel M, Pilkonis PA. The emotion dysregulation inventory: Psychometric properties and item response theory calibration in an autism spectrum disorder sample. Autism Res. (2018) 11:928–41. doi: 10.1002/aur.2018.11.issue-6
15. Guy W. ECDEU assessment manual for psychopharmacology. Washington, DC: US Department of Health, Education, and Welfare, Public Health Service (1976).
16. Strang JF, Anthony LG, Yerys BE, Hardy KK, Wallace GL, Armour AC, et al. The flexibility scale: Development and preliminary validation of a cognitive flexibility measure in children with autism spectrum disorders. J Autism Dev Disord. (2017) 47:2502–18. doi: 10.1007/s10803-017-3152-y
17. Gioia GA, Isquith PK, Guy SC, Kenworthy L. BRIEF-2: Behavior rating inventory of executive function. FL: Psychological Assessment Resources Lutz (2015).
18. Sofronoff K. Counseling youth with asperger's syndrome. In: Baker L, Welkowitz L, editors. Asperger's Syndrome: Interventing in Schools, Clinics and Communities. Mahwah, NJ: Lawrence Erlbaum Associates Publishers (2005). p. 135–53.
19. Lamash L, Little L, Hen-Herbst L. Telehealth interventions to promote health and behavior-related outcomes in adolescents with autism spectrum disorder. J Autism Dev Disord. (2023) 53:405–23. doi: 10.1007/s10803-022-05440-2
Keywords: autism, emotion regulation, children, adolescents, telehealth, emotion dysregulation, group therapy, teletherapy
Citation: Coffman M, Wells M, Schmitt LM, Reisinger DL, Horn PS and Shaffer RC (2024) Telehealth regulating together pilot trial: emotion regulation intervention for autistic children and adolescents. Front. Psychiatry 15:1401148. doi: 10.3389/fpsyt.2024.1401148
Received: 14 March 2024; Accepted: 03 September 2024;
Published: 07 October 2024.
Edited by:
Antonio M. Persico, University of Modena and Reggio Emilia, ItalyReviewed by:
Nicole Matthews, Southwest Autism Research & Resource Center, United StatesKate Wallis, University of Pennsylvania, United States
Copyright © 2024 Coffman, Wells, Schmitt, Reisinger, Horn and Shaffer. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Rebecca C. Shaffer, Rebecca.shaffer@cchmc.org