Jill Locke1*
Alyssa M. Hernandez1
Mahima Joshi1
Maria L. Hugh2
Alice Bravo1Anthony Osuna1
Michael David Pullmann1- 1Department of Psychiatry and Behavioral Sciences, University of Washington, Seattle, WA, United States
- 2Department of Special Education, University of Kansas, Lawrence, KS, United States
Introduction: Educators in public schools are required to serve students in their least restrictive environment. While many evidence-based practices (EBPs), defined as practices and strategies shown by research to have meaningful effectson outcomes for autistic students are documented in the literature, less is known about EBP use among educators in public schools.
Methods: Eighty-six general and special education teachers and para educators completed a survey about familiarity, training, and EBP use for included autistic children.
Results: Across roles, educators reported familiarity (98.8%), use (97.7%), and training (83.7%) in reinforcement. They reported the least familiarity with behavioral momentum (29.1%), training in both video modeling and peer-mediated instruction and intervention (18.6%), and use of video modeling (14.0%). Follow-up interviews (n = 80) highlighted mixed understanding of EBP definitions and use.
Discussion: Implications for inclusive education are discussed including autism-specific EBP training within pre-service teacher preparation programs.
One in 44 youth in the United States has autism spectrum disorder [ASD; (1)]. ASD is a pervasive developmental disorder characterized by deficits in social communication and the presence of restricted and/or repetitive behavior (2). As the primary setting in which autistic children receive services (3), schools are increasingly affected by this increased prevalence (4). Under the Individuals with Disabilities Education Act (5), schools are required to provide education in the least restrictive environment; thus, many autistic children are partially or fully included in general education settings (6). However, educators in these contexts have mixed familiarity, training, and varying degrees of support in their knowledge and use of evidence-based practices [EBPs; (7)], defined as practices and strategies shown by research to have meaningful effects on outcomes for autistic students (8). The types of EBPs most germane to inclusive settings and the extent to which general and special education teachers and paraeducators are trained to use EBPs is unknown (9, 10). Though EBP use is mandated in IDEA (11–13), research has shown that EBPs have not been successfully adopted, implemented, or sustained in these settings to support the inclusion and retention of autistic students (14–16). Understanding what interventions are used in these settings may provide a “road-map” for targeted efforts to improve the quality of training and supports for educators of autistic students (16, 17).
It is not clear which EBPs, if any, general and special education teachers and paraeducators are familiar with, commonly trained to use, or use to support inclusion of autistic students. Research improving the delivery of autism services in public schools has focused on training teachers of autistic children in self-contained settings (13, 18–20). Bond et al. (21) reviewed educational interventions for autistic children and found that a promising 59% of the studies were implemented by or involved teachers and paraeducators. While this is an encouraging finding, few of these studies were conducted in general education settings. Despite the growing number of autistic children in general education settings (22, 23), far less attention has been afforded to improving the instructional practices of general education teachers and paraeducators (24). It is critical not only to better understand teachers' practices but also explore the role of paraeducators in supporting teachers and included autistic children (25).
Inclusion alone may be necessary but not sufficient for improving outcomes for autistic children. Inclusion is the “fundamental concept that [autistic] children can and should be educated in the same setting as their [neurotypical] peers” [(26), p. 337]. The ways in which inclusion is facilitated in schools vary. Time in general education settings may be based on autism severity, where more impacted autistic children spend less time, and less impacted autistic children spend more time in general education (27). As expected, there is tremendous variability in the success of included autistic children (28, 29). Teachers and paraeducators may struggle to meet the range of intensive academic and developmental needs of autistic children in general education settings or rely on general teaching strategies that have little relevance to autistic children (30, 31). The complex and heterogeneous presentation of ASD symptoms may require specialized autism training that often is limited and unavailable in standard teacher preparation programs (32–37).
A growing number of EBPs can be used to include and retain autistic children in general education settings purposefully (38–40). In 2015, the National Professional Development Center on Autism Spectrum Disorder (NPDC) applied a rigorous set of criteria to classify 27 interventions as EBPs (38). In 2020, the NPDC updated their review finding 28 EBPs with some overlap of the previous EBPs (e.g., scripting and visual supports) and initial evidence qualifying as EBP for two new practices [Sensory Integration Therapy, and music-mediated intervention (40)]. While important, these lists do not ensure that teachers and paraeducators consistently receive training to deliver EBPs for autistic children in schools (41, 42). In fact, there is a large disconnect between best practice guidelines and actual practice (14, 43, 44).
For EBPs to be used, educators must be familiar with and trained in them. However, the extent to which general and special education teachers and paraeducators are familiar with and trained to use EBPs and the types of EBPs most germane to inclusive settings remains minimally explored (9, 10, 24, 45). Studies that have examined EBP use among educators have traditionally focused on teachers and not paraeducators. McNeill (7) found that educators' knowledge and use of EBPs for autistic students were closely related. Given that these same EBPs often are not successfully adopted, implemented, or sustained in public schools (15, 46), familiarity and knowledge should be explored to examine this chasm. Barry et al. (24) found that the majority of teachers received little initial teacher education training in autism and almost no continuous professional development before educating an autistic child. The lack of specific knowledge about the use of EBPs may impede implementation efforts to increase use, which could be addressed by more nuanced research.
The purpose of this study was to identify which EBPs general and special education teachers and paraeducators have heard of, been trained in, and use to include and retain autistic children in general education settings more meaningfully. Specifically, this study had the following research questions: (1) Which EBPs have teachers and paraeducators heard of? (2) Which EBPs for autistic children have general and special education teachers and paraeducators been trained to use to support inclusion? (3) Which EBPs do teachers and paraeducators use to support included autistic children? (4) What are the most frequently used EBPs to support the inclusion and retention of autistic children in general education classrooms and how do they differ by role? (5) How do teachers and paraeducators understand EBPs? An exploratory, mixed-methods design was used to obtain educator-reported EBP familiarity, training, and use. These data will allow us to understand usual care practices in schools to support the inclusion of autistic children in general education settings.
Methods
Participants and setting
A free web-based tool, https://thegeneralizer.org, was used to obtain a representative sample of schools based on selected school and district characteristics (47). The web-based tool allowed us to capture a broad range of perspectives on the use of EBPs in general education settings to achieve data saturation. The target sample was intended to infer to Washington State schools from Kindergarten-5th grade (K-5), with representative balance based on school characteristics (size, % free and reduced lunch, gender, race, urbanicity/rurality) and district characteristics (number of schools, % English Language Learners, % language at home, English only, and urbanicity/rurality). In total, 56 schools in 28 districts were invited to participate in the study. Approximately 126 interest forms from school educators were received. Educators were screened per established criteria: (1) identified as a general education teacher, special education teacher, or paraeducator; (2) supported an autistic student who participates in a general education setting at least 15 min per day; and (3) worked in a Washington state public elementary school. One-hundred and four interested educators who met criteria were sent the study survey via a Qualtrics-generated hyperlink. Eighty-six educators from 50 schools from 24 districts in WA state completed surveys. The generalizability index is a score between 0 and 1, with 1 indicating that the sample is exactly the same as the population on the characteristics described above, and a 0 indicating that the sample and population share no common features (48). The final recruited sample achieved a generalizability index score of 0.92 for Washington State (considered very high), and 0.78 for the US population of schools (considered high) in regard to the characteristics described above.
Demographics
Table 1 presents descriptive information on enrolled participants. A total of 86 educators participated across three roles: general educators (n = 27), special educators (n = 31), and paraeducators (n = 28) who supported at least one autistic student in an inclusive general education classroom; 80 of these participants completed follow-up interviews. Most educators were between ages 35–44 (n = 30, %=34.9) and had an average of 6.4 years in their current position (SD = 4.8). Sex distribution was 91.9% female (n = 79), 8.1% male (n = 7). One paraeducator identified as Latinx (1.2% of entire sample). Educators self-identified as Asian (3.5%, n = 3), white (86.2%, n = 74), or multiracial (9.3%, n = 8). No participants identified exclusively as Black, Native American, or Hawaiian/Pacific Islander. There were no significant differences among roles based on sex, age, ethnicity, or race.
Table 1. Demographics.
Procedures
The University of Washington's Institutional Review Boards (IRB) approved the study. When applicable, school district IRB approval was sought. Eight school district IRB applications were submitted and five school district IRB approvals were obtained. We contacted school district officials to obtain a list of elementary schools that have enrolled autistic children who are partially or fully included in a general education classroom and then emailed the school principal. Approximately 358 school principals were emailed. Subsequently, we distributed all recruitment materials (e.g., flyers, consent materials) to general and special education teachers and paraeducators. Before participation, the research team provided a full description to all participants of study procedures and activities included in study participation. Upon consent, participants were asked to complete a modified Autism Treatment Survey (ATS; 13) via an online survey. After completion, all participants were invited to an audio-recorded semi-structured interview (30–45 min) at a convenient time for the participant (via Zoom). Of the 86 participants, 80 agreed to do a follow-up interview. As an incentive for their participation, all participants were offered a $40 gift card, and their schools received a resource kit of materials to use with autistic children (e.g., Velcro, visual timer, visual supports, sensory toys, and fidgets, etc.).
Measures
Modified Autism Treatment Survey [ATS]
The ATS was designed to measure teachers' frequency of use and training experiences with a comprehensive list of EBPs for autistic children (14). Given the increased research evaluating the efficacy of practices since the origination of the ATS, we have updated the ATS as follows: (a) we included practices that have been identified as evidence-based for autistic students since its publication according to the NPDC (40); (b) we separated evidence-based multicomponent practices (e.g., peer-based intervention) from strategies (e.g., modeling); (c) we used updated practice definitions that align with the NPDC that have been validated via cognitive interviewing in more recent research (49); and (d) we break down components of the implementation strategy—training—to inform later implementation support development (i.e., who provided the training, what type of training). In addition, we added a question about participants' familiarity with each practice with a dichotomous question that asked whether they had heard of the practice (49, 50).
Addressing calls for more specific investigations into subtypes of EBPs, we took a novel approach to autism EBP exploration by attending to both multicomponent practices and strategies (51). To develop a set of multicomponent practices and strategies that are used to support meaningful inclusion and retention of autistic children in general education settings, we used explicit criteria for exclusion of practices from the NPDC review—practices could not: (1) be assessments (e.g., functional behavior assessment); (2) implemented only outside of schools (e.g., parent-implemented); or (3) require certification (e.g., Pivotal Response Training, Sensory Integration Therapy). We reviewed these criteria and the final set of evidence-based multi-component practices and strategies with an autism intervention expert. Twenty-one EBPs from the 28 listed in the NPDC were included. Multicomponent EBPs included: social narratives, direct instruction, antecedent-based interventions, social skills training, self-management, functional communication training, discrete trial training, peer-mediated instruction and intervention, and naturalistic intervention. Evidence-based strategies included: reinforcement, modeling, task analysis, visual supports, prompting procedures, augmentative and alternative communication, extinction, response interruption/redirection, time delay, technology-aided instruction and intervention, video modeling, and behavioral momentum intervention. Distinguishing multicomponent practice and strategy was necessary to better understand the possible limited use of multicomponent practices rather than excluding these if participants report frequent use of strategies only (7, 43).
Semi-structured interview
To complement the modified ATS and more thoroughly explore EBP use to support and retain autistic children in general education settings, we developed a systematic and comprehensive interview guide with questions that explored what the terms “evidence-based practice” and “evidence-based strategy” meant to participants and how they used the identified EBPs from their survey responses. Questions were carefully constructed to elicit clear information without assigning valence to EBP use. We asked each participant about two to four EBPs from their survey. To achieve saturation across practices, strategies, training, and frequency of use, we selected each participant's EBPs based on the following decision-guide: one practice that they had been trained in but did not use, one practice and one strategy that they used frequently regardless of training, and one practice or strategy that was rarely used regardless of training.
Four research team members conducted interviews. Interviews were conducted via Zoom, and audio and visual media were recorded following the participant's consent. Interviewers recorded field notes to be referenced for documentation, recorded emerging themes, and uploaded audio media to Rev.com for transcription. Interviewers reviewed transcripts for accuracy and to confirm validity to audio recording, provide clarity around inaudible segments, and remove identifiable transcript text (e.g., name of school, district, city, etc.).
Data analysis
Crosstabulations with chi-square tests were used to compare educator roles on demographic and descriptive information. ANOVAs were computed to compare roles on the mean total number of different multicomponent practices and strategies the participants were familiar with, trained to use, or used. Due to the lack of homogeneity of variance, Ganes-Howell post-hoc tests were used to test between group differences for the number of multicomponent practices/strategies in which participants were familiar. Tukey's Honestly Significant Difference tests were used for multicomponent practices/strategies trained in and used. We descriptively analyzed the modified ATS by computing percentages of those who were familiar with the practice/strategy; who were trained to use the practice/strategy, and those who used the practice/strategy in the last 2 years.
For qualitative data, the principal investigator and three research team members independently coded an initial set of transcripts to identify codes and met as a group to discuss recurring codes. We developed a codebook with operational definitions and examples of when to use and not use the code; an integrated approach to coding as certain codes were conceptualized during the interview guide development (i.e., deductive approach) and other codes were developed through a close reading of the initial set of transcripts [i.e., inductive approach; (52)]. The coding scheme was refined throughout the data analytic process (52). Following the development of a stable codebook, three team members coded ten randomly selected transcripts to train and achieve inter-rater reliability above 90%. After achieving initial reliability of 95.1%, coders interpedently coded the remaining transcripts, overlapping on 20% of randomly selected transcripts to maintain interrater reliability; drift reliability was 95.5%. To capture data complexity, avoid errors, reduce groupthink, and circumvent some researcher biases, a consensus process was used in which all reviewers independently coded reliability transcripts and met to compare their coding to arrive at consensus judgments through open dialogue (53–55). We used the approach of inductive thematic saturation to determine when there are no new emerging codes or themes, meaning data saturation has been reached (56).
Results
Modified Autism Treatment Survey [ATS; (14)]
Quantitative data were collected from 86 educators. Educator roles significantly differed by the mean number of different multicomponent practices and strategies in which they were familiar (F = 12.1, p < 0.001), trained in (F = 9.4, p < 0.001), or used (F = 17.5, p < 0.001). Post-hoc testing revealed that general education teachers had significantly fewer multicomponent practices and strategies in which they were familiar, trained in, and used compared to the other two roles (see Figure 1). There were no significant differences between special education teachers and paraeducators on any variables.
Figure 1. Number of different practices educators were familiar with, trained in, or used, with standard deviation whiskers.
Familiar multicomponent practices and strategies
Across educator roles, reinforcement (98.8%), modeling (97.7%), and task analysis (94.2%) were the most familiar multicomponent practices or strategies, and behavioral momentum intervention (29.1%), video modeling (44.2%), and naturalistic intervention (44.2%) were the least familiar multicomponent practices or strategies (Table 2).
Table 2. Multicomponent practice and strategies heard of (ranked by entire sample).
Familiar multicomponent practices and strategies by role
General educators were most familiar with reinforcement (96.3%), direct instruction (92.6%), modeling (92.6%), and visual supports (92.6%); and least familiar with behavioral momentum intervention (3.7%), discrete trial teaching (18.5%), and naturalistic intervention (22.2%). Special educators were most familiar with social narratives (100.0%), reinforcement (100.0%), modeling (100.0%), task analysis (100.0%) and visual supports (100.0%) and least familiar with technology-aided instruction and intervention (32.3%), behavioral momentum intervention (38.7%), naturalistic intervention (51.6%). Paraeducators were most familiar with reinforcement (100.0%), modeling (100.0%), task analysis (96.4%), social narratives (96.4%), and antecedent-based interventions (96.4%) and least familiar with video modeling (35.7%), behavioral momentum intervention (42.9%), technology-aided instruction and intervention (57.1%), discrete trial teaching (57.1%), and naturalistic intervention (57.1%).
Training in multicomponent practices and strategies
As shown in Table 3, educators were most frequently trained to use reinforcement (83.7%), modeling (79.1%), and visual supports (74.4%) and least frequently trained to use video modeling (18.6%), peer-mediated instruction and intervention (18.6%), and behavioral momentum intervention (19.8%).
Table 3. Multicomponent practice and strategies training (ranked by entire sample).
Training in multicomponent practices and strategies by role
General educators were most frequently trained to use reinforcement (77.8%), modeling (70.4%), and visual supports (66.7%) and least frequently trained to use behavioral momentum intervention (0%), discrete trial teaching (3.7%), and video modeling (11.1%). Special educators were most frequently trained to use reinforcement (93.5%), modeling (90.3%), and visual supports (87.1%) and least frequently trained to use peer-mediated instruction and intervention (12.9%), technology-aided instruction and intervention (19.4%), and behavioral momentum intervention (29.0%). Paraeducators were most frequently trained to use reinforcement (78.6%), modeling (75.0%), and prompting procedures (75.0%), and least frequently trained to use video modeling (10.7%), behavioral momentum intervention (28.6%), peer-mediated instruction and intervention (32.1%), technology-aided instruction and intervention (32.1%), and naturalistic intervention (32.1%).
Use of multicomponent practices and strategies
As shown in Table 4, across educator roles and practice types (multicomponent or strategy), reinforcement (97.7%), modeling (94.2%), and visual supports (86.0%) were the most often used. Video modeling (14.0%), technology-aided instruction and intervention (17.4%), and behavioral momentum intervention (19.8%) were the least used. On a scale from 1 (rarely used) to 4 (very often used), the most frequently used (when only including those participants who used it to compute the mean score) were reinforcement (M = 3.61, SD = 0.58), modeling (M = 3.54, SD = 0.63), and prompting procedures (M = 3.49, SD = 0.63), and the least frequently used were video modeling (M = 2.25, SD = 0.75), peer-mediated instruction and intervention (M = 2.50, SD = 0.91), and extinction (M = 2.74, SD = 0.86).
Table 4. Multicomponent practice and strategies use (ranked by entire sample).
Use of multicomponent practices and strategies by role
Among general educators, the most used multicomponent practices or strategies to facilitate inclusion of an autistic student were reinforcement (92.6%), modeling (88.9%), and visual supports (74.1%); behavioral momentum intervention (0%), discrete trial teaching (3.7%), and video modeling (3.7%) were the least used. On a scale from 1 (rarely used) to 4 (very often used), the most frequently used were modeling (M = 3.63, SD = 0.50), reinforcement (M = 3.60, SD = 0.65), and task analysis (M = 3.60, SD = 0.51). The least frequently used were video modeling, with one participant reporting use, (M = 2.00, SD = –); discrete trial teaching, with one participant reporting use (M = 2.00, SD = –); and peer-mediated instruction and intervention (M = 2.40, SD = 0.55).
Among special educators, the most used multicomponent practices or strategies to facilitate inclusion of an autistic student were reinforcement (100.0%), modeling (100.0%), and visual supports (100.0%) and the least used were peer-mediated instruction and intervention (16.1%), technology-aided instruction and intervention (16.1%), and visual modeling (22.6%). On a scale from 1 (rarely used) to 4 (very often used), of special educators who used a multicomponent practice or strategy, the most frequently used were reinforcement (M = 3.77, SD = 0.43), modeling (M = 3.71, SD = 0.46), visual supports (M = 3.58, SD = 0.62), social skills training (M = 3.58, SD = 0.70), and prompting procedure (M = 3.58, SD = 0.58). The least frequently used were video modeling (M = 2.29, SD = 0.76), peer-mediated instruction and intervention (M = 2.60, SD = 1.14), and augmentative and alternative communication (M = 2.65, SD = 1.17).
Among paraeducators, the most used multicomponent practices or strategies to facilitate inclusion of an autistic student were reinforcement (100.0%), modeling (92.9%), and antecedent-based interventions (82.1%) and the least used were video modeling (14.3%), technology-aided instruction and intervention (25.0%), and behavioral momentum intervention (28.6%). On a scale from 1 (rarely used) to 4 (very often used), the most frequently used multicomponent practices or strategies were prompting procedure (M = 3.50, SD = 0.69), reinforcement (M = 3.43, SD = 0.63), and modeling (M = 3.27, SD = 0.83). The least frequently used were video modeling (M = 2.25, SD = 0.96), peer-mediated instruction and intervention (M = 2.50, SD = 1.00), and extinction (M = 2.65, SD = 1.12).
Semi-structured interview
Qualitative data were collected from 80 educators (n = 26 general education teachers, n = 30 special education teachers, and n = 24 paraeducators); six participants did not respond to the invitation or declined. Almost all educators believed that the term “EBP” meant that there is evidence (e.g., from their own experiences, others' work, and research) backing-up the effectiveness of the practices or strategies. Most also believed that EBPs need to be proven successful through replication in different settings, undergo “multiple trial and error”, and “peer review”. Some educators also mentioned “to get the desired effects, there needs to be data collection” and continuous effort to fit what individual students need. There were few educators who could not define EBPs or could only describe how they might use an EBP more broadly.
When asked about specific EBPs that educators said they used in their surveys, many educators had to be reminded what the specific EBP meant. Several participants asked the interviewer to provide the definition of that named EBP. Most educators could describe the components of the specific practice or strategy that was asked (e.g., steps that they use in the classroom with the student) but could not name the EBP. More educators asked for the definition (coded 50 times) compared to educators who knew what the term was and its definition (coded 19 times). There also were a few instances where the educators provided the wrong definition for a specific EBP they described. For example, one participant defined reinforcement when asked about antecedent-based intervention, “When I hear [Antecedent-Based Intervention], I'm thinking in my head, okay, so this is like a behavior chart where I'm reinforcing behaviors that I want and not reinforcing the behaviors that I don't, and then re-teaching new behaviors…”.
Almost all educators described how they used or applied specific EBPs with autistic students. The majority said they used additional school-based programs such as Second Steps or Edmark to complement their EBP use. Many participants also mentioned combining multiple EBPs together (e.g., prompting and visual supports, direct instruction and social skills training) to help their autistic students. There were a few educators who described the use of specific EBPs incorrectly–the most frequent misapplication was naturalistic intervention (e.g., 25% of the time naturalistic intervention was described did not match the definition in the literature).
Discussion
The heterogeneity of autism symptoms poses a tremendous challenge in providing targeted, individualized, and meaningful EBPs to autistic children in public schools—no single EBP addresses the needs of all autistic children (8), which makes it almost impossible for educators to become familiar, receive training, and develop expertise to use a multitude of EBPs to support various autistic children in their care. Despite the catalog of promising, emerging, and established EBPs in the NPDC (40), it is still unclear which EBPs are used in elementary schools to support the inclusion and retention of autistic children in their least restrictive environment. This study is one of the first to prospectively understand the number and type of EBPs that elementary school general and special education teachers and paraeducators were familiar, trained in, and used to support autistic children in inclusive settings.
Overall, we found that educators were most familiar with and trained in reinforcement, modeling, task analysis, and visual supports but reinforcement, modeling, visual supports, and antecedent-based interventions were the most frequently used EBPs to support the inclusion and retention of autistic children in general education classrooms. We also found significant differences by educator role in that general education teachers had significantly less familiarity, training in EBPs, and use compared to special education teachers and paraeducators. Qualitative data explored nuanced differences in educators' understanding of EBPs and uncovered a mixed understanding of specific EBPs and their unique application to autistic students. The results of this study have important implications on how public schools consider and support EBP use among general and special education teachers and paraeducators for included autistic children.
Not surprisingly, all four EBPs (reinforcement, modeling, task analysis, and visual supports) that educators were most familiar with and trained in were evidence-based strategies. Only one EBP, antecedent-based intervention, was classified as a multicomponent practice. Although reinforcement, modeling, task analysis, and visual supports often are embedded steps in many of the queried multicomponent practices, these findings point to the challenges around EBP use of more “complex” interventions that comprise multiple strategies and components (51, 57). Multicomponent practices may be “harder” and more challenging for educators to implement, given their intervention complexity. One critical aspect of intervention complexity is that complex EBPs may require higher interventionist training and skill (57), a known barrier to implementing autism EBPs in school settings (28, 58). Interestingly, while these EBPs address ancillary behaviors related to the education of autistic children, they do not specifically address the core symptoms (e.g., social interaction and communication) underlying autism. Multicomponent practices with a strong evidence-base supporting social interaction and communication such as naturalistic intervention and peer-mediated instruction and intervention were infrequently used, despite evidence that educators can effectively implement these (59). Efforts to improve familiarity, training of targeted EBPs, and use to support specific outcomes such as social behaviors may be warranted to cultivate a more conducive environment for inclusion of autistic children.
The results also indicated that general education teachers had significantly less familiarity, training in EBPs, and use than their special education counterparts. These findings suggest that general education teachers may need more exposure to and training in autism-specific EBPs given the increased prevalence and high likelihood that autistic children will be included in their classrooms. There are several avenues in which this can occur. First, standard teacher preparation programs should consider requiring more specialized autism training (e.g., coursework, practicum, rotations, etc.) during educators' pre-service learning to build familiarity, practice, and gain mastery in EBP use (49, 60). Second, school districts and school buildings should prioritize in-service training or professional development opportunities to continuously learn new EBPs to support autistic children. Community-academic partnerships may be one avenue to support the training of providers to fidelity in autism EBPs (61, 62). Lastly, while most schools have adopted teams that comprise general and special educators and specialists (e.g., counselors, psychologists, speech therapists, etc.) to support autistic children, there may be some utility in protecting shared planning or meeting time to discuss supports for autistic children, monitor and track progress, or problem-solve around EBP implementation.
While it is promising that most educators understood what the term “EBP” meant, the qualitative data suggested there is some mismatch between how educators describe their use of specific EBPs compared to how those EBPs are defined in the literature. Although many educators were able to describe how they used specific EBPs in their classroom with autistic children, they could not name that EBP nor did they describe their use of it in a way that matched the research description. These findings highlight the discrepancy between the terminology used in autism research and educators' implementation—researchers may define practices in ways that educators may not understand or apply in practice. There is a need for future research to document educators' specific adaptations to EBPs from research trials that may improve EBP fit to the local contexts and resources of schools.
Limitations and future directions
We note several limitations, including participant characterization, homogeneity, and reliance on self-rated assessments. The representativeness of our sample on certain school- and district-wide characteristics was very high for Washington State and high for the United States. This adds inferential power to these findings as generalizable. However, there may be other characteristics for which we do not have important data, such as the proportion of autistic students, rates of autism training and awareness, and availability of funding for special education services. Second, although participants were a representative sample of WA and the USA, included educators were predominately white (86.2%). While a large percentage of general education (81.9%) and special education teachers in the United State identify as white (82.1%), there are significant differences in diversity across regions, type of district and schools (63), which may limit generalization of the present findings to other US and international school contexts. Third, data were collected during the 2020–2021 school year when schools were closed due to COVID-19, and we were unable to conduct live observations to corroborate EBP use with fidelity. Although necessary, reliance on self-report to understand EBP use is prone to response bias. To better understand EBP use to support inclusion and retention of autistic students, future studies should explore characterization factors, include a more diverse sample, and corroborate self-report data with direct observation of EBP use.
Conclusions
In sum, the present paper highlights important overlap and divergence between how general and special educators and paraeducators are familiar, trained in, and use EBPs to support autistic students in inclusive education settings. Educators reported familiarity (98.8%), use (97.7%), and training (83.7%) in reinforcement and the least familiarity with behavioral momentum (29.1%), training in both video modeling and peer-mediated instruction and intervention (18.6%), and use of video modeling (14.0%). School personnel may benefit from more exposure, training, and collaboration related to what EBPs are, autism-specific EBPs, and selection of EBPs across education contexts. Due to increasing efforts to improve EBP use and inclusion of autistic students, public schools must consider how to better and more consistently train their educators to use EBPs to support their students with varying needs. These findings underscore the need for further research on how educators use EBPs as well as ways in which implementation supports may facilitate EBP use to support the inclusion and retention of autistic students.
Data availability statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Ethics statement
The studies involving human participants were reviewed and approved by the University of Washington IRB (IRB ID: STUDY00010045) as well as each participating school district's Institutional Review Boards have approved the study procedures. The patients/participants provided their written informed consent to participate in this study.
Author contributions
JL is the principal investigator of the study, generated the idea and designed the study, is the primary writer of the manuscript, and approved all changes. MDP is the study methodologist and drafted the data analysis sections. AH, MJ, and MH coded all qualitative data. AB and AO supported the writing of the manuscript. All authors were involved in developing, editing, reviewing, and providing feedback for this manuscript and have given approval of the final version to be published.
Funding
This study was previously reviewed and approved and is funded by the Institute of Education Sciences [grant #: R324A200033 (JL)] in the amount of $1,399,375 and Institute of Education Sciences [grant #: #R305B170021 (Bruns)] in the amount of $702,476. The funder had no role in the design of this project, in the writing of the manuscript, and in the decision to submit this manuscript for publication.
Acknowledgments
We thank Dr. Eric Bruns, who is PI of the training grant that supported MH's time on this project.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
1. Maenner MJ, Shaw KA, Bakian AV, Bilder DA, Durkin MS, Esler A, et al. Prevalence and characteristics of autism spectrum disorder among children aged 8 years – autism and developmental disabilities monitoring network, 11 Sites, United States, 2018. Morb Mortal Wkly Rep Surveill Summ. (2021) 70:1–16. doi: 10.15585/mmwr.ss7011a1
2. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition. Washington, DC: American Psychiatric Association (2013). doi: 10.1176/appi.books.9780890425596
3. Kang-Yi CD, Locke J, Marcus SC, Hadley TR, Mandell DS. School-based behavioral health service use and expenditures for children with autism and children with other disorders. Psychiatr Serv. (2016) 67:101–6. doi: 10.1176/appi.ps.201400505
4. Cardinal DN, Griffiths AJ, Maupin ZD, Fraumeni-McBride J. An investigation of increased rates of autism in U.S. public schools. Psychol Sch. (2021) 58:124–140. doi: 10.1002/pits.22425
5. IDEA. (2004). Individuals With Disabilities Education Act 20 U.S.C. § 1400. Washington, DC: US Department of Education (2004).
6. Majoko T. Inclusion of children with autism spectrum disorders: Listening and hearing to voices from the grassroots. J Autism Dev Disord. (2016) 46:1429–40. doi: 10.1007/s10803-015-2685-1
7. McNeill J. Social validity and teachers' use of evidence-based practices for autism. J Autism Dev Disord. (2019) 49:4585–94. doi: 10.1007/s10803-019-04190-y
8. Cook BG, Odom SL. Evidence-based practices and implementation science in special education. Except Child. (2013) 79:135–44. doi: 10.1177/0014402913079002021
9. Segall MJ, Campbell JM. Factors relating to education professionals' classroom practices for the inclusion of students with autism spectrum disorders. Res Autism Spectr Disord. (2012) 6:1156–67. doi: 10.1016/j.rasd.2012.02.007
10. Finch K, Watson R, MacGregor C, Precise N. Teacher needs for educating children with autism spectrum disorders in the general education classroom. J Spec Educ. (2013) 2:6.
11. Fixsen D, Blase K, Metz A, Van Dyke M. Statewide implementation of evidence-based programs. Except Child. (2013) 79:213–30. doi: 10.1177/0014402913079002071
12. Odom SL, Cox AW, Brock ME. Implementation science, professional development, and autism spectrum disorders. Except Child. (2013) 79:233–51. doi: 10.1177/0014402913079002081
13. Stahmer AC, Rieth S, Lee E, Reisinger EM, Mandell DS, Connell JE. Training teachers to use evidence-based practices for autism: examining procedural implementation fidelity. Psychol Sch. (2015) 52:181–95. doi: 10.1002/pits.21815
14. Hess KL, Morrier MJ, Heflin LJ, Ivey ML. Autism Treatment Survey: services received by children with autism spectrum disorders in public school classrooms. J Autism Dev Disord. (2008) 38:961–71. doi: 10.1007/s10803-007-0470-5
15. Stark KD, Arora P, Funk CL. Training school psychologists to conduct evidence-based treatments for depression. Psychol Sch. (2011) 48:272–82. doi: 10.1002/pits.20551
16. Brookman-Frazee L, Haine RA, Baker-Ericzén M, Zoffness R, Garland AF. Factors associated with use of evidence-based practice strategies in usual care youth psychotherapy. Adm Policy Ment Health. (2010) 37:254–69. doi: 10.1007/s10488-009-0244-9
17. Stahmer AC, Suhrheinrich J, Mandell DS. The importance of characterizing intervention for individuals with autism. Autism. (2016) 20:386–7. doi: 10.1177/1362361316637503
18. Mandell DS, Stahmer AC, Shin S, Xie M, Reisinger E, Marcus SC. The role of treatment fidelity on outcomes during a randomized field trial of an autism intervention. Autism. (2013) 17:281–95. doi: 10.1177/1362361312473666
19. Suhrheinrich J, Stahmer AC, Reed S, Schriebman L, Reisinger E, Mandell D. Implementation challenges in translating pivotal response training into community settings. J Autism Dev Disord. (2013) 43:2970–6. doi: 10.1007/s10803-013-1826-7
20. Pellecchia M, Connell JE, Beidas RS, Xie M, Marcus SC, Mandell DS. Dismantling the active ingredients of an intervention for children with autism. J Autism Dev Disord. (2015) 45:2917–27. doi: 10.1007/s10803-015-2455-0
21. Bond C, Symes W, Hebron J, Humphrey N, Morewood G, Woods K. Educational interventions for children with ASD: a systematic literature review 2008–2013. Sch Psychol Int. (2016) 37:303–20. doi: 10.1177/0143034316639638
22. Frederickson N, Jones AP, Lang J. Inclusive provision options for pupils on the autistic spectrum. J Res Spec Educ Needs. (2010) 10:63–73. doi: 10.1111/j.1471-3802.2010.01145.x
23. Sansosti JM, Sansosti FJ. Inclusion for students with high-functioning autism spectrum disorders: definitions and decision making. Psychol Sch. (2012) 49:917–31. doi: 10.1002/pits.21652
24. Barry L, Holloway J, Gallagher S, McMahon J. Teacher characteristics, knowledge and use of evidence-based practices in autism education in Ireland. J Autism Dev Disord. (2021). doi: 10.31124/advance.13686640
25. Rispoli M, Neely L, Lang R, Ganz J. Training paraprofessionals to implement interventions for people autism spectrum disorders: a systematic review. Dev Neurorehabil. (2011) 14:378–88. doi: 10.3109/17518423.2011.620577
26. Mesibov GB, Shea V. Full inclusion and students with autism. J Autism Dev Disord. (1996) 26:337–46. doi: 10.1007/BF02172478
27. Yianni-Coudurier C, Darrou C, Lenoir P, Verrecchia B, Assouline B, Ledesert B, et al. What clinical characteristics of children with autism influence their inclusion in regular classrooms? J Intellect Disabil Res. (2008) 52:855–63. doi: 10.1111/j.1365-2788.2008.01100.x
28. Locke J, Williams J, Shih W, Kasari C. Child characteristics of socially successful children with autism. J Child Psychol Psychiatry. (2017) 58:94–102. doi: 10.1111/jcpp.12636
29. Koegel L, Matos-Freden R, Lang R, Koegel R. Interventions for children with autism spectrum disorders in inclusive school settings. Cogn Behav Pract. (2012) 19:401–12. doi: 10.1016/j.cbpra.2010.11.003
30. Corkum P, Bryson SE, Smith IM, Giffen C, Hume K, Power A. Professional development needs for educators working with children with autism spectrum disorders in inclusive school environments. Except Educ Int. (2014) 24:33–47. doi: 10.5206/eei.v24i1.7709
31. White SW, Scahill L, Klin A, Koenig K, Volkmar FR. Educational placements and service use patterns of individuals with autism spectrum disorders. J Autism Dev Disord. (2007) 37:1403–12. doi: 10.1007/s10803-006-0281-0
32. Knight VF, Huber HB, Kuntz EM, Carter EW, Jaurez P. Instructional practices, priorities, and preparedness for education students with autism and intellectual disability. Focus Autism Other Dev Disabl. (2019) 34:3–14. doi: 10.1177/1088357618755694
33. Loiacono V, Valenti V. General education teachers need to be prepared to co-teach the increasing number of children with autism in inclusive settings. Int J Spec Educ. (2010) 25:24–32.
34. Delmolino L, Harris SL. Matching children on the autism spectrum to classrooms: a guide for parents and professionals. J Autism Dev Disord. (2012) 42:1197–204. doi: 10.1007/s10803-011-1298-6
35. Alexander JL, Ayres KM, Smith KA. Training teachers in evidence-based practice for individuals with autism spectrum disorder. Teach Educ Spec Educ. (2015) 38:13–27. doi: 10.1177/0888406414544551
36. Morrier MJ, Hess KL, Heflin LJ. Teacher training for implementation of teaching strategies for students with autism spectrum disorders. Teach Educ Spec Educ. (2011) 34:119–32. doi: 10.1177/0888406410376660
37. Hsiao Y-J, Petersen S. Evidence-based practices provided in teacher education and in-service training programs for special education teachers of students with autism spectrum disorders. Teach Educ Spec Educ. (2019) 42:193–208. doi: 10.1177/0888406418758464
38. Wong C, Odom SL, Hume K, Cox AW, Fettig A, Kucharczyk S, et al. Evidence-Based Practices for Children, Youth, and Young Adults with Autism Spectrum Disorder. Chapel Hill: The University of North Carolina, Frank Porter Graham Child Development Institute, Autism Evidence-Based Practice Review Group. (2015). doi: 10.1007/s10803-014-2351-z
39. Schwartz IS, Sandall SR, McBride BJ, Boulware G. Project DATA (Developmentally Appropriate Treatment for Autism): an inclusive school-based approach to educating young children with autism. Topics Early Child Spec Educ. (2004) 24:156–68. doi: 10.1177/02711214040240030301
40. Steinbrenner JR, Hume K, Odom SL, Morin KL, Nowell SW, Tomaszewski B. Evidence-based practices for children, youth, young adults with Autism. Chapel Hill: The University of North Carolina, Frank Porter Graham Child Development Institute, National Clearinghouse on Autism Evidence Practice Review Team. (2020). https://ncaep.fpg.unc.edu/sites/ncaep.fpg.unc.edu/files/imce/documents/EBP%20Report%202020.pdf
41. Strain PS, Schwartz IS, Barton EE. Providing interventions for young children with autism spectrum disorders: what we still need to accomplish. J Early Interv. (2011) 33:321–32. doi: 10.1177/1053815111429970
42. Corona LL, Christodulu KV, Rinaldi ML. Investigation of school professionals' self-efficacy for working with students with ASD. J Posit Behav Interv. (2017) 19:90–101. doi: 10.1177/1098300716667604
43. Brock ME, Dynia JM, Dueker SA, Barczak MA. Teacher-reported priorities and practices for students with autism: characterizing the research-to-practice gap. Focus Autism Other Dev Disabl. (2020) 35:67–78. doi: 10.1177/1088357619881217
44. Dynia JM, Walton KM, Brock ME, Tiede G. Early childhood special education teachers' use of evidence-based practices with children with autism spectrum disorder. Res Autism Spectr Disord. (2020) 77:101606. doi: 10.1016/j.rasd.2020.101606
45. Sulek R, Trembath D, Paynter J, Keen D. Empirically supported treatments for students with autism: General education teacher knowledge, use, and social validity ratings. Dev Neurorehabil. (2019) 22:380–9. doi: 10.1080/17518423.2018.1526224
46. Brookman-Frazee L, Taylor R, Garland AF. Characterizing community-based mental health services for children with autism spectrum disorders and disruptive behavior problems. J Autism Dev Disord. (2010) 40:1188–201. doi: 10.1007/s10803-010-0976-0
47. Tipton E, Miller K. The Generalizer [Web-tool]. (2022). Available online at: http://www.thegeneralizer.org (accessed February 16, 2022).
48. Tipton E. How generalizable is your evaluation? Comparing a sample and population through a generalizability index. J Educ Behav Stat. (2014) 39:478–501. doi: 10.3102/1076998614558486
49. Hugh ML. Exploring determinants of early childhood special educators' practice selections for young children with autism spectrum disorder (Order No. 28024484) (Doctoral dissertation). University of Minnesota, Minneapolis, MN, United States.
50. Locke J, Hugh M, Pullmann M, Cook H, Coifman J, McRee E, et al. Exploring individual and organizational mechanisms of implementation of evidence-based practices for the inclusion of elementary students with autism: Study protocol. Int J Educ Res. (2021) 108:101779. doi: 10.1016/j.ijer.2021.101779
51. Ledford JR, Lambert JM, Barton EE, Ayres KM. The evidence base for interventions for individuals with ASD: a call to improve practice conceptualization and synthesis. Focus Autism Other Dev Disabl. (2021) 36:135–47. doi: 10.1177/10883576211023349
52. Bradley EH, Curry LA, Devers KJ. Qualitative data analysis for health services research: Developing taxonomy, themes, and theory. Health Serv Res. (2007) 42:1758–72. doi: 10.1111/j.1475-6773.2006.00684.x
53. DeSantis L, Ugarriza DN. The concept of theme as used in qualitative nursing research. West J Nurs Res. (2000) 22:351–72. doi: 10.1177/019394590002200308
54. Hill CE, Thompson BJ, Williams EN. A guide to conducting consensual qualitative research. Couns Psychol. (1997) 25:517–72. doi: 10.1177/0011000097254001
55. Hill CE, Knox S, Thompson BJ, Williams EN, Hess SA, Ladany N. Consensual qualitative research: an update. J Couns Psychol. (2005) 52:196–205. doi: 10.1037/0022-0167.52.2.196
56. Saunders B, Sim J, Kingstone T, Baker S, Waterfield J, Bartlam B, et al. Saturation in qualitative research: Exploring its conceptualization and operationalization. Qual Quant. (2018) 52:1893–907. doi: 10.1007/s11135-017-0574-8
57. Lewin S, Hendry M, Chandler J, Oxman AD, Michie S, Shepperd S, et al. Assessing the complexity of interventions within systematic reviews: development, content and use of a new tool (iCAT_SR). BMC Med Res Methodol. (2017) 17:1. doi: 10.1186/s12874-017-0349-x
58. Locke J, Olsen A, Wideman R, Downey MM, Kretzmann M, Kasari C, et al. A tangled web: The challenges of implementing an evidence-based social engagement intervention for children with autism in urban public school settings. Behav Ther. (2015) 46:54–67. doi: 10.1016/j.beth.2014.05.001
59. Hugh ML, Ahlers K, Joshi M, Locke J. School-implemented interventions for preschool to high School students with autism: An update on recent research. Curr Psychiatry Rep. (2021) 23:54. doi: 10.1007/s11920-021-01266-4
60. Hugh ML, Johnson LD, Fleury VP. Dissemination decision-making: Factors related to pre-service practitioners' selection of practices for students with autism. Educ Train Autism Dev Disabil. (2020) 55:332–47.
61. Brookman-Frazee L, Drahota A, Stadnick N. Training community mental health therapists to deliver a package of evidence-based practice strategies for school-age children with autism spectrum disorders: a pilot study. J Autism Dev Disord. (2012) 42:1651–61. doi: 10.1007/s10803-011-1406-7
62. Meza R, Drahota A, Spurgeon E. Community-academic partnership participation. Community Ment Health J. (2016) 52:793–8. doi: 10.1007/s10597-015-9890-4
Keywords: autism, inclusion, paraeducator, educators, evidence-based practice
Citation: Locke J, Hernandez AM, Joshi M, Hugh ML, Bravo A, Osuna A and Pullmann MD (2022) Supporting the inclusion and retention of autistic students: Exploring teachers' and paraeducators' use of evidence-based practices in public elementary schools. Front. Psychiatry 13:961219. doi: 10.3389/fpsyt.2022.961219
Received: 04 June 2022; Accepted: 18 November 2022;
Published: 06 December 2022.
Edited by:
Teresa A. May-Benson, TMB Educational Enterprises, United StatesReviewed by:
Tanu Wadhera, Indian Institute of Information Technology, Una, IndiaJuan Kou, Sichuan Normal University, China
Copyright © 2022 Locke, Hernandez, Joshi, Hugh, Bravo, Osuna and Pullmann. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Jill Locke, ampsb2NrZSYjeDAwMDQwO3V3LmVkdQ==