Skip to main content

ORIGINAL RESEARCH article

Front. Educ., 23 October 2024
Sec. Special Educational Needs
This article is part of the Research Topic Behavior-specific praise in preK-12 settings: Expanding the knowledge base View all 5 articles

Behavior-specific praise: Enhancing on-task behavior in a rural elementary school

  • Department of Special Education, Early Childhood, and Prevention Science, University of Louisville, Louisville, KY, United States

Behavior-specific praise (BSP) is a low-intensity strategy used to reinforce positive student behaviors in school settings. BSP is currently a potentially evidence-based practice, with more studies with three or more participants needed to contribute to the literature base. This study investigated the impact of teacher-delivered BSP on student on-task behavior in an inclusive second grade classroom taught by a general and special education coteacher dyad in a rural Southeast school. Using an A-B-A-B withdrawal design, we observed the on-task behavior of four students with emotional and/or behavioral disorders (EBD) when the coteaching pair increased their rates of BSP after a brief training. All four students increased on-task behavior during BSP intervention conditions. Social validity questionnaires identified a positive impression from three out of four students and both teachers about the implementation of BSP in the classroom. Limitations and future directions are discussed.

Introduction

Instruction in general education classrooms requires teachers to balance pedagogy and behavioral strategies, planning rigorous, differentiated lessons while managing behavior. Disruptive student behavior, such as persistent off-task behavior, physical aggression to others or property, calling out, cursing, presence and use of weapons, and verbal threats to staff and students, along with classroom management concerns are common causes of teacher attrition (Amitai and Van Houtte, 2022). The frequency of these disruptive behaviors, unfortunately, are perceived by the vast majority of educators to occur “more now” or “significantly more now,” according to a survey of 41 school districts (EAB Global, Inc., 2019). In the same survey, most schools and districts lacked clear and consistent behavior management guidelines and teachers reported not being prepared to manage disruptive behavior in their classroom. This was consistent with an earlier review of course offerings in teacher preparation programs that showed preservice teachers are often not adequately trained to manage student behavior (Freeman et al., 2014).

It is not surprising then to learn challenging student behavior is the top reason for educator burnout, with upwards of 44–50% of teachers resigning in their first 5 years (Arnup and Bowles, 2016; Gerald, 2019). Similarly, the U.S. Bureau of Labor Statistics anticipated an average of 270,000 teachers will leave the field per year in the 2016–2026 decade (Torpey, 2018). Ingersoll and Tran (2023) identified rural teacher turnover at 15.4% and high-poverty rural schools at 28% each year, while Billingsley and Bettini (2019) found across 30 studies over 15 years special education teacher attrition was even higher than general education teachers, such as 75% compared to 40% in one study, respectively, in their first 5 years. Ensuring teachers have the skills to prevent challenging or disruptive behaviors and respond respectfully when they occur is critical to retaining teachers and maintaining a positive, productive, safe learning environment.

Historically, teachers’ classroom management plans consisted of reacting to challenging behavior with punishment rather than focusing on consistent implementation of positive, proactive strategies to prevent disruptions (Eaves et al., 2020; Sugai and Horner, 2008). Yet, the frequent use of reactive or punitive strategies is associated with higher levels of disruptive behaviors, lower student participation, poorer academic achievement, and increased risk of school dropout (O’Handley et al., 2020). Thus, many school districts now emphasize positive and proactive behavior support strategies designed to reinforce appropriate classroom behaviors [e.g., Positive Behavioral Interventions and Supports (PBIS); Sugai and Horner, 2006] rather than only relying on punishing inappropriate behaviors. Unfortunately, as mentioned earlier, many university programs provide preservice teachers with minimal, if any, universal behavior management strategies (e.g., rules, daily routines, parent communication), with only some programs training teachers with specific strategies for increasing appropriate and preventing or decreasing disruptive behaviors in schools (Flower et al., 2017; Freeman et al., 2014). This becomes especially disappointing given how important it is for general education teachers to have the knowledge and skills to support students with disabilities included alongside general education students (given the more positive outcomes for students with disabilities in inclusive settings; Cole et al., 2023) the increasing trend with greater numbers of students receiving special education services in inclusive general education settings (Institute of Education Sciences, 2023), equipping teachers with effective strategies to prevent challenging classroom behaviors has become increasingly important.

Behavior-specific praise: A low-intensity teacher-delivered strategy

Teachers need effective, efficient, easy-to-implement strategies (“low-intensity” strategies; Lane et al., 2015) to prevent challenging student behavior across all school settings, especially for all students in the classroom setting. Low-intensity teacher-delivered strategies include active supervision, high-probability request sequences, instructional choice, opportunities to respond, instructional feedback, precorrection, and behavior-specific praise (BSP), all of which teachers can use in instructional (e.g., the general education classroom) and non-instructional (e.g., hallway and cafeteria) settings for all students. BSP is more than feedback or acknowledgement in that it is a more intense response and includes a specific behavioral description component (Ennis et al., 2020a). Where general praise acknowledges or provides feedback, such as “good job,” BSP adds specificity, such as, “good job talking quietly.” Adding specificity informs students what they are doing well, making it more likely they will engage in the same behavior in the future if they find the attention reinforcing.

BSP has been researched extensively since the 1960s and shown strong results in supporting student academic engaged time while preventing challenging behavior (Ennis et al., 2020a; Royer et al., 2019). Ennis et al. (2020a) mapped the 50 years of literature examining BSP including delivery styles (e.g., praise notes, Nelson et al., 2008; peer-delivered BSP, Teerlink et al., 2017; majority were vocal-verbal), the training and coaching supports provided to teachers (e.g., single training only, daily or weekly coaching; bug-in-ear, graphed performance feedback, self-monitoring of BSP frequency), and the impact on student appropriate or inappropriate behaviors (31 studies with positive outcomes, five mixed results, zero negative). BSP was shown to be effective across early childhood, elementary, middle, and high school settings, in multiple contexts (e.g., general education, resource, self-contained) and content/subject areas, and delivery by a variety of adult (e.g., general education teachers, special education teachers, paraeducators) and student participants (Ennis et al., 2020a). Across a systematic review of 45 studies from 1973 to 2018 focused on coaching of preK-12 educators (primary independent variable) to increase their rate of BSP (primary dependent variable), Ennis et al. (2020b) found 16 studies that met all Council for Exceptional Children (2014) quality indicators. Of those 16 studies, six included graphed data for student behavior as a secondary dependent variable, all with overall improved outcomes. Hemmeter et al. (2011) and O’Handley et al. (2018) measured early childhood and elementary whole-class student behavior, while Duncan et al. (2013) and Rathel et al. (2014) measured behavior for one student per teacher classroom (three Head start, two elementary and one middle school self-contained, and one middle school resource), with all studies showing when educators were coached to increase BSP, student challenging/disruptive behavior reduced or task engagement/academic engaged behaviors increased. Similarly, Myers et al. (2011) demonstrated reduced off-task and disruptive middle school student behavior but in three out of four teachers’ classrooms (three random students selected for each observation), and Thompson et al. (2012) showed increased elementary student time on task for two out of three students, each in a different teacher’s classroom.

Although these examples included graphed student outcomes, within the 50 years of literature on BSP the vast majority of studies focused on increasing adult educator BSP rates with on-going coaching, and only a handful of studies had the primary dependent variable focused on student outcomes (Ennis et al., 2020a). From analysis of those studies, BSP is a potentially evidenced-based practice for increasing on-task behavior and reducing disruptive behavior, based on the Council for Exceptional Children (Council for Exceptional Children, 2014; Cook et al., 2014) standards for evidence-based practices (Royer et al., 2019). Royer et al. (2019) found only six studies met inclusion criteria for teacher-delivered BSP as the independent variable without on-going researcher coaching, and with student on task, off task, or disruptive/inappropriate behavior as the dependent variable. The six studies ranged from 1968 to 2016 and although methodological rigor was high for all and student outcomes improved for all, only two had three or more participants and established a functional relation between teacher-delivered BSP and student behavior (Royer et al., 2019). Authors thus called for more BSP studies focused on teacher-delivered BSP with three or more student participants to add to the evidence base that could help establish if the low-intensity strategy of BSP can be considered an evidence-based practice according to Council for Exceptional Children (2014) standards.

Purpose

Given the small number of studies in the literature base on BSP with three or more student participants (Royer et al., 2019), we sought to fill that gap with an experimental study focused on the impact of teacher-delivered BSP (independent variable) on student on-task behavior (dependent variable) for students with disabilities. With three or more student participants, results would contribute to the literature base that would help determine if BSP can be considered an evidence-based practice. Specifically, our research questions were:

1. To what extent will co-teachers implement BSP during second-grade literacy small group instruction following a brief training?

2. To what extent will on-task behavior for students with disabilities change due to teacher use of BSP, and is there a functional relation?

3. How do teacher and student ratings of the BSP intervention goals, procedures, and outcomes change when comparing pre- to post-implementation?

Method

Participants and setting

The study took place at Creek Vale Elementary School, a rural school in the southeast United States (all names and places are pseudonyms). The school had 441 students across preschool through fifth grade. Demographically, 386 students were White (87.5%), 29 students were Latinx (6.6%), four students were Black (0.9%), and 17 were identified as two or more races (3.9%). There were 224 (50.9%) students eligible for free- or reduced-price lunch, and 135 (30.6%) students received special education services. See Table 1 for additional school demographic information. All teachers in the school were trained in a schoolwide behavior plan the summer prior to the study: they used a virtual token economy system building-wide (Class Dojo; https://www.classdojo.com/v2/), where students received points for teacher-perceived positive behaviors and points could be deducted for teacher-perceived inappropriate behaviors. The teachers in this study utilized ClassDojo rarely, with a bell “ding” sounding when a student earned a point, but students were not aware of who received the point or why – we thus did not include these acknowledgements for positive behavior in our definition of BSP (see direct observation measure). Students redeemed points at a monthly school store.

Table 1
www.frontiersin.org

Table 1. School demographics.

Two second-grade coteachers and four students participated in this study. Ms. Duncan was a White female second-grade general education teacher with 4 years of experience, one at the current school. Ms. Winger was a White female special education teacher with 7 years of experience in her first year at the current school. Ms. Winger and Ms. Duncan cotaught small group math and literacy, the latter being observed in this study (see Table 2 for additional teacher demographics). The school principal nominated teachers for participation using our inclusion criteria: full state licensure, had over 90.0% attendance, and no previous school or district training in BSP (confirmed by first author, instructional coach for the building). We confirmed nominated teachers delivered less than five BSP statements in a 15-min screening observation (O’Handley et al., 2023). Specifically, we screened teachers over 2 days and Ms. Duncan used no BSP statements and Ms. Winger used five BSP on day one and one BSP on screening day two.

Table 2
www.frontiersin.org

Table 2. Teacher participant demographics.

Student inclusion criteria were (a) an active IEP, (b) 80.0% or more attendance, (c) moderate or high risk in one or both domains of the Student Risk Screening Scale – Internalizing and Externalizing (SRSS-IE; Lane and Menzies, 2009), and (d) were off-task at least five times by frequency count during a 15-min screening observation (e.g., looking somewhere other than the instructional materials for 3 s or more, not using tools or manipulatives for the teacher’s stated purpose, out of seat without permission, talking off topic).

Veronica was a 9-year-old White female with medical diagnoses of autism and attention deficit hyperactivity disorder (ADHD) receiving special education services under the eligibility category of Other Health Impairment. She received reading, math, and fine motor resource services and social skills coteaching services, and on the SRSS-IE she screened in at moderate risk for both externalizing and internalizing behavior patterns. Archie was a 7-year-old White male with a special education eligibility of Intellectual Disability (federal category; Mild Mental Disability state category). He received reading, math, fine motor, and social skills resource services, social skills and reading coteaching services, and on the SRSS-IE screened in at high risk for externalizing and internalizing behavior patterns. Additionally, Archie had an individual behavior chart token board that started halfway through baseline and was no longer used after the fourth intervention observation (indicated by asterisks on Archie’s graph). Ms. Winger created the token board which consisted of three tokens, each given to Archie, based on Ms. Winger’s perception of his on-task behavior at variable times, earning him a 2-min break to play with toys that suctioned together. Reggie was a 9-year-old White male with an eligibility of Intellectual Disability (federal category; Mild Mental Disability state category). He received reading, math, writing, and social skills resource services and additional social skills instruction in the cotaught classroom, and on the SRSS-IE he screened in at high risk for externalizing behavior patterns and moderate risk for internalizing behavior patterns. Kevin was an 8-year-old White male with an eligibility of Developmental Delay: Social–Emotional. He received resource and coteaching for social skills instruction, and on the SRSS-IE screened in at high risk for both externalizing and internalizing behavior patterns.

The cotaught classroom had 24 students enrolled (eight with IEPs), but based on district assessments, some students switched with students from another class for literacy small group instruction time where the study took place. Each student had their own desk and chair for independent work time while teachers worked with small groups of 4–6 students (with and without IEPs) on the sides of the room: the special education teacher’s group had two rectangular tables and the general education teacher’s group had one kidney-shaped table. Teachers utilized a smart panel TV to show literacy group rotation scheduling and the class was one-to-one with Chromebooks, working independently on i-Ready reading (see Baseline description) when not with either teacher’s small group, with both teachers monitoring students in the middle of the room who worked independently.

Measures

Dependent variable

We measured student on-task behavior as our dependent variable, defined as the student-oriented toward the teacher or task and academically engaged with the teacher or stimuli presented, such as sitting quietly, following teacher directions, writing when appropriate, talking on topic, and raising their hand (Gill and Remedios, 2013). Non-examples of on-task behavior included students engaging with non-teacher materials, head down on the desk, looking away from instructional materials for more than 3 s (starting at time of momentary observation), talking off topic, or talking out.

We used 1-min momentary time sampling (MTS) to estimate duration of student on-task behavior as simultaneous duration recording of four students was not possible. Momentary time sampling with shorter intervals has been established across decades of research as a close match to duration recording (Meany-Daboul et al., 2007; Radley et al., 2015; Saudargas and Zanolli, 1990), while also being a flexible, practical way to measure multiple variables in authentic school-based settings (Umbreit et al., 2024).

We observed the four participating students at the beginning of each interval to determine if they were on-task or off-task, marking the respective column on the data collection sheet for the corresponding interval. Because of the consistently on-time schedule of student rotations, observers were able use the large classroom clock with sweeping second hand to track intervals as each interval was equated to a clock time (versus needing to use interval numbers for various clock times in other studies when teachers start teaching at slightly different times each day). For example, observations always started at 12:00 PM and observers watched the clock’s second hand for the beginning of each new interval while they listened for and tallied teacher general and BSP statements. When the second hand swept :00 it took 1 s to glance at all four students and determine if each was on or off task, recorded as observers continued to listen to teachers for praise statements.

Teacher praise statements

We measured frequency of general and BSP statements separately by direct observation during the same 46 min divided into 1-min intervals. These data allowed us to determine the degree to which the independent variable was put in place by each coteacher, frequency of BSP. General praise was operationally defined by Zoder-Martell et al. (2019) as a praise statement that does not specify the specific, observable effective behavior. Examples included, “Good job” and “Way to go!” Non-examples included praise with behavior specified, such as, “Good job sitting quietly, Ruthie,” and, “I like how you have written your name neatly, Millie.” BSP was operationally defined as positive statements with a specific behavioral description component (Ennis et al., 2020a). Examples included, “Class, good job entering the room quietly and beginning your work,” and, “I love how you are sharing your markers with your table mates, Katie.” Non-examples included general positive comments such as, “Good job, Barbara” and, “Nice work, Jeramiya.” Additionally, non-examples of both general and BSP included reprimands such as, “Stop that,” “Pick your head up,” and “Get to work.” Acknowledgements were also non-examples for both categories of praise such as, “That is correct,” “Yes,” and, “You did the task.”

Design

We used an A-B-A-B withdrawal design to test the effects of increased rates of teacher-delivered BSP on student on-task behavior. The decision to begin teacher delivery of BSP was made based on the stability and trend (counter/therapeutic direction) of baseline data for the dependent variable (percentage of intervals of on-task behavior for four students in the cotaught classroom during literacy small group centers) determined with visual analysis of the graphed data (Lane and Gast, 2014). Similarly, the decisions to change conditions for withdrawal and reintroduction of the BSP intervention were made based on on-task behavior data stability, counter/therapeutic trends, and level determined with visual analysis, weighed against probability of benefit to continuing the condition (e.g., what additional value to visual analysis would an additional data point add). We a priori set a minimum of three observations per condition with the expectation of five observations being likely given the potential for a student to be absent, with the possibility of extending conditions longer if data were highly variable.

Procedures

We first obtained university IRB and district approvals then approached the school principal for permission and teacher nominations, whom we then screened (see Participants) and obtained informed consent. Teachers were not aware of the exact intervention they would be trained to implement, only that it would be one of the seven low-intensity strategies described in the introduction. Participating teachers then completed the Intervention Rating Profile-15 (IRP-15; Witt and Elliott, 1985) and worked with us to review student data for possible participants. Five students met the inclusion criteria but one had anticipated absences for medical reasons and was not invited to the study. They still received the classwide BSP intervention along with all students. Next, we obtained informed parent consent (all seven low-intensity strategies were presented as options for the intervention their child might receive) and then approached students and obtained their assent (students were given examples of two possible low-intensity strategies their teacher might start using, increased praise for doing well or offering choices of what to work on) and completion of the Children’s Intervention Rating Profile (CIRP; Witt and Elliott, 1985).

Data collection

Trained observers collected data using the same procedures across all conditions: the observer entered the room quietly, sat or stood in a discreet location, and did not interact with students during each 46-min observation. Teachers were directed in baseline to not change their current practices and engaged in their normal rates of praise during group instruction. The observer collected frequency of general and BSP statements for both teachers, and on-task behavior for the four students via 1-min momentary time sampling (see Measures). During baseline, teachers were not aware of what specific intervention they would be trained in, only that it was a “low-intensity behavior strategy.” Teacher implementation of BSP was selected for this study as the intervention to impact student on-task behaviors.

Baseline

In addition to a whole-group general education teacher-led phonics lesson and comprehension instruction from the i-Ready learning curriculum earlier in the day, the class used a literacy block of 60 min later in the day, divided into four 15-min student stations (we observed the first three rotations): two teacher-led guided practice groups, independent reading practice with passages and worksheets, and independent practice with i-Ready Personalized Learning1. With Ms. Duncan, groups often worked on comprehension practice with teacher-supplied passages. With Ms. Winger, groups studied a novel (high-achieving students) or received decoding instruction (low-achieving students) based on the district-created phonics continuum of skills. Students who worked with teachers read either independently or aloud in a small group of 4–6 students then answered teacher questions. Teachers responded with an acknowledgment (“Yes, that is right” or “No”) and behavioral reprimands (correction, redirection) with a low rate of praise (e.g., “Good”). A timer alerted students when to transition to the next station following the schedule displayed on the smart panel TV.

Intervention

During intervention conditions, students followed the same procedures as in baseline, going to their literacy group based on the visual menu displayed on the smart panel TV and transitioning to their next station when the timer buzzed. Teachers at or making their way to their small group tables at the beginning of the literacy block now delivered BSP statements as students arrived on time and throughout the period for exhibiting on-task behavior (dependent variable; e.g., “Good job staying focused on i-Ready reading,” “I like how I saw everyone following along”) and occasionally for meeting schoolwide expectations. They also continued to use general praise (e.g., “Good job”), though there was no instruction to do so, and we separately recorded both when delivered to individual students, a small group, or the whole class.

Withdrawal and reintroduction of BSP

After student intervention data were visually analyzed (see Experimental Design), the first author met face-to-face with each teacher and instructed them to withdraw the BSP intervention and return to pre-training rates of BSP. Direct observation continued until our visual analysis of student on-task behavior determined it was time for a condition change, after which teachers were asked to reintroduce BSP for the final intervention condition.

Post-intervention

After completion of direct observation data collection, graphs were printed, shown to teachers, and discussed. Teachers then filled out the post-intervention IRP-15. The four students were also shown their graphed data, engaged in a brief discussion, and then completed the post-intervention CIRP one-on-one with the lead author, who later shared aggregated teacher and student social validity data with teachers.

Interobserver agreement

The first author (doctoral student in special education and special education instructional coach within the school from the district level) trained the second author (university faculty) and the school assistant principal on direct observation procedures using recorded 10-min videos from the classroom made prior to baseline. Each secondary data collector watched a 10-min video, compared their data to the first author, calculated interobserver agreement (IOA) for dependent (student on-task behavior) and independent (frequency of teacher general and BSP) variables, and watched additional videos until three consecutive practice IOA scores were 90% or higher (M = 97.8%, range = 91.0–100%) before observing in the classroom. IOA percentage was calculated comparing interval-by-interval: exact count for frequency of teacher general and BSP in each interval and student on- or off-task score per interval, dividing the number of agreements by the sum of the number of agreements and disagreements and multiplying by 100 (Cooper et al., 2020). A secondary data collector observed 20.0% of sessions across all baseline and intervention conditions for both teachers and all student participants. We planned to retrain when IOA was <80% for any one observation, but retraining was not required. Mean IOA for student on-task behavior was 93.0% (range = 86.6–97.8%); mean IOA for frequency counts of teacher praise was 97.6% (range = 94.0–100%).

Fidelity

Implementation fidelity

After a stable baseline and/or countertherapeutic trends were determined via visual analysis for student on-task behavior, the first author trained both teachers on BSP during their common planning period in the principal’s office for 30 min with the principal present. We used a training fidelity checklist (available upon request) to ensure training was delivered as designed and consistent across studies taking place at additional school sites (see Hogg et al., 2024; Royer et al., 2024b), reviewed prior to and completed after training. Example items included “agenda presented,” “trainer modeled BSP,” and “trainer administered three checks for understanding,” scored as a binary yes or no. Trainers counted the number of yes items, divided by the total number of items, and multiplied by 100 to get an implementation fidelity percentage. Implementation fidelity for this study was 100%.

The trainer greeted participants with a BSP upon entering to model the practice (i.e., “Thank you for being on time”), introduced the rationale of BSP with a PowerPoint, provided examples of BSP and general praise with time to practice differentiating, and had teachers generate their own BSP based on a picture prompt. Three comprehension/skill checks, multiple choice, and short answer questions were embedded throughout the training which teachers needed to score at least 90% to complete the training. The comprehension checks required teachers to identify examples of each type of praise, why they work (e.g., reinforcement), at what ratio praise should be provided compared to correction or reprimands (i.e., 4:1), and to generate BSP statements for multiple picture scenarios. Combined, teachers scored an average 95.5% (range = 90.9–100%). The only item missed in the training was a multiple answer question to identify why BSP is considered a low-intensity intervention; the general education teacher selected two of the three correct options. The trainer explained when to begin using BSP, that data collectors would continue to observe as in baseline, and how phase changes would occur based on stable teacher and student responses. We directed teachers to use at least three BSP statements per 15-min rotation (0.2/min), and that even more would have greater impact on student on-task behavior. We planned to retrain teachers if their aggregate classroom rate of BSP during either intervention condition was less than the predetermined criterion of 0.2 per min for two observations, but this was not needed.

Procedural fidelity

We utilized a procedural fidelity checklist across 100% of sessions, with a secondary observer completing the same checklist for 20% of sessions (once per condition). The checklist included five items, three for the observer to self-report (e.g., “Observer did not interact with students”) and two for the observer to score teachers, with one item reverse scored during baseline conditions (i.e., “Teacher utilized BSP at least 3× per rotation”). Items were scored as 0 = not implemented, 1 = partially implemented, and 2 = fully implemented. Fidelity scores were summed daily, divided by the total points possible (10), and multiplied by 100 to obtain a percentage. Across all conditions, procedural fidelity averaged 95.0% (range = 90.0–100.0%; see Table 3). During the baseline and withdrawal conditions, procedural fidelity averaged 97.5% (range = 90.0–100.0%). During both intervention phases, procedural fidelity averaged 96.7% (range = 90.0–100.0%). The only item scored partially instead of fully implemented in any condition was when a teacher used an occasional BSP statement (more than zero but less than three per 15-min rotation). IOA was assessed for 20.0% of sessions (once per phase) and averaged 99.6% (range = 96.7–100.0%).

Table 3
www.frontiersin.org

Table 3. Procedural fidelity and IOA results by condition.

Social validity

The Children’s Intervention Rating Profile (CIRP; Witt and Elliott, 1985) included seven items rated by the student, asking if the intervention was fair, helpful, acceptable, appropriate, or likely to cause problems with friends. Items were rated on a 6-point Likert-type scale (some were reverse scored) where 1 = strongly disagree and 6 = strongly agree. Example items included, “I think I will like being in this program,” and “I think being in this program will help me do better in school.” Total scores (sum) ranged from 7 to 42, with higher scores indicating higher social validity. Internal consistency of the CIRP in previous studies ranged from 0.75 to 0.89 (Carter, 2007).

The Intervention Rating Profile (IRP-15; Witt and Elliott, 1985) contained 15 questions asking adults whether the intervention was acceptable, fair, appropriate, compatible, and effective. Items were rated on a 6-point Likert-type scale ranging from 1 = strongly disagree to 6 = strongly agree. Example items included, “This intervention would not result in negative side effects for the child,” and “This intervention would be appropriate for a variety of children.” Total scores (sum) ranged from 15 to 90, with higher scores indicating higher social validity. Internal consistency was reported in previous studies to be 0.98 (Common and Lane, 2017).

Analysis

We analyzed data collected from this study through descriptive statistics (e.g., mean, range, percentage) for social validity (pre- to post-implementation comparison) and procedural fidelity, plus through visual analysis of level, trend, and stability for graphed data within condition as well as between condition (Lane and Gast, 2014). Additionally, we calculated the effect size for student on-task behavior using between-case standardized mean difference (BC-SMD; Valentine et al., 2016), comparable with Cohen’s d effect sizes in group comparison research designs. BC-SMD effect sizes can be interpreted as small (0.20–0.50), medium (0.50–0.80), and large (≥0.80; Fritz et al., 2012).

Results

In this study we used an A-B-A-B withdrawal design over 10 weeks to evaluate the effects of teacher-delivered BSP on four students’ on-task behavior. As seen in the graphs, two weeks did not include data collection, one for a week off for inclement weather and 1 week for medical leave for the lead author. Veronica was absent 3 days due to illness and typically left the classroom for a resource reading group with a different special education teacher for three of the 1-min intervals observed by data collectors (i.e., left early). Reggie missed 186 intervals across six observation days (3 baseline, 3 intervention) due to in-school mental health therapy and was absent from school for one full intervention day. Kevin was absent for 4 days of observation. All students were present for at least three sessions of each condition.

Teacher praise statements

Ms. Duncan displayed zero BSP and a low rate of general praise (M = 0.03 per min, range = 0.00–0.09/min) with a downward trend in baseline (see Figure 1). Her rate of BSP increased in the initial BSP intervention phase (M = 0.19/min, range = 0.09–0.35) with a positive trend and her general praise also increased in level with stability (M = 0.06/min, range = 0.02–0.09). After a decline of BSP on her fourth intervention day (BSP k = 4), her special education coteacher reminded her to increase her rate, which might partially account for her highest rate of BSP (k = 16) occurring in the next observation. Ms. Duncan’s rate of BSP returned to near-baseline levels (M = 0.004/min, range = 0.00–0.02) when teachers withdrew the BSP intervention, and her general praise decreased to levels lower than baseline (M = 0.008/min, range = 0.00–0.04). In B2, when reintroducing the teacher-delivered BSP intervention, her use of BSP increased immediately and dramatically (M = 0.23/min, range = 0.20–0.28) with greater stability compared to B1. Her rate of BSP during each observation in the second intervention phase met our criterion rate of 0.20 per minute (at least one BSP every 5 min). Her general praise rate also rose in the second intervention phase compared to baseline and withdrawal phases (M = 0.04, range = 0.00–0.13).

Figure 1
www.frontiersin.org

Figure 1. Ms. Duncan’s (general education teacher) rates of general and behavior-specific praise (BSP) during 46-min literacy observations.

Ms. Winger (see Figure 2) displayed stability in baseline with a low rate of BSP (M = 0.06/min, range = 0.02–0.11) and general praise (M = 0.07/min, range = 0.04–0.11). Ms. Winger had an immediate large magnitude increase in her use of BSP with an accelerating trend (M = 0.44/min, range = 0.30–0.67) and her rate of general praise also increased (M = 0.23/min, range = 0.07–0.39). When withdrawing the use of BSP, Ms. Winger’s rate of BSP (M = 0.03/min, range = 0.00–0.07) and general praise (M = 0.08/min, range = 0.04–0.11) returned to near-baseline levels with a decreasing trend. With the reintroduction of teacher-delivered BSP, Ms. Winger’s rate of BSP again increased immediately and dramatically to an average of 0.36/min (range = 0.26–0.50) with stability and higher than our criterion of 0.20, though not as high as the average in B1. Her rate of general praise also increased to an average 0.17/min (range = 0.11–0.24), less than B1 but greater than baseline and withdrawal. There was no criterion set for general praise.

Figure 2
www.frontiersin.org

Figure 2. Ms. Winger’s (special education teacher) rates of general and behavior-specific praise (BSP) during 46-min literacy observations.

Student on-task behavior

For Veronica’s baseline data (Figure 3), she had an overall negative trendline with 56.0–87.0% of intervals on-task (M = 70.5% of intervals on-task). After BSP was introduced in the first condition change, she had an immediate level increase of 31.5% of intervals on-task. Her on-task behavior during the first intervention condition was much higher compared to baseline and had an accelerating trend (M = 94.4%, range 87.5–100.0% of intervals). When the teachers withdrew their use of BSP, on-task behavior returned to baseline levels with a decelerating trend (M = 54.5% of intervals, range 51.2–60.5%). The final intervention condition yielded an immediate dramatic level increase again, with a slightly accelerating trend (M = 97.0%, range 93.3–100.0%). One data point in each intervention condition had on-task behavior at 100.0% of intervals.

Figure 3
www.frontiersin.org

Figure 3. Veronica’s on-task behavior percentage of 1-min momentary time sampling intervals across 46-min literacy observations.

Archie’s baseline (Figure 4) had a slight negative trend in on-task behavior ranging from 65.0 to 86.4% of intervals (M = 73.1%). When BSP was implemented, he had a positive level change with an accelerating trend. Though four of his data points overlapped with data from A1, the trend was accelerating and the mean was 6.5% higher (M = 79.6% of intervals on-task, range = 0.50–95.7%). When the BSP intervention was withdrawn, Archie’s on-task behavior immediately and dramatically dropped far below baseline levels. While there was a positive trend, his on-task behavior was significantly lower than both intervention conditions (M = 32.4%, range = 8.7–58.7%). When reintroducing BSP, Archie’s on-task behavior rose dramatically from 23.9% (final withdrawal date) to 78.0% and continued three more days with a strong positive trend (M = 81.8%, range = 59.0–100.0%).

Figure 4
www.frontiersin.org

Figure 4. Archie’s on-task behavior percentage of 1-min momentary time sampling intervals across 46-min literacy observations (* = start of token board; † = end of token board).

Reggie’s baseline (Figure 5) had higher variability with a slight decelerating trend (M = 58.8% of intervals, range = 35.0–76.9%). When BSP was introduced in the classroom, his on-task behavior jumped higher than baseline but continued a negative trend for the first 3 days before leaping to 97.8 and 95.7% for the last 2 days of intervention (M = 80.0%, range = 54.5–97.8%). Reggie’s lowest on-task behavior on the third day of teacher-delivered BSP intervention was impacted by fewer intervals available for observation due to his attending mental health counseling. Without this outlier, his mean changed to 86.4% of intervals. In the withdrawal condition, Reggie’s on-task behavior returned to baseline levels with a decelerating trend (M = 57.5%, range = 48.5–67.4%). When the intervention was reintroduced, Reggie had a large level change and averaged higher than the first intervention condition (M = 84.5% of intervals, range = 66.7–97.6%). Again, his lowest on-task behavior day was also a mental health counseling day with reduced exposure to the intervention; without this outlier his average percentage of intervals on on-task behavior would have been 90.4%.

Figure 5
www.frontiersin.org

Figure 5. Reggie’s on-task behavior percentage of 1-min momentary time sampling intervals across 46-min literacy observations.

Baseline on-task behavior for Kevin (Figure 6) was mostly stable around the average 77.5% of intervals (range = 70.0–92.3%). He had a positive level change when BSP was introduced and on-task behavior stayed high with a slight decreasing trend (M = 95.2%, range = 91.3–100.0%). In withdrawal, Kevin’s on-task behavior dropped to below baseline with a decreasing trend (M = 56.5%, range = 45.7–65.2%). When the BSP intervention was reintroduced, there was an immediate and significant level increase with stable responding at a much higher percentage of intervals of on-task behavior (M = 95.2%, range = 93.5–97.8%).

Figure 6
www.frontiersin.org

Figure 6. Kevin’s on-task behavior percentage of 1-min momentary time sampling intervals across 46-min literacy observations.

All four students demonstrated a functional relation between the introduction of BSP and changes in their on-task behavior percentage of intervals. The BC-SMD estimate for student on-task behavior was 1.8989 with a standard error 0.3598 and 95.0% CI of [1.1642, 2.6336]. This represents a large effect size for BSP on student on-task behavior.

Social validity

Pre-intervention results of the IRP-15 for teachers averaged 75.5 (75 and 76 for the special and general education teachers, respectively) out of 90. Post-intervention scores increased to an average of 88.0 (86 and 90, general and special education teachers), an average increase of 12.5, indicating intervention expectations were exceeded. A similar trend was seen in student social validity ratings on the CIRP. Pre-intervention scores ranged from 17 to 40 out of 42 (M = 29.5) and at post-intervention, ranged from 34 to 42 (M = 40.0) with three maximum scores, an average increase of 10.5, which indicated expectations were exceeded. See Table 4 for individual adult and student social validity results.

Table 4
www.frontiersin.org

Table 4. Social validity results by participant and condition.

Discussion

In this study we measured the impact of a BSP intervention on student on-task behavior in response to the call for more BSP studies with at least three student participants, contributing to the BSP literature base of studies to determine if BSP can be considered an EBP (Royer et al., 2019). Teacher-delivered BSP was delivered to all students classwide, in small groups, and individually (the latter two audible to all students), though we did not count the praise statements given specifically to target students in the study. Caldarella et al. (2023) found BSP statements increased on-task behaviors for target students and the whole class. Target students’ on-task behavior was markedly higher when BSP was intentionally in place compared to baseline and when BSP was withdrawn, suggesting a functional relation for the four students between the dependent variable and introduction of BSP. With higher rates of BSP present in the classroom and the focus on positive, expected behaviors, the overall focus in the classroom thus shifted to noticing positive and on-task behaviors, encouraging all students to self-reflect on their behavior choices when hearing other students praised for meeting classroom expectations. By increasing on-task behavior, students engaged more with the general education curriculum and, in theory, would perform better on assessments.

Teacher results

During each intervention phase the rates of BSP for Ms. Winger, the special education teacher (B1 M = 0.42/min, B2 M = 0.36/min), outpaced Ms. Duncan, the general education teacher, (B1 M = 0.18/min, B2 M = 0.24/min). This could be partly due to Ms. Winger’s experience, specialty in special education, or her focus was behavior goals within the IEP to provide students access to the general curriculum. Thus, it is also possible Ms. Winger was more enthusiastic about trying a new intervention to support students who needed more than Tier 1 was providing.

Additionally, this study empowered the two coteachers with a skill that will help them prevent challenging and disruptive behavior (Ennis et al., 2018). Increasing their use of BSP should help them both continue to shift from a traditional reactive approach to classroom management (that typically does not teach students how to meet teacher expectations and instead leads to resentment, more disruption, and higher rates of school dropout; O’Handley et al., 2020) to a proactive prevention model, where BSP has a central role in reinforcing classroom behavior expectations (Pérez et al., 2023). BSP, along with use of additional low-intensity strategies such as precorrection, instructional choice, and high rates of opportunities to respond, can help teachers build their classroom self-efficacy and prevent challenging student behavior, creating a positive, productive, safe learning environment less likely to lead to teacher burnout (Lane et al., 2018; Lanza, 2020; Oakes et al., 2021).

Even though the general education teacher’s rate of BSP in B1 only met the 0.2/min criterion during the final session, there was still an increase in student on-task behavior. This further demonstrated the power of even a small amount of BSP. For example, it is possible Ms. Winger’s BSP from across the room, which averaged 0.302/min, was overheard by Ms. Duncan’s groups as they rotated, and thus, in combination with Ms. Duncan’s lower rate of BSP was sufficient to remind students of expectations and reinforce those behaviors meeting expectations.

During baseline phases, Ms. Duncan was more likely to engage in general praise rather than BSP, but rates were low. Scott et al. (2017) found across 6,752 observations over 7 years that teachers rarely engaged in positive feedback, let alone general or behavior specific praise, about once every 7.5 min in elementary, once every 16.4 min in middle school, and only once every 30.3 min in high school. It is imperative to increase the rate of praise in classrooms given how powerful (immediate, large magnitude changes in student on-task behavior) a low-intensity strategy such as BSP can be toward developing a positive, productive, safe learning environment. Additionally, when classrooms are full of positivity, encouragement, and praise, teachers may be more likely to stay in their current positions and less likely to consider leaving (Brunsting et al., 2023), helping to reduce teacher attrition.

As a low-intensity strategy to support classroom behavior, the value of using BSP cannot be understated and is worth repeating. Using BSP is free, with no additional cost or preplanning (once BSP becomes a habit) for teachers to implement. Teachers can easily verbally recognize expected behaviors when observed, increasing the likelihood those behaviors will occur more often when students find the attention reinforcing. Teachers must know their students well and customize BSP delivery, such as delivering praise privately (verbally or by written praise notes) to students who would find the public attention aversive. By shifting from reactive classroom management plans to recognizing behavioral expectations met and ignoring minor misbehavior, teachers are empowered to prevent challenging behavior and no longer need to focus on using ineffective punishment strategies.

Student results

Overall, teacher-delivered BSP positively influenced on-task behavior across students, with variations of effect possibly due to individual circumstances (e.g., disability, perceived value of BSP) and intervention dosage (e.g., student absences, classwide BSP statements heard). Although there was some overlap in student on-task behavior between baseline and the introduction of BSP, there was no overlap between withdrawal and reintroduction conditions, and only Reggie had overlap between B1 and A2 – there are clear level and trend changes between when BSP was present versus not. Veronica had the clearest functional relation of the four students, as her on-task behavior in both intervention conditions increased significantly and fell below mean baseline level when BSP was withdrawn.

Archie’s baseline to first intervention condition data overlapped but only due to one extreme value in each condition. That difference in level, with the significant drop in on-task behavior when BSP was withdrawn and the significant increase when BSP was reintroduced established a functional relation between teacher-delivered BSP and his on-task behaviors. When the token board was introduced during baseline (the one extreme value mentioned), he did have an increase in on-task behavior. However, because the token board was only implemented for half a month, three observations in A1 and three in B1, it is unclear to what degree the token board contributed to his improved on-task behavior for the first two intervention sessions, especially given the last two sessions in baseline had the token board in place but had the lowest percentages of on-task behavior. The change from low on-task behavior (with token board in place) to increased on-task behavior when BSP was first introduced, along with the level change between A2 and B2 without the presence of the token board and the demonstration of effect when BSP was withdrawn, contributes to the determination of a functional relation for Archie.

Reggie’s data had greater variability while still having clear highs in on-task behavior during BSP intervention conditions compared to clear lows in baseline and withdrawal conditions. This variability could be due to reduced dosage of BSP based on his reduced class time due to mental health counseling. Additionally, outside mental health needs could have tempered his response to the BSP low-intensity intervention. However, when comparing his mean level of on-task behavior across all four conditions, a functional relation becomes clearer with a pattern of alternating significant differences (A-B-A-B means = 58.8, 80.0, 57.5, 84.5%).

Kevin had a much higher baseline percentage of intervals of on-task behavior compared to the three other students, despite having the highest externalizing score on the SRSS-IE. Kevin also was absent the most, impacting his received dosage of BSP in the classroom which we expected to influence his on-task behavior, yet he had the most consistently high on-task behavior percentages of intervals of all four students. Like the other three students, when BSP was withdrawn, Kevin’s on-task behavior fell and then rose again when the intervention was reintroduced and stayed high, suggesting a functional relation between teacher-delivered BSP and his on-task behavior.

The student results are similar to Madsen et al. (1968) where the introduction of teacher-delivered BSP was also responsible for improved student behavior (reduced inappropriate behavior) after a brief BSP training and minimal coaching (suggestions for specific situations observed). Houghton et al. (1990) also found increased on-task student behavior when BSP was in use, establishing a functional relation across a multiple baseline design with four secondary school students. Improved student on-task behavior was also present in van der Mars (1989). Haydon and Musti-Rao (2011) found decreased rates of disruptive behavior per min when BSP was used after a 40-min teacher training similar to our study’s 30-min training, but only across two eighth grade math classrooms in a multiple baseline design, precluding determination of a functional relation. Authors also found a significant decrease of teacher reprimands when the BSP intervention was in place, a variable not measured for this study, but a teacher behavior noted anecdotally to occur frequently in baseline and less so throughout the study. Future researchers might consider measuring the use of teacher reprimands, often relied on by teachers for managing their class, to investigate if BSP reduces the need for such reactive procedures. Hollingshead et al. (2016) found similar results to our study in improved on-task behavior when teachers implemented BSP after a brief 30-min teacher training as in our study, and similar to Hayden and Musti-Rao saw a reduction in teacher reprimands as well. Notably, Hollingshead et al. (2016) mean baseline on-task behavior was lower (52.6% of intervals) compared to our baseline on-task behavior averaging closer to 70.0% across students, which might have more easily allowed for an effect to be demonstrated, though no functional relation was establish because the withdrawal condition only had two observations.

It was interesting to note how our four student participants’ percentage of on-task behavior fell below baseline average levels when the BSP intervention was withdrawn. We suspect the withdrawal of BSP had a temporary effect of lowering on-task behavior as the students anticipated the schedule of BSP reinforcement that was no longer there, similar to how intermittent schedules of reinforcement for problem behaviors are the strongest and hardest to disrupt (Cooper et al., 2020). It could also simply be on-task behavior, as a reversible behavior, responds to whatever students find reinforcing and when removed students experienced disappointment. Since most young students find teacher attention reinforcing, when BSP was withdrawn after students became accustomed to the positive environment it established, perhaps the motivation to continue working in the lesser-positive environment was reduced. If true, behavior-specific praise could be a powerful strategy to use at Tier 1 for all students to establish and maintain a positive, productive, safe learning environment.

Limitations

Results should be interpreted with the following limitations in mind. First, we did not collect maintenance or follow-up data. Without maintenance probes, we cannot determine if the impact of BSP on student on-task behavior was maintained long-term. Future researchers should see if teachers maintain their positive trends in using BSP over extended time and if student on-task behavior maintains at higher levels. Additionally, replication studies are needed to determine how this study would generalize more broadly, given it was limited to a specific set of second grade coteachers at a rural school during literacy instruction. Future research should replicate this design in other settings (e.g., upper elementary, middle school, high school), and across different content areas to determine how well BSP works for whom under what conditions.

A second limitation of this study was student absences, potentially masking even greater impacts of BSP. Kevin missed several days throughout phases due to non-academic barriers such as lice and eviction. Veronica had a slightly smaller dosage due to leaving a few minutes before the last interval for her resource literacy instruction. Reggie missed upwards of 40 min of instruction for mental health counseling through an in-school provider. He missed 90 intervals out of 138 intervention intervals across 3 days. Although teachers anecdotally reported using the intervention throughout the day, the transition back from counseling and the limited dosage could have reduced the impact BSP could have had on these students’ on-task behavior.

Both teachers taught second grade reading and were coteaching partners. One threat to internal validity was the Hawthorne Effect, wherein participants could be influenced to change behavior simply by the presence of the observers (Ledford and Gast, 2024). That is, teachers may have waited until days of direct observation data collection to implement BSP, versus using BSP every day, or if they were implementing BSP every day they might have made extra effort on days observers were present. To reduce this possibility, observers frequently visited the classroom after consent was obtained and before baseline was collected to help teachers feel more at ease with the additional adult’s presence. The training also naturally embedded opportunities for rapport building.

We tested the effects of BSP in the literacy block of one cotaught classroom where each teacher worked with a small group of students while the rest of the class worked independently, and so we encourage future researchers to examine the use of BSP as a strategy in various settings, such as other literacy contexts (e.g., whole group cotaught instruction, one general education teacher, one special education resource or special day class), as well as across other academic subject areas and in middle and high school settings. Such studies would help determine the extent to which BSP results in this study generalize to what conditions for which students.

Future directions

While data appear to indicate a functional relation between the introduction of BSP and increased student on-task behavior, and we attempted to control for history and maturation threats, we cannot say with absolute certainty BSP caused students to be more on task. Student social validity data showed dramatic increases to maximum scores from pre- to post-intervention for three out of four students but decreased for the fourth student despite improved on-task behavior. Future researchers should consider interviewing students to determine the desirable features of praise, delivery modality, and to what students attribute their improvement in on-task behavior. Floress et al. (2024) reviewed literature about praise in middle and high schools and identified three studies that included assessment of student praise preferences, coming to the same conclusion as Schneider et al. (2020; published after Floress et al., 2024 concluded their literature search) who used a survey of 511 middle school students and found most preferred to receive quiet praise. Deeper qualitative interviews across grade levels may further illuminate patterns that could help teachers decide when and how best to deliver praise to students of different ages. Additionally, we did not collect data on the rate of teacher corrections or reprimands, so we cannot say if they stayed consistent or decreased, changes of which could be partially responsible for observed changes in on-task behavior when negatively correlated to increased BSP. Caldarella et al. (2020) and Floress et al. (2022) investigated praise to reprimand ratios across elementary, middle, and high schools in rural, suburban, and/or urban settings. Author teams found praise led to more on-task behavior than reprimands did, and that teachers more frequently use general praise than BSP. Although Floress et al. (2022) included rural schools in their sample, results were not disaggregated by geographic area. Therefore further research on praise vs. reprimands would be beneficial when focused specifically on rural schools, the setting where this current study took place. Such data, features of praise, student perception, praise to reprimand ratios, and settings in rural schools, may help the field determine which student attributes predict for whom BSP will be a preferred strategy (e.g., students who find teacher attention reinforcing, so teachers can be careful to give attention to desired behaviors [BSP] and not accidentally reinforce inappropriate behaviors with reprimand attention) to assist teachers determining the best-aligned strategy when a student needs support beyond Tier 1.

Replication of this study with more generalization observations across the school day would help determine if teachers were using BSP outside of the literacy time block observed by data collectors. Relatedly, observation probes after future studies conclude B2 would help researchers understand the degree to which teachers maintain BSP over time. In this study, we showed teachers can increase praise after a short training without follow up coaching, though we were prepared to do so as previous studies have shown it was necessary, and so future trainers should consider a tiered training model (Gage et al., 2018).

Additional replication could target more significant behaviors as well, given student behaviors were relatively mild in this study, per their baseline percentage of intervals on task. Future studies should continue to look at the potential for BSP to shape adequate levels of on-task behavior toward high levels (replications), and how effectively BSP, in combination with other strategies (e.g., as a component of a Tier 3 intervention), can shape more extreme behaviors for students who are more significantly off-task. Another avenue for replication studies would be to extend BSP investigations with more diverse cultural and ethnic groups, both teachers and students. This study was conducted in a rural school with only White teacher and student participants, and replication studies should consider similarly rural settings while including greater diversity (e.g., race, ethnicity, teacher gender) in student and teacher participants for broader perspectives on BSP interventions.

Implications for practice

This study showed BSP has potential benefits when used in elementary coteaching classrooms, with replication studies needed to establish its generalizability to additional contexts. As a “low-intensity” strategy, BSP appeared well-suited for addressing low-intensity behaviors and more research would be needed to determine its effects on more severe behaviors of concern. As always, practitioners should match behavioral interventions to the intensity and function of student behaviors. BSP seemed to contribute to an overall classroom structure focused on positive behaviors from students with more positive teacher-student interactions. When BSP was withdrawn, student on-task behavior decreased, lending evidence to BSP as a Tier 1 low-intensity strategy for consistent use throughout each school day to maintain a positive, productive, safe learning environment (Lane et al., 2015). Practitioners should therefore focus on implementing BSP consistently and at high rates to effectively reinforce the prosocial behaviors they want to see occur more often in their classrooms.

There is great opportunity within coteaching settings for teachers to coach and model skills such as low-intensity strategies like BSP for each other. Without direction from the research team, the special education teacher coached the general education teacher after intervention session 4 on February 8 to use BSP more frequently. This was a natural opportunity for coteachers to align practices and enhance their coteaching relationship through communication, showing how coteachers can encourage best practices in the classroom, such as the delivery of low-intensity strategies like BSP as part of regular instruction for all students (Friend and Cook, 2017; Samuel, 2020). Teachers assigned to coteach must build a relationship and develop an openness to share feedback and discussion on student performance and teacher behaviors.

Lastly, for teacher educators it is critical to equip preservice and alternatively certified teachers with effective strategies and to model those strategies across settings. Many teachers in Christofferson and Sullivan’s (2015) study of preservice teacher classroom management training reported their experiences as “inadequate” or “ineffective.” They also reported frequently having isolated courses in behavior management (Christofferson and Sullivan, 2015). However, by giving preservice or alternatively certified teachers multiple examples and opportunities to see and practice low-intensity strategies that increase academic engagement and prevent challenging behavior, they develop a more fluent use of effective practices. For example, Chen (2021) conducted a pilot study using virtual reality simulations with frequent, real-time audio feedback for the teachers to practice classroom management, reinforcing that frequent real-time feedback positively shapes teacher behaviors (O’Handley et al., 2022). Teacher educators should then intentionally embed classroom management training across courses to better prepare teachers to address challenging behaviors and therefore support retention of teachers in the field.

This study adds to the literature about the potential of BSP as a low-intensity strategy to support classroom management (Lane et al., 2015). By having teachers explicitly focus on and reinforce positive behaviors with BSP, they can shape student behavior toward what is socially acceptable (determined by schoolwide expectations created ideally by all adults within the building along with input from families and students; Lane et al., 2019; Royer et al., 2024a) while also developing a positive classroom environment. The practice of using BSP costs teachers nothing and can be used in conjunction with several other low-intensity behavior strategies such as precorrection, opportunities to respond, active supervision, and others. BSP, in conjunction with other strategies, can reduce and prevent disruptive behaviors that distract from the learning process and increase academic engaged time.

Data availability statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics statement

The studies involving humans were approved by University of Louisville Institutional Review Board. The studies were conducted in accordance with the local legislation and institutional requirements. Written informed consent for participation in this study was provided by the participants’ legal guardians/next of kin.

Author contributions

NN: Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Software, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing. DR: Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Software, Supervision, Validation, Visualization, Writing – review & editing. JH: Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Software, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing. AP: Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Software, Supervision, Validation, Visualization, Writing – review & editing.

Funding

The author(s) declare that financial support was received for the research, authorship, and/or publication of this article. This research was funded in part by Project SPIDERS (School-University Partnerships Influencing aDvocacy and Engaging Rural Special educators), a U.S. Department of Education Office of Special Education Programs grant (H325D210042), and the Gheens Community Engagement Mini Grant Program at University of Louisville.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/feduc.2024.1445523/full#supplementary-material

Footnotes

References

Amitai, A., and Van Houtte, M. (2022). Being pushed out of the career: former teachers’ reasons for leaving the profession. Teach. Teach. Educ. 110, 103540–103512. doi: 10.1016/j.tate.2021.103540

Crossref Full Text | Google Scholar

Arnup, J., and Bowles, T. (2016). Should I stay or should I go? Resilience as a protective factor for teachers’ intention to leave the teaching profession. Aust. J. Educ. 60, 229–244. doi: 10.1177/0004944116667620

Crossref Full Text | Google Scholar

Billingsley, B., and Bettini, E. (2019). Special education teacher attrition and retention: a review of the literature. Rev. Educ. Res. 89, 697–744. doi: 10.3102/0034654319862495

Crossref Full Text | Google Scholar

Brunsting, N. C., Bettini, E., Rock, M. L., Common, E. A., Royer, D. J., Lane, K. L., et al. (2023). Working conditions and burnout of special educators of students with EBD: Longitudinal outcomes. Teacher Education and Special Education, 46, 44–64. doi: 10.1177/08884064221076159

Crossref Full Text | Google Scholar

Caldarella, P., Larsen, R. A. A., Williams, L., Downs, K. R., Willis, H. P., and Wehby, J. H. (2020). Effects of teachers’ praise-to-reprimand ratios on elementary students’ on-task behaviour. Educ. Psychol. 40, 1306–1322. doi: 10.1080/01443410.2020.1711872

Crossref Full Text | Google Scholar

Caldarella, P., Larsen, R. A. A., Williams, L., and Wills, H. P. (2023). Effects of middle school teachers’ praise-to-reprimand ratios on students’ classroom behavior. J. Posit. Behav. Interv. 25, 28–40. doi: 10.1177/10983007211035185

Crossref Full Text | Google Scholar

Carter, S. L. (2007). Review of recent treatment acceptability research. Educ. Train. Dev. Disabil. 42, 301–316.

Google Scholar

Chen, C. (2021). Immersive virtual reality to train preservice teachers in managing students’ challenging behaviours: a pilot study. Br. J. Educ. Technol. 53, 998–1024. doi: 10.1111/bjet.13181

Crossref Full Text | Google Scholar

Christofferson, M., and Sullivan, A. L. (2015). Pre-service teachers' classroom management training: a survey of self-reported training experiences, content coverage, and preparedness. Psychol. Sch. 52, 248–264. doi: 10.1002/pits.21819

Crossref Full Text | Google Scholar

Cole, S. M., Murphy, H. R., Frisby, M. B., and Robinson, J. (2023). The relationship between special education placement and high school outcomes. J. Spec. Educ. 57, 13–23. doi: 10.1177/00224669221097945

Crossref Full Text | Google Scholar

Common, E. A., and Lane, K. L. (2017). “Social validity assessment” in Applied behavior analysis advanced guidebook. Ed. J. K. Luiselli (Academic Press), 73–92.

Google Scholar

Cook, B., Buysse, V., Klinger, J., Landrum, T., McWilliam, R., Tankersley, M., et al. (2014). Council for Exceptional Children: standards for evidenced-based practices in special education. Teach. Except. Child. 46, 206–212. doi: 10.1177/0040059914531389

Crossref Full Text | Google Scholar

Cooper, J. O., Heron, T. E., and Heward, W. L. (2020). Applied behavior analysis. 3rd Edn: Pearson.

Google Scholar

Council for Exceptional Children. (2014). Council for exceptional children standards for evidence-based practices in special education. Author.

Google Scholar

Duncan, N. G., Dufrene, B. A., Sterling, H. E., and Tingstrom, D. H. (2013). Promoting teachers' generalization of intervention use through goal setting and performance feedback. J. Behav. Educ. 22, 325–347. doi: 10.1007/s10864-013-9173-5

Crossref Full Text | Google Scholar

EAB Global, Inc. (2019). Breaking bad behavior: the rise of classroom disruptions in early grades and how districts are responding [White Paper].: Education Advisory Board.

Google Scholar

Eaves, A. E., Radley, K. C., Dufrene, B. A., Olmi, D. J., and Bernard, L. E. (2020). A comparison of two group contingencies on teachers’ use of behavior-specific praise. J. Behav. Educ. 30, 226–246. doi: 10.1007/s10864-020-09366-6

Crossref Full Text | Google Scholar

Ennis, R. P., Royer, D. J., Lane, K. L., and Dunlap, K. D. (2020a). Behavior-specific praise in pre-K–12 settings: mapping the 50-year knowledge base. Behav. Disord. 45, 131–147. doi: 10.1177/0198742919843075

Crossref Full Text | Google Scholar

Ennis, R. P., Royer, D. J., Lane, K. L., and Dunlap, K. D. (2020b). The impact of coaching on teacher-delivered behavior-specific praise in preK-12 settings: a systematic review. Behav. Disord. 45, 148–166. doi: 10.1177/0198742919839221

Crossref Full Text | Google Scholar

Ennis, R. P., Royer, D. J., Lane, K. L., Menzies, H. M., Oakes, W. P., and Schellman, L. E. (2018). Behavior-specific praise: an effective, efficient, low-intensity strategy to support student success. Beyond Behav. 27, 134–139. doi: 10.1177/1074295618798587

Crossref Full Text | Google Scholar

Floress, M. T., Luh, H.-J., Heuermann, L., Granberg, A., Wingate, A., Wienstroer, M., et al. (2024). Middle and high school praise: a systematic review of the literature. School Psychol. 39, 31–49. doi: 10.1037/spq0000561

Crossref Full Text | Google Scholar

Floress, M. T., Riesdesel, E. K., Brito, C. F., and White, J. D. (2022). Middle and high school teachers’ praise and reprimand delivery. School Psychol. 37, 15–25. doi: 10.1037/spq0000482

Crossref Full Text | Google Scholar

Flower, A., McKenna, J. W., and Haring, C. D. (2017). Behavior and classroom management: are teacher preparation programs really preparing our teachers? Prev. Sch. Fail. 61, 163–169. doi: 10.1080/1045988X.2016.1231109

Crossref Full Text | Google Scholar

Freeman, J., Simonsen, B., Briere, D. E., and MacSuga-Gage, A. S. (2014). Pre-service teacher training in classroom management: a review of state accreditation policy and teacher preparation programs. Teach. Educ. Spec. Educ. 37, 106–120. doi: 10.1177/0888406413507002

Crossref Full Text | Google Scholar

Friend, M., and Cook, L. (2017). Interactions: collaboration skills for school professionals. 8th Edn. Boston: Pearson.

Google Scholar

Fritz, C. O., Morris, P. E., and Richler, J. J. (2012). Effect size estimates: current use, calculations, and interpretation. J. Exp. Psychol. Gen. 141, 2–18. doi: 10.1037/a0024338

Crossref Full Text | Google Scholar

Gage, N. A., Grasley-Boy, N. M., and MacSuga-Gage, A. S. (2018). Professional development to increase teacher behavior-specific praise: a single-case design replication. Psychol. Sch. 55, 264–277. doi: 10.1002/pits.22106

Crossref Full Text | Google Scholar

Gerald, V. (2019). Teacher retention: a growing problem. American School Board Journal. Available at: https://www.nsba.org/ASBJ/Issues/October/Teacher-Retention

Google Scholar

Gill, P., and Remedios, R. (2013). How should researchers in education operationalise on-task behaviours? Camb. J. Educ. 43, 199–222. doi: 10.1080/0305764x.2013.767878

Crossref Full Text | Google Scholar

Haydon, T., and Musti-Rao, S. (2011). Effective use of behavior-specific praise: A middle school case study. Beyond Behav. 20, 31–39.

Google Scholar

Hemmeter, M. L., Snyder, P., Kinder, K., and Artman, K. (2011). Impact of performance feedback delivered via electronic mail on preschool teachers’ use of descriptive praise. Early Child. Res. Q. 26, 96–109. doi: 10.1016/j.ecresq.2010.05.004

Crossref Full Text | Google Scholar

Hogg, J., Royer, D. J., Priddy, A., and Newton, N. A. (2024). Effects of behavior-specific praise on student behavior in career and technical education. [Manuscript submitted for publication].

Google Scholar

Hollingshead, A., Kroeger, S. D., Altus, J., and Trytten, J. B. (2016). A case study of positive behavior supports-based interventions in a seventh-grade urban classroom. Prev. Sch. Fail. Altern. Educ. Child. Youth 60, 1–8. doi: 10.1080/1045988x.2015.1124832

Crossref Full Text | Google Scholar

Houghton, S., Wheldall, K., Jukes, R., and Sharpe, A. (1990). The effects of limited private reprimands and increase private praise on classroom behaviour in four British secondary school classes. Br. J. Educ. Psychol. 60, 255–265. doi: 10.1111/j.2044-8279.1990.tb00943.x

Crossref Full Text | Google Scholar

Ingersoll, R., and Tran, H. (2023). Teacher shortages and turnover in rural schools in the US: an organizational analysis. Educ. Adm. Q. 59, 396–431. doi: 10.1177/0013161x231159922

Crossref Full Text | Google Scholar

Institute of Education Sciences. (2023). Number of school-age students served under individuals with disabilities education act (IDEA), part B, by educational environment and type of disability: selected years, fall 2012 through fall 2022 [table]. National Center for Education Statistics. Available at: https://nces.ed.gov/programs/digest/d23/tables/dt23_204.65.asp

Google Scholar

Lane, J. D., and Gast, D. L. (2014). Visual analysis in single case experimental design studies: brief review and guidelines. Neuropsychol. Rehabil. 24, 445–463. doi: 10.1080/09602011.2013.815636

PubMed Abstract | Crossref Full Text | Google Scholar

Lane, K. L., and Menzies, H. M. (2009). Student risk screening scale for internalizing and externalizing (SRSS-IE). Available at: http://www.ci3t.org/screening

Google Scholar

Lane, K. L., Menzies, H. M., Ennis, R. P., and Oakes, W. P. (2015). Supporting behavior for school success: a step-by-step guide to key strategies : Guilford.

Google Scholar

Lane, K. L., Menzies, H. M., Ennis, R. P., and Oakes, W. P. (2018). Effective low-intensity strategies to enhance school success: what every educator needs to know. Beyond Behav. 27, 128–133. doi: 10.1177/1074295618799044

Crossref Full Text | Google Scholar

Lane, K. L., Oakes, W. P., Cantwell, E. D., and Royer, D. J. (2019). Building and installing comprehensive, integrated, three-tiered (Ci3T) models of prevention: a practical guide to supporting school success (v1.3) : KOI Education.

Google Scholar

Lanza, G. E. (2020). Teachers' self-efficacy when managing disruptive student behaviors and its influence on teacher burnout (publication no. 2406) [doctoral dissertation, University of Connecticut]. Available at: https://opencommons.uconn.edu/dissertations/2406

Google Scholar

Ledford, J. R., and Gast, D. L. (2024). Single case research methodology: applications in special education and behavioral sciences. 4th Edn: Routledge.

Google Scholar

Madsen, C. H., Becker, W. C., and Thomas, D. R. (1968). Rules, praise, and ignoring: elements of elementary classroom control. J. Appl. Behav. Anal. 1, 139–150. doi: 10.1901/jaba.1968.1-139

Crossref Full Text | Google Scholar

Meany-Daboul, M. G., Roscoe, E. M., Bourret, J. C., and Ahearn, W. H. (2007). A comparison of momentary time sampling and partial-interval recording for evaluating functional relations. J. Appl. Behav. Anal. 40, 501–514. doi: 10.1901/jaba.2007.40-501

PubMed Abstract | Crossref Full Text | Google Scholar

Myers, D. M., Simonsen, B., and Sugai, G. M. (2011). Increasing teachers' use of praise with a response-to-intervention approach. Educ. Treat. Child. 34, 35–59. doi: 10.1353/etc.2011.0004

Crossref Full Text | Google Scholar

Nelson, J. A. P., Caldarella, P., Young, K. R., and Webb, N. (2008). Using peer praise notes to increase the social involvement of withdrawn adolescents. Teach. Except. Child. 41, 6–13. doi: 10.1177/004005990804100201

Crossref Full Text | Google Scholar

O’Handley, R. D., Dufrene, B. A., and Whipple, H. (2018). Tactile prompting and weekly performance feedback for increasing teachers’ behavior-specific praise. J. Behav. Educ. 27, 324–342. doi: 10.1007/s10864-017-9283-6

Crossref Full Text | Google Scholar

O’Handley, R. D., Dufrene, B. A., and Wimberly, J. (2022). Bug-in-the-ear training increases teachers’ effective instruction delivery and student compliance. J. Behav. Educ. 31, 771–795. doi: 10.1007/s10864-020-09429-8

Crossref Full Text | Google Scholar

O’Handley, R. D., Olmi, D. J., Dufrene, B. A., Radley, K. C., and Tingstrom, D. H. (2023). The effects of different rates of behavior-specific praise in secondary classrooms. J. Posit. Behav. Interv. 25, 118–130. doi: 10.1177/10983007221091330

Crossref Full Text | Google Scholar

O’Handley, R. D., Olmi, D. J., Dufrene, B. A., Tingstrom, D. H., and Whipple, H. (2020). The effects of behavior-specific praise and public posting in secondary classrooms. Psychol. Sch. 57, 1097–1115. doi: 10.1002/pits.22375

Crossref Full Text | Google Scholar

Oakes, W. P., Lane, K. L., Royer, D. J., Menzies, H. M., Buckman, M. M., Brunsting, N., et al. (2021). Elementary teachers’ self-efficacy during initial implementation of comprehensive, integrated, three-tiered models of prevention. J. Posit. Behav. Interv. 23, 93–105. doi: 10.1177/1098300720916718

Crossref Full Text | Google Scholar

Pérez, P., Gil, H., Artola, A., Royer, D. J., and Lane, K. L. (2023). Behavior-specific praise: empowering teachers and families to support students in varied learning contexts. Prev. Sch. Fail. Altern. Educ. Child. Youth 67, 83–90. doi: 10.1080/1045988X.2023.2181303

Crossref Full Text | Google Scholar

Radley, K. C., O’Handley, R. D., and Labrot, Z. C. (2015). A comparison of momentary time sampling and partial-interval recording for assessment of effects of social skills training. Psychol. Sch. 52, 363–378. doi: 10.1002/pits.21829

Crossref Full Text | Google Scholar

Rathel, J. M., Drasgow, E., Brown, W. H., and Marshall, K. J. (2014). Increasing induction-level teachers’ positive-to-negative communication ratio and use of behavior-specific praise through e-mailed performance feedback and its effect on students’ task engagement. J. Posit. Behav. Interv. 16, 219–233. doi: 10.1177/1098300713492856

Crossref Full Text | Google Scholar

Royer, D. J., Lane, K. L., Dunlap, K. D., and Ennis, R. P. (2019). A systematic review of teacher-delivered behavior-specific praise on K–12 student performance. Remedial Spec. Educ. 40, 112–128. doi: 10.1177/0741932517751054

Crossref Full Text | Google Scholar

Royer, D. J., Lane, K. S., Lane, K. L., and Oakes, W. P. (2024a). Examining the schoolwide expectations survey for specific settings: applications for building expectation matrices. J Positive Behav. Support. 20, 1–17. doi: 10.1177/10983007241276777

Crossref Full Text | Google Scholar

Royer, D. J., Priddy, A. P., Hogg, J. A., and Newton, N. A. (2024b). Using behavior-specific praise in a high school setting. [Manuscript submitted for publication].

Google Scholar

Samuel, A. (2020). Improving co-teachers relationships. J. Vincentian Soc. Action 5, 19–36.

Google Scholar

Saudargas, R. A., and Zanolli, K. (1990). Momentary time sampling as an estimate of percentage time: a field validation. J. Appl. Behav. Anal. 23, 533–537. doi: 10.1901/jaba.1990.23-533

PubMed Abstract | Crossref Full Text | Google Scholar

Schneider, M. M., Hilac, D. M., Mickelson, L. R., and Phillips, E. K. (2020). Middle school students’ preferences for praise. Psychol. Sch. 58, 221–234. doi: 10.1002/pits.22411

Crossref Full Text | Google Scholar

Scott, T. M., Hirn, R. G., and Cooper, J. T. (2017). Teacher and student behaviors: Keys to success in classroom instruction. Rowman and Littlefield.

Google Scholar

Sugai, G., and Horner, R. R. (2006). A promising approach for expanding and sustaining school-wide positive behavior support. Sch. Psychol. Rev. 35, 245–259. doi: 10.1080/02796015.2006.12087989

Crossref Full Text | Google Scholar

Sugai, G., and Horner, R. H. (2008). What we know and need to know about preventing problem behavior in schools. Exceptionality 16, 67–77. doi: 10.1080/09362830801981138

Crossref Full Text | Google Scholar

Teerlink, E., Caldarella, P., Anderson, D. H., Richardson, M. J., and Guzman, E. G. (2017). Addressing problem behavior at recess using peer praise notes. J. Posit. Behav. Interv. 19, 115–126. doi: 10.1177/1098300716675733

Crossref Full Text | Google Scholar

Thompson, M. T., Marchant, M., Anderson, D., Prater, M. A., and Gibb, G. (2012). Effects of tiered training on general educators' use of specific praise. Educ. Treat. Child. 35, 521–546. doi: 10.1353/etc.2012.0032

Crossref Full Text | Google Scholar

Torpey, E. (2018). Projections for teachers: How many are leaving the occupation? Career outlook. U.S. Bureau of Labor Statistics. Available at: https://www.bls.gov/careeroutlook/2018/data-on-display/how-many-teachers-are-leaving.htm

Google Scholar

Umbreit, J., Ferro, J. B., Lane, K. L., and Liaupsin, C. J. (2024). Functional assessment-based intervention: effective individualized support for students : Guilford.

Google Scholar

Valentine, J. C., Tanner-Smith, E. E., Pustejovsky, J. E., and Lau, T. S. (2016). Between-case standardized mean difference effect sizes for single-case designs: a primer and tutorial using the scdhlm web application. Campbell Syst. Rev. 12, 1–31. doi: 10.4073/cmdp.2016.1

Crossref Full Text | Google Scholar

van der Mars, H. (1989). Effects of specific verbal praise on off-task behavior of second-grade students in physical education. J. Teach. Phys. Educ. 8, 162–169. doi: 10.1123/jtpe.8.2.162

Crossref Full Text | Google Scholar

Witt, J. C., and Elliott, S. N. (1985). “Acceptability of classroom intervention strategies” in Advances in school psychology. ed. T. R. Kratochwill, vol. 4 (Routledge), 251–288.

Google Scholar

Zoder-Martell, K. A., Floress, M. T., Bernas, R. S., Dufrene, B. A., and Foulks, S. L. (2019). Training teachers to increase behavior-specific praise: a meta-analysis. J. Appl. Sch. Psychol. 35, 309–338. doi: 10.1080/15377903.2019.1587802

Crossref Full Text | Google Scholar

Keywords: behavior-specific praise, general praise, on-task behavior, coteaching, withdrawal design

Citation: Newton NA, Royer DJ, Hogg JA and Priddy A (2024) Behavior-specific praise: Enhancing on-task behavior in a rural elementary school. Front. Educ. 9:1445523. doi: 10.3389/feduc.2024.1445523

Received: 07 June 2024; Accepted: 23 September 2024;
Published: 23 October 2024.

Edited by:

Seth King, The University of Iowa, United States

Reviewed by:

Ashley Rila, The University of Iowa, United States
Collin Glazek, The University of Iowa, United States

Copyright © 2024 Newton, Royer, Hogg and Priddy. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Nicholas A. Newton, bmljaG9sYXMubmV3dG9uQGxvdWlzdmlsbGUuZWR1

ORCID: Nicholas A. Newton, https://orcid.org/0009-0004-7564-2136
David James Royer, https://orcid.org/0000-0003-2882-1049
Jennifer A. Hogg, https://orcid.org/0009-0005-4958-4523
Amber Priddy, https://orcid.org/0009-0000-4481-2228

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.