- Department of Counseling, Educational Psychology and Special Education, Michigan State University, East Lansing, MI, United States
Student motivation to write is a pivotal factor influencing their writing achievement. However, individual motivation to write is not independent of the learning environment. It also is crucial for teachers to develop their own efficacy, knowledge, and ability in writing and writing instruction to help them utilize effective instructional methods that stimulate students' motivation to write and further promote their writing achievement. Given these considerations, we utilized a two-level hierarchical linear model to examine the relationships among student motivation, teacher personal and professional traits, teacher writing instruction, and writing achievement at student and teacher levels. Our analysis of the dataset, which included 346 fourth and fifth graders nested within 41 classrooms, found that motivation had a positive predictive effect on writing ability at both student and teacher levels. Moreover, female students, fifth graders, and typically achieving students demonstrated higher writing achievement than their counterparts. While there were no significant effects of teacher efficacy, knowledge, ability, or professional development on student writing achievement, we observed that higher frequency of classroom management practices during writing instruction had a significant negative effect on student writing achievement. Our full model revealed that the relationship between student motivation and achievement was negatively moderated by teachers' increased use of instructional practices related to process features and using writing instruction materials, but positively moderated by increased use of varied teaching tactics. Overall, our findings emphasize the importance of contextual factors in understanding the complexity of student writing achievement and draw attention to the need for effective instructional practices to support students' writing development.
1. Introduction
The development of proficient writing skill is widely recognized as an indispensable component of K-12 education in the United States, as it empowers individuals to attain their academic, occupational, and personal aspirations (Graham, 2019; Sato and Thompson, 2020). However, the majority of young learners do not achieve mastery in the requisite writing behaviors and skills aligned with their grade-level expectations (Deane, 2011). This concerning trend is corroborated by the findings of the Nation Center for Education Statistics (NCES), which measures writing performance using the National Assessment of Educational Progress. The 2011 Nation's Report Card revealed that only 27% of twelfth-grade students demonstrated proficiency in writing, indicating a pervasive deficiency across the nation in constructing written responses that effectively accomplish the communicative purpose of writing, with proficient writing characterized by well-organized and coherent text with appropriate transitions and diverse sentence structure (NCES, 2011; Crossley and McNamara, 2016). In addition, half of learners encounter difficulties in even the most rudimentary aspects of writing, such as using detailed and factual descriptions, appropriate lexical choice, and varied sentence structures (NCES, 2011). The unprecedented decline in average scores across other core academic subjects (i.e., mathematics and reading) during the COVID-19 pandemic years, as reported in 2022 by the NCES, has further exacerbated concerns regarding writing deficiencies in the student population.
Examining the multitude of factors that influence writing performance represents a complex endeavor. Of these factors, student-level factors have garnered considerable research attention, given their direct and substantial influence on writing achievement (e.g., Maxwell et al., 2017; Coker et al., 2018). The existing writing models provide theoretical frameworks for understanding how the acquisition of writing skills and the production of written text can be influenced by individual factors. One such notable model is Hayes' (1996) cognitive model of writing, which underscores the central role of motivation and its enduring impact on student writing performance throughout the entire writing process. The model posits that motivation can facilitate both short-term responses to immediate writing goals and a long-term predisposition to engage in writing activities, even when they present challenging demands. Additionally, the model incorporates other individual factors, such as writing knowledge, working memory, and the ability to transcribe and translate ideas into conventional linguistic units, to account for the complexity of writing performance. Empirically, research has identified individual characteristics, such as motivational beliefs (e.g., Graham et al., 2018), writing knowledge (e.g., Saddler and Graham, 2007), working memory (e.g., Cordeiro et al., 2020), and writing-related behaviors and strategies (e.g., Graham et al., 2017b; Wijekumar et al., 2019), as significant contributors to writing achievement on the individual level.
Meanwhile, individual differences in writing-related factors are contingent upon the environment and are amenable to change through teachers' personal and professional qualities, as well as their instructional practices. Extensive research shows that teachers' beliefs in their ability to write and teach writing effectively (e.g., Tschannen-Moran and Barr, 2004; Corkett et al., 2011), writing knowledge and abilities (e.g., Huang and Shimizu, 2016), and participation in professional development programs (e.g., Roberts, 2002; Fearn and Farnan, 2007), have a positive and lasting impact on their students' writing performance and development. Moreover, establishing a supportive and inclusive learning environment by adopting effective writing instructional practices (e.g., Lam and Law, 2007; Graham and Harris, 2013; De Smedt and Van Keer, 2014), incorporating cultural and linguistic diversity elements when designing writing curricula and assessments (e.g., Datnow et al., 2003; Shapiro et al., 2016), and organizing school-wide celebratory events (e.g., Bradshaw et al., 2009) can also promote writing success. These findings also resonate with Graham's (2018) writers-within-community perspective, which emphasizes the significance of contextual factors and writing communities in shaping the meaning, motivation, and effectiveness of writing. Effective writing instruction should not only align with individual goals but also consider the intended audience, norms, and conventions of the genre to enhance the quality of writing. To accomplish this, teachers are expected to possess pedagogical knowledge and attitudes for teaching quality writing and a deep understanding of the social policy forces that influence writing instruction (Troia et al., 2011; Harris and Graham, 2016).
Despite a substantial body of research exploring the effects of various factors on student writing achievement, the majority of studies have investigated the associations between writing achievement and influential factors at the student and teacher level independently, without considering their interactional effects (e.g., Graham et al., 2017a; Bresina and McMaster, 2020; Wright et al., 2021). To address the complex nature and multilayered structure underlying writing achievement, it is essential for research to examine the nested relationships and consider the interplay of variables at higher levels through adopting multilevel analyses to mitigate aggregation bias and heterogeneity of regression (Anderson, 2012). Although some studies have investigated writing achievement from an integrated perspective by considering multilevel effects (e.g., Olinghouse, 2008; Mo and Troia, 2017), there is still much to explore regarding how these cross-level effects contribute to the effectiveness of writing instruction and ultimately lead to improved student writing achievement and what types of writing instructional actions can impact students' writing performance when considering their varying levels of writing motivation.
2. Student-level predictors of writing achievement
2.1. Writing motivation
Writing motivation has been a well-established area of research within the educational field, with recent conceptualizations highlighting the critical motivational and affective forces shaping students' perceived gains and losses in writing performance (e.g., Troia et al., 2013). Empirical evidence consistently suggests that motivated students demonstrate positive and strategic behaviors toward writing (e.g., Conroy et al., 2009; Wijekumar et al., 2019), expend extra effort on writing assignments (e.g., Hidi and Boscolo, 2006; Troia et al., 2012), persist in undertaking challenging writing tasks (e.g., Schrodt et al., 2019), actively seek feedback and guidance from teachers and peers (e.g., Williams and Takaku, 2011), collaborate with others to share writing ideas (e.g., Turner and Paris, 1995; Graham et al., 2017b), self-regulate their learning to write (Zimmerman, 1990), and evaluate their drafts periodically (e.g., Boscolo and Hidi, 2006). These behaviors enable students to complete writing tasks successfully, resulting in longer and better texts and further reinforcing their enthusiasm for writing (e.g., Graham et al., 2018).
Research has provided compelling evidence of the significant and positive associations between writing motivation and outcomes. For instance, a meta-analysis conducted by Camacho et al. (2021) revealed that multiple motivational constructs, such as self-efficacy and attitudes toward writing, were moderately associated with writing performance. Conversely, the positive impact of performance on motivational levels has also been observed, as students who experience success in writing tasks tend to exhibit higher levels of motivation. A recent systematic review by Alves-Wold et al. (2023) investigated self-reported writing motivation, with a specific focus on K-5 students. The review found that motivational levels varied depending on students' ability level and that students' self-efficacy beliefs were positively related to their actual writing performance, with changes in performance affecting motivation levels. Additionally, the review examined the construct validity of student self-reported motivational scales and highlighted the importance of designing motivational measures that align with their intended purpose and design features.
2.2. Individual demographic characteristics
The impact of demographic factors such as gender, grade, and learning ability on student writing achievement has been extensively analyzed in the literature on writing motivation and achievement. Research has yielded a mixture of findings regarding gender differences in writing motivation. Girls tend to report higher levels of achievement-oriented goals and self-efficacy beliefs than boys, as they often attribute their successes to effort and hard work (Pajares et al., 2000). However, girls possess lower self-esteem than boys, and their expectations for success may be undermined as writing tasks becomes increasingly difficult (Hidi et al., 2002). Boys, on the other hand, tend to rate their confidence higher than girls, potentially due to their more positive beliefs about their own writing ability (Pajares and Johnson, 1996). There are a few studies that demonstrated no statistically significant differences between male and female students in certain motivational constructs, such as in self-efficacy beliefs. For example, other gender-related factors, such as gender orientation (i.e., stereotypical beliefs about gender and task performance that students usually hold; Pajares and Valiante, 2001), may confound the effects of gender on writing motivation and achievement. Hence, gender can be regarded as a proxy variable that is associated with motivational beliefs and can explain writing achievement.
Numerous studies have examined the relationship between grade level and writing motivation, with varying results. Generally, lower grade students exhibit higher levels of self-efficacy beliefs compared to their counterparts in higher grades. For example, Shell et al. (1995) discovered that fourth graders reported significantly higher levels of self-efficacy, effort, and intelligence than 7th and 10th graders. In contrast, 7th graders showed little difference compared with 10th graders, except for self-efficacy beliefs where there was a slight decrease among 10th graders. This tendency is consistent with other studies demonstrating that writing motivation may decrease as early as Grade 3 and remain stable through middle and high school (Koster et al., 2015; James et al., 2017). This decline in motivation could be attributed to the increasing difficulty of writing tasks (Boscolo and Gelati, 2019) and the attainment of more accurate self-perception (Stipek, 1993) as students' progress through school. Empirical investigations (e.g., Pajares, 2003; Pajares et al., 2007a) have consistently indicated a weakening trend in writing motivation among students as they advance in their academic careers. However, some studies have sought to identify the nuances of writing motives. For instance, Rasteiro and Limpo's (2023) research revealed that middle school students demonstrated greater confidence in their use of the conventions of writing than higher-level cognitive skills such as ideation and self-regulation. Furthermore, they observed that middle school students were motivated to engage in writing activities by a combination of intrinsic (e.g., curiosity) and extrinsic (e.g., assignment grade) factors. It is also noteworthy that the relationship between a writers' abilities and their level of motivation may shift as they gain more experience and proficiency in writing (Pajares et al., 2007b).
In addition, a student's learning ability can play a vital role in determining their level of motivation and achievement in writing. Individuals with higher learning ability often possess more advanced cognitive and metacognitive skills that allow them to comprehend and analyze complex texts, generate and organize ideas, and employ effective writing strategies (Karlen and Compagnoni, 2017). These skills can boost their confidence and motivation to engage in writing activities. Conversely, students with lower learning ability may struggle with these skills, leading to frustration and reduced motivation to write. They may also encounter difficulties in mastering basic writing techniques such as spelling, grammar, and punctuation, which can further impede their writing progress and diminish their confidence and motivational beliefs (Troia et al., 2009; Roitsch et al., 2021). Brouwer's (2012) study found that students experiencing language learning impairment had diminished perceptions of their writing competence and their autonomous writing motivation. Although language learning ability did not necessarily have a direct association with student writing motivation, it could function as a moderator that influences the connection between motivation and writing quality. This is because language learning ability influences the proficiency with which students can articulate their thoughts in written form and can further decrease their motivation and writing outcomes if impaired.
3. Teacher-level predictors of writing achievement
3.1. Teacher efficacy beliefs
Although the body of research on teacher-level factors influencing students' writing performance is not as extensive as that on student-level factors, it is equally important to recognize their role in promoting students' writing proficiency, positive learning environment, and motivational beliefs (Graham et al., 2001). A teacher's self-efficacy beliefs is one of the most critical teacher-level factors that can lead to effective writing instruction. It can manifest in various aspects. Firstly, teachers with a strong sense of self-efficacy are more likely to adopt evidence-based teaching approaches that are multimodal and innovative (Posnanski, 2002) and demonstrate empathy and cater to the diverse needs of their students (Goroshit and Hen, 2016). Secondly, teachers with strong efficacy beliefs can enhance writing curriculum and assessment by dedicating more time to teaching grammar, mechanics, and content-level skills, such as developing ideas and text structures (Handtke and Bögeholz, 2019; Wyatt and Dikilitaş, 2021). Furthermore, they can enhance classroom management by implementing strategies to motivate students to write (Mojavezi and Tamiz, 2012), organizing in-class events and discussions on writing (Myhill et al., 2013), managing their classes efficiently to prevent disruptive behaviors (Poulou et al., 2019), and avoiding overly criticizing student errors (Shaukat and Iqbal, 2012). Collectively, these practices can help emphasize the importance of writing within the class, increase student engagement and enthusiasm, and achieve desired writing instruction outcomes.
A teacher's sense of efficacy is also influenced by contextual factors beyond their personal capabilities, such as professional development and teacher training programs (Posnanski, 2002), school resources and materials (Lee et al., 2011), and statewide assessment policies and high-stakes testing (Gonzalez et al., 2017). Troia and Graham's (2016) national survey found that teachers' beliefs and attitudes toward the Common Core State Standards for Writing and Language (CCSS-WL) and Common Core Aligned Assessments for Writing and Language (CCAA-WL) were associated with their sense of efficacy for teaching. Teachers who exhibited strong self-efficacy beliefs for teaching tended to hold favorable perceptions of the CCSS-WL and viewed them as feasible to implement with effort. This alignment with state standards was viewed as supportive of students in achieving satisfactory academic outcomes. The survey suggested that teachers who possess a positive self-perception of their efficacy as educators and are adequately prepared to teach writing are more likely to perceive state standards as a means to achieve improved student writing outcomes rather than a barrier hindering their ability to implement effective teaching practices.
Additional scholarly findings suggest that teachers' self-efficacy beliefs for their writing abilities and writing instruction skills are both important indicators of their effectiveness as writing educators. To become efficacious, it is crucial for teachers to develop a solid understanding of writing skills development and possess the capability to effectively implement writing instruction in their classrooms (Grossman et al., 2009). Teachers who lack confidence in their ability to lead student learning effectively may avoid emphasizing the importance of writing to their students and may not allocate sufficient time for writing instruction (Tschannen-Moran and Hoy, 2001), which can have negative effects on their students' writing skills and motivation. Consequently, it is essential for teachers to develop their own writing skills and have confidence in their capacity to teach writing to their students.
3.2. Teacher professional development and writing expertise
Efficient writing instruction necessitates competent teachers with a strong knowledge base, skills, and strategies in writing. Nevertheless, there is a scarcity of literature on teachers' writing knowledge, and one approach to evaluate their teaching writing knowledge is to examine their training programs (Lembke et al., 2021). According to a national report by Yoon et al. (2007), professional development can positively affect student achievement by first influencing teacher knowledge and skills, which subsequently serves as a mediator, leading to higher student achievement. The report also reveals a moderate-to-strong effect size of 0.53 on reading and writing performance, underlining that effective professional development training or workshops can significantly impact student achievement in these academic areas. Hence, it is essential to evaluate the extent to which teachers have received and internalized such trainings while assessing the impact of professional development efforts on student writing achievement.
Previous research has established that professional development programs that address both beliefs and practices enable teachers to shape their pedagogies and translate their beliefs into effective teaching behaviors (Doubet and Southall, 2017). In a randomized controlled trial conducted by Myhill et al. (2013), 32 teachers from different schools were assessed on their grammar knowledge and pedagogical content knowledge through an achievement test and interview. It was found that teachers with extensive knowledge of grammar were better equipped to enhance learning outcomes and assist their students in developing metalinguistic comprehension of written discourse. On the other hand, teachers with limited grammar knowledge may encounter challenges in handling grammatical discussions, especially when confronted with students' inquiries, and could potentially overlook opportunities to rectify misunderstandings related to grammar usage.
3.3. Writing instruction actions
The implementation of effective instructional practices is paramount to minimizing the discrepancies between anticipated and actual student achievement outcomes (Guskey, 1982). However, the quality and quantity of writing instruction provided to K-12 students often falls short (Cutler and Graham, 2008). Graham (2019) identified four major indicators of insufficient writing instruction, including inadequate time allocated for teaching writing, particularly for unfamiliar writing tasks, infrequent opportunities for students to engage in writing activities, limited utilization of evidence-based writing instruction, and insufficient access to digital tools to support students' writing needs. Addressing these shortcomings requires a concerted effort, including teachers' commitment to enhance their expertise and attitudes, as well as radical changes in curriculum standards and associated instructional materials within the educational system. Although mitigating these inadequacies can be daunting, analyzing the interconnections between student- and instructional-level variables may yield meaningful implications for educational practitioners seeking to facilitate student writing outcomes.
Numerous experimental research and synthesis studies (e.g., Graham and Perin, 2007; Graham et al., 2012) have demonstrated that writing instruction can enhance text quality and quantity, and also spark students' creativity and interest in writing tasks, as long as specific components are incorporated. One key component is the process-oriented approach to teaching writing, which involves explicit instruction of various practices such as planning and revising writing components, peer conferencing for providing and receiving feedback on writing, sharing writing ideas with classmates, monitoring writing progress, selecting one's writing topics, working at one's own pace, and using invented spellings (Pritchard and Honeycutt, 2006; Cutler and Graham, 2008). According to a meta-analysis study by Graham and Sandmel (2011), process-focused writing instruction produced a statistically significant but modest increase in the overall quality of writing, as evidenced by an average weighted effect size of 0.34. Despite some studies reporting low effect sizes for certain writing processes and activities (e.g., traditional grammar instruction), the process approach to writing instruction remains a valuable albeit moderately influential strategy for teaching writing to students in general education classrooms.
Effective writing instruction can also be achieved through the use of appropriate teaching materials. Ciullo and Reutebuch (2013) found that interventions using technology-based graphic organizers or concept maps had a relatively high effect size of 0.80 in improving writing outcomes. By providing students with a structured method for planning and organizing their ideas, graphic organizers can enhance both the quantity and quality of their text output. Similarly, digital writing environments offer an immersive and interactive experience for students, leading to an increase in students' motivation, quantity and quality of writing, use of the writing process, and writing skills (Yamaç et al., 2020). Word processors are one such tool with digital environments, and they have been shown to be effective in improving writing length, quality, development and organization of text, mechanical correctness, and motivation to write (Morphy and Graham, 2012). These programs allow for easy revision and produce legible characters while providing additional learning supports such as speech recognition and spellcheck. Incorporating rubric-based feedback has also been observed to lead to higher levels of self-efficacy for elementary-aged students in writing class (Hier and Mahony, 2018).
Effective instruction in writing is also evident in both its teaching content and methods. An essential component involves incorporating instructional practices that encompass transcription, grammar, vocabulary, text structures, and general global features. These practices are crucial for improving students' overall writing quality and productivity. Specifically, in the early and middle elementary grades, it is imperative to prioritize the teaching of these basic composing writing skills as they establish a solid foundation for advancing writing abilities (Graham et al., 2012). Kim et al. (2021) meta-analysis study provides evidence that focusing on the basic mechanics and conventions of writing has a moderate and positive effect (ES = 0.31) on writing outcomes for primary-grade students (Kindergarten to Grade 3). This effect is particularly pronounced among students with weak writing skills compared to those with typical writing skills. Pedagogically, teachers can model the writing process and exemplify the desired products through the utilization of various material supports, such as writing notebooks, graphic organizers, checklists, and rubrics. Moreover, teachers can foster student engagement through questioning, offering suggestions, and facilitating summarization activities. These approaches contribute to enhancing students' writing proficiency and their understanding of effective strategies (Troia et al., 2011). In a study conducted by Graham and Perin (2007), explicit teaching interventions, such as summarization, were found to have a significant positive effect on writing outcomes, with an effect size of 0.82.
Effective writing instruction is also reliant upon successful classroom management and organizational skills. Elementary school teachers who possess these skills are more likely to have actively engaged students in their classrooms (Clunies-Ross et al., 2008; Rimm-Kaufman et al., 2015), leading to increased participation, greater persistence, and fewer behavioral issues (Rimm-Kaufman et al., 2009). Additionally, classroom management methods that provide clarity and consistency in class regulations have been shown to enhance student interest and emotional engagement in writing (Kunter et al., 2007; Hochweber et al., 2014). By incorporating these strategies into writing instruction, teachers can optimize student learning and academic achievements.
4. Interplay between student- and teacher-level predictors
Several studies have investigated the variability of students' writing achievement at different levels, including the student, class, school, and broader state levels. Most of these investigations have utilized multilevel modeling to account for the variance within the nested structure of the educational data, allowing them to examine the effects of various factors and their interactions that contribute to explaining achievement disparities between classes. For example, Olinghouse (2008) investigated the impact of student- and instructional-level factors on the variability of narrative writing fluency and quality. The study revealed that students with low word reading ability could benefit from intensive spelling and grammar instruction to access acquired advanced planning skills, along with an increase in writing instructional time to enhance their genre and topical background knowledge. In a similar vein, Ritchey et al. (2015) explored the relationship between teachers' orientations and writing instructional practices, which varied by grade level, with older students producing superior texts and their teachers adjusting their instructional foci according to their students' developing competencies. Additionally, Coker et al. (2018) examined the connections between generative writing instruction and student achievement, which were found to vary based on two student factors (i.e., ethnicity and gender). Specifically, male and minority group students displayed higher writing quality than their counterparts when exposed to increasingly generative writing practices. Taken together, these studies provide critical implications for educators and researchers, emphasizing the need to address the ways in which student variables interact with influential teacher variables to facilitate student learning and construct classroom contexts.
5. Research objectives for this study
Although prior research has shed light on the factors that influence student writing achievement, there remain gaps in our understanding of how these factors interact and influence student writing outcomes. Specifically, exploring the interplay between student motivational beliefs, teacher professional traits, teacher instructional practices, and student writing achievement holds promise to inform the development of effective interventions that promote and sustain writing development. This study aims to expand on previous research by examining the relationships among these variables in upper elementary students using hierarchical linear modeling. The proposed conceptual model is presented in Figure 1. The study addresses the following research questions and corresponding hypotheses as follows:
Research Question 1: Does students' writing motivation predict their writing quality?
Hypothesis 1: Students' writing motivation relates to their writing quality. More specifically, we posited that the composite motivational scores of students, encompassing self-efficacy beliefs, task interest and value, and outcome and efficacy expectations, would exert a positive influence on their writing performance.
Research Question 2: Do teachers' professional traits and teaching effectiveness predict students' writing quality?
Hypothesis 2a: Teachers' self-efficacy beliefs, writing knowledge, writing ability, and professional development efforts relate to students' writing quality.
Hypothesis 2b: Teachers' instructional practices related to process, skills, materials, teaching tactics, and classroom management relate to students' writing quality.
Research Question 3: Does the relationship between students' writing motivation and their writing quality depend on teachers' instructional practices?
Hypothesis 3: Teachers' instructional practices related to process, skills, materials, teaching tactics, and classroom management moderate the relation between students' writing motivation and writing quality.
6. Method
6.1. Participants and setting
The present study is a subset of a larger research project that aimed to evaluate changes in students' writing motivation, knowledge, and performance over a school year, disaggregated by genres at multiple levels of analysis, including district, classroom, teacher, and student levels (see Troia et al., 2020). The sample data analyzed in this study were obtained from 41 English language arts teachers from 18 suburban districts in the Midwestern United States. A total of 346 students were selected based on their writing ability levels, as determined by either their district writing assessment scores or their teacher's ratings of the quality of their beginning-of-year writing samples evaluated using a common rubric in the district. Students varied between low, average, and high writing performance based on this information. The dataset was organized using a two-level stratified cluster sampling design, with students as the first level and teacher/classroom as the second level. As such, the findings from this study can be generalized to similar populations, as the sample included a diverse range of writing ability levels.
6.2. Student instruments
6.2.1. Demographics
At the beginning of each school year, the participating teachers provided students' sociodemographic information, including their grade level, gender, race/ethnicity, and disability status through a survey. When data collection began, the students self-identified their gender and race/ethnicity on a participant information form. Of the 346 students, 46.5% (n = 161) were fourth graders, 55.5% (n = 192) were female, 72.0% (n = 249) were White, and 7.8% (n = 27) were students who received special education services.
6.2.2. Writing motivational scale
The Situated Writing Activity and Motivation Scale (SWAMS) is a self-report tool used to measure students' motivation levels across three writing genres: narrative, informative, and persuasive. Based on an earlier version developed by Troia et al. (2013), the SWAMS consists of 15 Likert-scale items rated on a 7-point scale (ranging from 0 representing strongly disagree to 6 representing strongly agree) for each genre that measure three common motivational constructs of writing: self-efficacy beliefs, task interest and value, and outcome and efficacy expectations. Confirmatory factor analyses were performed to determine the factorial structure of the motivational instrument. The results revealed that a single motivation factor using all 15 items was sufficient to represent writing motivation in each genre, with good internal consistency reliabilities (Cronbach's α ranged from 0.85 to 0.87). The model also exhibited good fitness, as evidenced by CFI = 0.97 and RMSEA = 0.073. Furthermore, significant correlations have been observed between the motivation for narrative, informative, and persuasive writing (see Troia et al., 2022; Table 2), indicating strong associations ranging from 0.89 to 0.90. Therefore, to represent students' overall level of writing motivational beliefs across three genres, a composite score was computed in this study by averaging the three genre-specific writing motivation scores.
6.2.3. Writing quality
Over the course of the academic year, students were required to complete four writing tasks for each of the three genres: narrative, opinion, and informative. These tasks were administered through an online writing assessment tool (see Truckenmiller et al., 2020), with each genre containing four distinct prompts that were presented in a counterbalanced order. To assess the quality of the students' typewritten responses, two trained research assistants utilized an analytic trait scoring rubric based on the Smarter Balanced Assessment Consortium writing rubrics (Troia et al., 2020). The raters evaluated the quality based on seven dimensions, including orienting the reader to the purpose of the text, grouping ideas to enhance text coherence, providing a concluding sentence or section, linking ideas using transition words and phrases, developing ideas with facts, examples, experiences, and descriptive details, using varied and appropriate language and vocabulary, and using correct grammar, usage, and mechanics. Each dimension was double scored on a scale of 0 to 5, resulting in a total score ranging between 0 and 35. To ensure interrater reliability, a two-way random effects intraclass correlation with absolute agreement was calculated, yielding coefficients of 0.80, 0.81, and 0.84 (Troia et al., 2022). Similar to the findings regarding writing motivation, our study revealed statistically significant correlations among the writing quality of three distinct genres (see Troia et al., 2022; Table 2), demonstrating correlation coefficients ranging from 0.81 to 0.85. These results indicate moderate to strong associations between three assessed writing qualities. In order to determine overall writing quality, a composite score was calculated by taking the average score of all essays completed by each student.
6.3. Teacher instruments
6.3.1. Demographics
The study involved 41 teachers who taught fourth and fifth grade English language arts classes. The majority of the participating teachers were female (95.1%) and White (92.7%), but the sample also comprised two African American teachers and one Asian American teacher. Of the 41 participating teachers, 10 (24.6%) held only a bachelor's degree, and 20 (48.8%) taught fourth grade classes. On average, the teachers were 41.59 years old (SD = 1.45, range = 26–61). They had an average of 15.01 years of teaching experience and reported an average of 6.64 years of teaching fourth or fifth grade writing classes, depending on the grade level they were currently teaching when data collection was conducted.
6.3.2. Self-efficacy beliefs
The Teacher Efficacy for Writing Scale (TEWS) is a self-report instrument originally developed by Graham et al. (2001). In the present study, the scale was modified by excluding eight items related to assessing teachers' general teaching efficacy factor, as these items exhibited low internal consistency reliability. The TEWS utilized in this study is composed of eight questionnaire items that assess teachers' perceived competence in teaching writing, using a six-point scale that ranges from strongly disagree to strongly agree (total scores ranging from 8 to 48; Cronbach's α = 0.84, CFI = 0.92). A higher mean score across items indicates greater teacher efficacy. The TEWS questionnaire items pertain to asking teachers' abilities to implement effective strategies for teaching writing, enhance student retention of introduced concepts, teach writing concepts and skills for rapid mastery, assist students with their most challenging writing problems, adjust the difficulty of writing assignments for struggling students, accurately assess the reasons for a student's writing difficulties, provide appropriate accommodations, and manage disruptive behaviors during writing time. Overall, the TEWS serves as a valuable means of gauging teachers' perceptions of their writing instruction efficacy. The average score of the eight items was used in this study to represent teachers' self-efficacy beliefs.
6.3.3. Writing knowledge
The Teaching Writing Knowledge Test (TWKT) is an assessment tool aimed to measure teachers' writing content knowledge and pedagogical content knowledge. TWKT encompasses a total of 32 questionnaire items with 116 unique multiple-choice or fill-in responses scored as correct or incorrect (total score ranging from 0 to 116). The test includes items from research-based spelling and grammar knowledge tests for teachers (e.g., Cajkler and Hislam, 2002; Myhill et al., 2013), as well as items from other available tests used to evaluate pedagogical content knowledge of teachers (e.g., Cambridge English Teaching Knowledge Test). The TWKT also incorporated original items developed by the researchers. The test evaluates teachers' knowledge of key writing concepts such as morphemes, phonemes, syllables, consonant and vowel digraphs, consonant blends, root words, derivational and inflectional suffixes, regular and irregular spelling patterns, parts of speech, sentence structure, writing mechanics (capitalization, punctuation, and spelling), genre traits, evidence-based writing instruction practices, and targeted instructional activities to address various aspects of writing. The instrument has an internal consistency reliability of 0.72.
6.3.4. Writing ability
The participating teachers were asked to undertake two subtests of the Wechsler Individual Achievement Test-Second edition (WIAT-II; Wechsler, 2005) at the beginning of the school year. These subtests, which evaluated the teachers' spelling and written expression skills, yielded standardized age-based scores as measures of writing proficiency. As one of our primary outcome variables at the teacher-level, a composite score was derived by tallying the standardized scores of the two subtests to represent teachers' overall proficiency in writing.
6.3.5. Professional development
A researcher-designed questionnaire of three items is used to assess the nature of teachers' pre-service and in-service professional development (PD) opportunities related to teaching writing. The first item asks about the number of pre-service courses that included information on writing instruction, with response options ranging from 0 (none) to 2 (two or more) or those that were fully devoted to writing instruction, with response options ranging from 3 (one) to 4 (two or more). The second item focuses on the number of in-service activities related to writing instruction that teachers had participated in over the prior 5 years, which included live or online workshops, as well as formal or informal coaching/mentoring activities, with options ranging from 0 (none) to 4 (more than 6). The third item aims to capture the extent of teachers' unique independent learning activities to improve their writing instruction skills, such as engaging in more writing, reading about effective writing instruction, observing other teachers' writing instruction, seeking feedback on their writing instruction, and participating in additional courses or workshops not part of preservice or in-service training. The response options for this item ranged from 0 to 5. The total score for the questionnaire ranged from 0 to 13.
6.3.6. Instructional practices observation
Over the course of the academic year, beginning in October/November and ending in April/May, the writing classes of the participating teachers were observed typically four times. It is worth noting that unforeseen disruptions, particularly during the COVID-19 pandemic, occasionally impeded the researchers' attempts to maintain a consistent interval between observation points. The observers received extensive training in project meetings before conducting the observations and employed a time-sampling procedure to document the occurrence of assigned instructional practices within each 10-min interval. To record the instructional practices, the two observers used iSeeNCode (Hofstetter, 2016), an iPad application with 131 binary codes (0 = absent, 1 = present) derived from the Observation Protocol for Writing Assessment and Instruction (OPWAI). The OPWAI was subdivided into eight major observation dimensions: (1) grouping, (2) process feature focus, (3) genre focus, (4) product feature focus, (5) materials, (6) instructional tactics, (7) management tactics, and (8) assessment. The present study places a particular emphasis on five dimensions of writing instruction, including process feature focus, product feature focus, materials, instructional tactics, and management tactics. To represent each dimensional code, the average proportion of relevant codes to the total number of observation codes (131) per observation segment was calculated across all observations. A higher value for each dimensional code indicates that teachers exhibited a greater frequency of taking actions related to that particular dimension during their observed classes. This approach allows for a quantitative assessment of the extent to which teachers implemented instructional practices related to the five dimensions of writing instruction examined. The components and subcomponents that were encompassed within the five dimensions, along with the interobserver agreement reliability statistics for each dimension, are displayed in the Supplemental material.
6.4. Data analysis strategy
Our study utilized a multilevel structure dataset comprised of 346 students nested within 41 classrooms. This hierarchical structure implies that a student's learning outcome is influenced by both their individual characteristics and the broader class environment. Since simple regression is not suited for analyzing nested data due to the assumption of independence among observations, we employed hierarchical linear modeling (HLM) as our major statistical approach. HLM allows for the accommodation of the nested structure and parameter estimation of the effects of predictors at different levels simultaneously. Given the large sample size within clusters in our case, we also employed the maximum likelihood estimation (MLE) method for accurate parameter estimation on fixed and random effects (Maas and Hox, 2005). Due to the sensitivity of HLM to missing data at level 2 or above, we removed 2 instances of missing data at the teacher level, resulting in a final sample of 41 eligible teachers. All HLM analyses were conducted using lmer package in R Studio 2023.03.0.
During the exploratory phase of our study, we used descriptive and correlational analyses to determine potential covariates and gain preliminary insights into our data characteristics prior to model estimation. However, we acknowledge the limitations of solely relying on correlational analyses as they were indicative of interdependence rather than causality and did not account for correlations across multiple levels. Thus, in the subsequent stages of our study, we adopted HLM analyses to uncover the distinct main and interaction effects of the study measures across different levels.
The present study employed a linear two-level HLM model with MLE method to explore the complexity of the outcome variable of student writing quality. The analytical procedure involved four major steps. Firstly, a null model with no independent variables at both student and teacher levels was executed to assess the proportion of variance in student writing quality that can be attributed to differences between classrooms in addition to the magnitude of variance within classrooms. The intraclass correlation coefficient (ICC) was computed to summarize the proportion of total variance in student writing achievement that is attributable to differences between classrooms. If the ICC value is >0.058, the differences across groups cannot be neglected and should be explained using more complex models (Cohen, 1988).
Secondly, a level 1 model was employed by incorporating student-level variables, including writing motivation as the principal student-level predictor, along with four relevant covariates (i.e., gender, grade, race/ethnicity, special education status). The level 1 model was designed to examine the effects of student-level predictors on student writing quality.
Thirdly, a level 2 model incorporating teacher-level variables was fitted to test the effects of these variables on student writing quality while accounting for the effects of teacher covariates. The teacher-level variables were categorized into two dimensions. The first dimension consisted of personal and professional attributes of a given teacher, including self-efficacy, writing knowledge, writing ability, and professional development score. The second dimension pertained to teacher instructional effectiveness, focusing on process features, product features, materials, teaching tactics, and class management. By controlling for two demographic covariates, namely gender and educational attainment (i.e., degree), the level 2 model analysis aimed to unpack the unique contribution of teacher-level factors to student writing quality.
Finally, a full model was conducted to examine the cross-level moderator effect. Specifically, the interaction terms between instructional actions at the teacher level and writing motivation at the student level were of primary interest in this study, while six covariates at both student and teacher levels were also included in the full model to control for their potential influence. To ensure accurate and unbiased estimates of the relationship between variables in our HLM, we utilized a strategy of centering variables. Specifically, all student-level variables were centered on the grand mean, while all teacher-level variables were centered on the group mean. This adjustment allowed for easier interpretation of the fixed effect of the level 1 predictor, improved the convergence of the model, and helped to avoid issues of multicollinearity in models with interaction terms. This approach is supported by prior research (Raudenbush and Bryk, 2002; Hayes, 2006) and is a common practice in hierarchical linear modeling.
The full model can be mathematically presented as follows:
where:
rij = random effect for student i in classroom j;
uoj = random effect for classroom j.
HLM models can be evaluated using multiple criteria. The model fit comparison analyses were conducted using one-way ANOVA. The Akaike information criterion (AIC) and Bayesian information criterion (BIC) are commonly used fit indices, where lower values indicate superior model fit. The deviance statistic is another measure of fit for the covariance components of a model, which is calculated as −2 times the log likelihood function. Lower deviance values indicate a better model fit. Additionally, the difference in deviance statistics between two nested models can be used to test the hypothesis of whether additional predictors can improve model fit (Jayetileke, 2021). The difference in statistics follows a chi-square distribution, with degrees of freedom equaling the difference in the number of estimated parameters in the covariance component of the two models (Davison et al., 2002). These criteria are essential in evaluating the adequacy of HLM models and ensuring that the model accurately captures the relationship between variables.
7. Results
7.1. Exploratory data analysis
Table 1 presents the descriptive statistics of the student and teacher measures. Tables 2, 3 present unadjusted bivariate correlations for within-group (student) and for between-group (teacher) measures, respectively. At the student level, student demographic variables, including gender, grade, race/ethnicity, and disability status, were significantly correlated with their writing motivation and quality. Specifically, the positive and moderately strong correlation (r = 0.362, p < 0.01) between grade and paper quality suggested that moving from the grade 4 category to grade 5 category was moderately associated with an increase in quality, Gender was also found to have a positive but relatively low magnitude association (r = 0.117, p < 0.05) with paper quality, suggesting that moving from the male category to female category was associated with an increase in paper quality. Race/ethnicity showed a negative correlation (r = −0.117, p < 0.05) with writing motivation, indicating that moving from White category to non-White category was associated with a decrease in writing motivation. Disability status was found to be significantly associated with both motivation (r = −0.177, p < 0.01) and quality (r = −0.291, p < 0.05), suggesting that students with disabilities tended to demonstrate lower writing motivation and paper quality than typically achieving students. Therefore, these demographic variables were incorporated as covariates in subsequent HLM analyses.
Table 1. Descriptive statistics and coding for the student and teacher measures included in the model.
At the teacher level, teachers' gender and degree information displayed significant associations with other teacher variables. For instance, the weakly positive correlation (r = 0.121, p < 0.05) between gender and teacher writing knowledge indicates that moving from the female category to male category weakly corresponds with an increase in their writing knowledge, or higher writing knowledge tends to co-occur with the male category. In addition, the weakly positive correlation (r = 0.109, p < 0.05) between degree and teacher efficacy implies that moving from teachers with bachelor's degrees to teachers with master's degrees was weakly associated with an increase in their teaching efficacy beliefs, or higher efficacy beliefs tend to co-occur with teachers with a master's degree. This finding is consistent with other studies (e.g., Yilmaz and Çokluk-Bökeoglu, 2008; Orakci and Karagöz, 2023) suggesting that as teachers' level of education progresses, they are likely to develop a more profound comprehension of writing, which may enhance their efficacy beliefs regarding their own writing skills and their effectiveness in teaching writing. Hence, the effects of teacher's gender and degree variables were controlled in the subsequent analyses.
7.2. Unconditional model
To estimate the extent to which writing achievement varied at the student and teacher levels, we initiated our HLM analysis by conducting a one-way random-effects ANOVA model, also referred to as an unconditional model, and included the dependent variable of writing quality as the sole factor. The intercept was found to be significant at 13.66, t(38) = 36.59, p < 0.001, representing the overall average score of writing quality without any predictors in the model. The intraclass correlation coefficient (ICC) was 0.24, indicating that a considerable proportion (i.e., 24%) of the variance in student writing quality could be attributed to differences between classrooms, whereas most of the variance was due to differences between students. As our ICC was above the conventional threshold (i.e., 0.058; Cohen, 1988), further analyses were required to explain the variance related to differences between teachers and students. The ICC result also revealed the nested data structure of this study, making HLM an appropriate approach for examining our data. Furthermore, Figure 2 displays students' writing motivation and quality scores within each class, reinforcing the nested nature of the data and the necessity for multilevel modeling analysis. The varying slopes depicted in Figure 2 indicate that the factors contributing to the variability between classrooms needs to be explained in the subsequent models. The HLM results are given in Table 4.
Figure 2. Student writing motivation, quality scores, and their relational slopes disaggregated by teacher/classroom. Each box in the figure represents a unique teacher ID (n = 41).
7.3. Level 1 model: student-level
The level 1 model was employed to investigate the associations between students' writing motivational beliefs and writing quality while holding the four covariates constant. Results from the level 1 model supported our proposed Hypothesis 1 that student writing motivation had a positive effect on their writing quality, with a one-scale point increase in writing motivation resulting in a 1.61-point increase in writing quality. Moreover, the results revealed that students who were in fifth grade, female, and typically achieving had significantly better writing performance than their counterparts.
Incorporating student-level predictors into the model accounted for ~32% of the between-class variance in writing quality, while the estimated within-class variance decreased from 0.24 in the unconditional model to 0.14 in the student-level model. The reduction in within-class variance suggested that the addition of student-level predictors was not able to account for a significant portion of the within-group variability in writing achievement, and/or there may be other unmeasured factors that were influencing writing achievement at the student level. Furthermore, based on the model fit comparison (see Table 4), the resulting level 1 model demonstrated a significantly better goodness of fit [χ2(5) = 121.96, p < 0.001] than the unconditional model, indicating that the integration of student-level predictors significantly improved the model's ability to explain the variance in writing quality.
7.4. Level 2 model: teacher-level
The level 2 model was utilized to further explore the factors that influence student writing achievement by adding teacher-level predictors based on personal and professional attributes, as well as instructional actions. After controlling for two demographic covariates (namely gender and degree), our analysis revealed that, while teacher personal and professional characteristics did not significantly affect student writing quality, there were some notable effects observed between teacher instruction and student writing performance. Specifically, the use of effective teaching tactics, such as modeling, explanation, summarizing, and questioning, had a positive impact (γ = 0.66, p < 0.10) on student writing quality, while the frequent use of class management strategies had a negative effect (γ = −0.74, p < 0.10). Our findings highlighted the importance of effective teaching practices in shaping student writing quality. Effective teaching strategies, such as giving clear writing directions, facilitating discussions about writing-related issues, and using questioning techniques to gauge understanding, can enhance student writing performance. Conversely, instructional strategies that aim to monitor, support, alter, or control student writing behaviors may impede student writing achievement to some extent.
It is important to acknowledge that we applied a less stringent criterion for significance testing (i.e., p < 0.10) to interpret the results. The decision was made with the aim of increasing the likelihood of detecting interaction effects that hold theoretical importance while mitigating the risk of overfitting, which can arise when including too many variables in a model with a limited sample size (Scherbaum and Ferreter, 2009). Moreover, a significance level of 0.10 also was utilized to interpret the interaction results in the subsequent analyses. It is crucial to recognize that this approach introduces a limitation to the study.
By incorporating the main effects of teacher-level predictors, our level 2 model demonstrated an improved capability to account for 40% of the between-class variance in student writing achievement, resulting in a decrease in the estimated within-class variance by 0.08. Comparing the level 2 model to the level 1 model, level 2 model exhibited a better goodness of fit, as evidenced by its decreased deviation value of 1775.4 and a higher fit statistic [χ2(11) = 18.754, p = 0.06]. These findings suggest that the level 2 model is more effective in predicting data and provides a more accurate representation of the factors that impact student writing achievement.
7.5. Full model: moderating effect of teacher's instructional practices
Finally, a full model with multiple cross-level interaction terms was used to examine the joint effects of students' motivational beliefs and teachers' writing instructional practices on writing achievement. The findings showed that, at the student-level, gender, grade, and disability status remained significant predictors of writing quality, whereas the main effect of student motivational beliefs was no longer significant. However, we indeed found that student motivational beliefs had weak but significant interaction effects when combined with other writing instructional practices variables. This suggested that the effect of student writing motivation may be modified by other variables with which it interacted in a more complex model, such as teachers' implementation of certain writing instructional practices.
The findings indicated that the interaction term between student motivation and teacher instruction on process features was marginally significant and negative (γ = −1.27, p < 0.1), indicating that the relationship between student motivational beliefs and their writing achievement was moderated by the frequency of teacher instruction on process features. Specifically, the negative effect of student motivation on their writing achievement was found to be marginally significantly stronger when teacher instruction on process features was more frequent, compared to when it was less frequent. The observed decrease in the scale of the effect was weakened by a value of 1.27 units.
The interaction term of motivation × materials was also marginally significant and negative (γ = −0.60, p < 0.1), suggesting that the relationship between student motivational beliefs and their writing achievement was moderated by the more frequent use of materials in writing class. Specifically, the negative impact of student motivation on their writing achievement was found to be marginally significantly stronger when the frequency of utilizing materials in the writing class was higher compared to when it was lower. The observed decrease in the scale of the effect was weakened by a value of 0.60 units.
Conversely, the interaction term between student motivation and the frequency of utilizing teaching tactics in the writing class was marginally significant and positive (γ = 0.59, p < 0.1), indicating that the relationship between student motivational beliefs on writing and their writing achievement was moderated by the frequency of employing teaching tactics in the writing class. Specifically, the positive effect of student motivation on their writing achievement was found to be more evident when there was increased frequency of utilizing teaching tactics in the writing class compared to when it was lower. The observed increment in the scale of the effect was increased by a value of 0.59 units.
The full model, which included five pairs of interaction terms, did not significantly improve the fit of the model compared to the level 2 model, as indicated by the ANOVA chi-square test χ2(5) = 8.066, p = 0.15. In other words, the difference in fit between the level 2 model and full model is not statistically significant. While this non-significant result may suggest issues with statistical power or small sample size, it is important to note that the additional predictors in the full model may still be important and meaningful in explaining the outcome variable. It is noteworthy that the full model showed a slightly lower capability in explaining between-class variance in student writing achievement compared to the level 2 model, with a decrease of 2%. However, the full model demonstrated an increase of 6% in its predictive ability for explaining variance in writing achievement within classrooms.
7.6. Summary of results
The results of bivariate correlational analyses and level 1 model, as presented in Tables 2–4, revealed that all student-level variables, except race/ethnicity, were significantly related to student writing achievement. However, only two teacher variables, namely teaching tactics and class management, exhibited significant effects on writing achievement but with different directional impacts, as demonstrated by the level 2 model results. The HLM analysis revealed that writing motivation had a positive predictive effect on writing achievement, as evident from significant results in both student- and teacher-level models.
Despite student motivation being non-significant in the final HLM analysis, our study identified significant interaction effects between motivational beliefs and instructional practices on writing achievement. Specifically, our findings suggested that students with high motivation were more likely to demonstrate better writing outcomes in a classroom setting where writing instruction emphasized fewer process features and materials but utilized more teaching tactics, compared to classrooms with the opposite characteristics. Table 5 provides a summary of the results our proposed hypotheses.
8. Discussion and implications
Within the academic domain of writing, state content standards exert significant influence on guiding content and pedagogical approaches adopted by educators (Troia and Graham, 2016; Baez-Hernandez, 2019). Despite concerted efforts to incorporate a diverse array of writing task types and increase writing time across the curriculum, the impact of these standards on classroom instruction and subsequent writing outcomes may be curtailed due to the inadequate quantity and quality of writing practices provided throughout the United States (Graham et al., 2012). Additionally, the significant variability among teachers in terms of their experiences, values, beliefs, and attitudes toward writing proficiency and instruction poses a formidable challenge in implementing coordinated and effective writing instructional practices across diverse classrooms (Perry, 1998). This complexity necessitates a multifaceted approach when attempting to teach writing effectively and efficiently. Therefore, the aim of this study was to shed light on instructional practices and professional traits associated with writing that can promote students' motivation and performance. Our findings suggest an interrelated and integrated array of teachers' professional traits and instructional actions that can influence students' writing motivation and proficiency. Moreover, we observed that certain instructional practices targeting different aspects of developing students' writing performance can moderate the predictive power between students' writing motivation and their writing quality. Our findings not only validate students' writing strengths and weaknesses at the individual level, but also offer valuable insights for educators on implementing effective practices at the teacher level.
8.1. Student-level predictors of writing achievement
The outcomes of the student-level analysis indicated a significant association between students' motivational beliefs and their writing achievement, regardless of student demographics. Specifically, students who displayed a strong inclination toward writing, assigned value to producing multiple written products, and demonstrated confidence in their writing ability, tended to outperform in writing tasks compared to those who felt overwhelmed, frustrated, and lacked motivation toward writing. These findings were consistent with earlier research studies on writing motivation and achievement conducted by Pajares (2003), Graham et al. (2007), and Wilson and Trainin (2007), which also provided evidence of a significant positive correlation between writing motivation and achievement.
Furthermore, we explored the impact of students' sociodemographic characteristics on their writing achievement. Our analysis revealed that female students, fifth graders, and typically achieving students tended to produce higher quality writing than their male, fourth grade, and struggling counterparts. These findings aligned with prior research suggesting that gender (De Smedt et al., 2018), grade level (Shell et al., 1995), and learning ability (Troia and Graham, 2016) may have an impact on writing achievement, and should therefore be considered when designing writing instruction for elementary-aged children. Although the underlying reasons for these findings are not entirely evident, it is anticipated that girls, older students, and typically achieving students may have a more accurate understanding of their writing abilities, possess more advanced writing skills and strategies, set clearer goals for the writing process and product, and develop a theory of mind to understand their audience (Graham and Perin, 2007). Hence, students with these demographic characteristics are likely to develop into more advanced and sophisticated writers. Our results reinforce the notion that student motivational beliefs are malleable and can be influenced by various factors such as cultural background, personal interests, prior experience, and other individual traits (Pajares, 2003).
When examining the impact of student-level variables on writing achievement between classrooms, our study revealed that these factors accounted for a relatively lower proportion of the variance (i.e., 32%) compared to similar studies that employed multilevel analysis methods (e.g., Coker et al., 2018; Los and Schweinle, 2019) to explain writing outcomes. It is important to note that our study did not place primary emphasis on student-level factors, nor did we include other writing-related skills that have been found to significantly impact writing achievement, such as handwriting fluency, basic reading ability, and spelling, as was done in Coker et al.'s (2018) study. Future research could incorporate other student-related factors, such as writing knowledge and strategies, to capture a more comprehensive range of individual differences that may contribute to writing achievement.
The findings of our student-level analysis hold important implications for both preservice and in-service educators seeking to provide effective writing instruction for elementary-aged children. Firstly, along with considering the content and structure of the writing curriculum to benefit their students, it is also essential to consider individual student-level factors and tailor their instruction to meet the specific needs of each student to boost their motivation and writing achievement. To achieve this, educators should adopt a student-centered approach that acknowledges the social and cultural diversity of students' backgrounds and their unique motivational beliefs (see Land et al., 2012). Professional development opportunities should also be provided to educators to enhance their understanding of student motivation and effective writing instruction, particularly for students who are struggling or disengaged. By leveraging students' individual strengths and interests, educators can create a respectful, supportive, and engaging writing environment that fosters motivation and facilitates writing achievement for all students (Tucker, 2012).
Additionally, educators should consider providing targeted writing instruction and support for struggling students, including those who lack motivation or confidence in their writing ability, to help them overcome writing challenges and achieve writing success. This finding was also consistent with a prior study (Troia et al., 2022) that classified the same sample of students used here into five distinct written profiles, where motivation was identified as a critical writing-related measure that distinguished their profiles and further affected their writing quality in narrative, persuasive, and informative essays. To address the needs of unmotivated writers, instructional scaffolds with motivational elements, including self-regulatory activities to maintain motivation and individualize treatment (Zimmerman and Bandura, 1994) may be beneficial to keep students motivated and prevent them from falling behind.
8.2. Teacher-level predictors of writing achievement
While individual differences among students are undoubtedly significant contributors to the complexity of their writing achievement, it is essential not to overlook the impact of teacher/classroom-level factors in explaining the variance in writing achievement between classrooms. Our analysis revealed that teacher-level predictors significantly accounted for an additional 8% of the variance in explaining writing achievement beyond student-level factors.
In our study, we examined two dimensions of teacher-level factors. The first dimension of teacher-level factors was investigated, specifically the quantity of teaching practices across varied aspects of instruction. Our analyses revealed that teaching tactics were positively associated with student writing achievement, whereas class management was adversely related to student writing achievement. However, we did not observe any statistically significant impact on student writing achievement for other aspects of teacher actions. These findings suggest that the positive effect of teaching tactics on student writing achievement may be attributed to their ability to create a supportive and engaging learning environment through modeling, questioning, suggestions, feedback, and so forth, which can enhance student motivation and confidence in writing (Kapka and Oberman, 2001; Tienken and Achilles, 2003). On the other hand, excessive class management practices can disrupt student learning and negatively impact their motivation to write (Franklin and Harrington, 2019). Regarding the non-significant effects, it is possible that these effects were confounded by other factors. To explore this possibility further, we conducted a moderating analysis and found that some of the other teaching aspects had a significant impact on student writing achievement when motivation served as a moderator. The interacting relationships are discussed in a subsequent section.
Another domain involved investigating the impact of teachers' personal and professional traits on student writing achievement. However, we did not find any statistically significant effects of teacher degree, gender, efficacy beliefs, writing knowledge, writing ability, or professional development on student writing achievement. There are various reasons that could explain these findings. Firstly, our result was consistent with prior research that proved no significant relationship between teacher qualifications and student academic achievement (Huang and Moon, 2009; Kosgei et al., 2013). Secondly, the measures used to assess teacher-level factors in this study may not have been sensitive or specific enough to capture the nuances of these constructs. For example, self-efficacy beliefs are multifaceted and intricate constructions, and a narrow or insufficient measure may not be able to capture the full range of nuances in this construct. Similarly, for writing knowledge, we only analyzed teachers' writing ability in spelling and written expression using a standardized test (the WIAT-II), thereby neglecting the complex nature of this construct. Thirdly, it is also possible that teacher-level factors interact with other contextual factors; therefore, the effect of teacher-level factors may be masked or moderated by other factors. Hence, future study should investigate these contextual factors to obtain a more comprehensive understanding of the complex interplay between teacher-level factors and student writing achievement.
Our analysis of teacher-level factors has important implications. While we did not observe significant associations between teachers' personal and professional characteristics and student writing achievement, this does not necessarily imply that teachers should not strive to develop their own expertise and ability for teaching writing. Instead, we propose integrating these factors into a school district's accountability system can provide valuable empirical insights into the multifaceted process of teacher evaluation (see Kupermintz, 2003). Although it may be challenging to define the hallmarks of effective teachers, effective instructional practices can be identified and honed. When data on teacher effectiveness are coupled with professional development opportunities that concentrate on improving instructional characteristics and teaching behaviors, the ultimate result can be improved educational success for the majority of students (Stronge, 2006).
8.3. Moderating role of teachers' instructional effectiveness between student motivation and achievement
Our study has revealed three interaction effects at a significance level of 0.10. First, the interaction term of motivation × process was found to have negative impact on student writing achievement. This finding implies that, in classes where writing instruction on process features was infrequent, student motivation had a strong predictive effect on their writing achievement. It also can be interpreted that for students with lower writing motivation, providing writing instruction focused on process features was found to have a stronger predictive effect on their writing achievement; conversely, for students with higher writing motivation, such instruction may not provide as much benefit in facilitating their performance.1 This finding is in line with the notion that process-oriented instruction involves providing direct strategy instruction and scaffolded practice that integrates a set of theories, procedures, and activities into multiple writing processes such as planning, drafting, and revising. Previous research has suggested that such guided instruction can be effective in boosting writing performance and can be particularly beneficial for demotivated students (e.g., Collins, 1998; Lamb, 2017). Additionally, the literature also indicates that more experienced and mature writers typically use writing processes to compose essays, implying that motivated writers may have the capability to leverage their own self-regulation and may not derive as much benefit from guided instruction (e.g., Graham and Harris, 1996; Cleary and Zimmerman, 2004).
The second significant interaction effect we observed was between motivation and the utilization of writing materials during classes, which had a negative impact on student writing achievement. This suggests that in classes where writing materials such as graphic organizers, revision checklists, and word walls were infrequently utilized, student motivation had a strong predictive power on their writing achievement. In other words, for students with lower writing motivation, utilizing materials was found to have a stronger predictive effect on their writing achievement, whereas such teaching practices may not greatly profit students with higher writing motivation. This aligns with prior research that providing optimal learning materials can be engaging for unmotivated students and can provide additional support for their writing development with an effect size of 0.82 (see Graham and Perin, 2007).
Third, the interaction term of motivation × teaching tactics was found to positively influence student writing achievement. The result indicates that in writing classes where teaching tactics such as modeling, explanation, questioning, and conferencing/discussion were frequently employed, student motivation had a strong predictive effect on their writing achievement. Specifically, for students with high writing motivation, these instructional tactics were found to have a stronger predictive effect on their writing achievement, while for students with lower writing motivation, providing such instruction may not be as beneficial for facilitating their achievement. Effective and adequate teaching tactics can contribute to a positive learning environment and promote student engagement, ultimately leading to better academic performance. Our findings are consistent with previous research suggesting that teachers can establish positive relationships with the students and enhance their writing performance by providing varied instructional assistance, including modeling, demonstration, and discussion, as well as offering positive feedback and reinforcement for the use of writing strategies, and granting students more autonomy in selecting their writing topics (Troia et al., 2012; Bruning and Kauffman, 2016; Philippakos, 2020). Additionally, the finding that low-motivated students may not gain as much from teaching tactics is likely due to their lack of intrinsic drive and interest, which can hinder their ability to remain attentive and receptive during teacher-led instruction. To address this issue, educators may opt for incorporating instructional models such as the self-regulated strategy development approach, which involves teacher modeling followed by independent student practice and hands-on activities that have been demonstrated to promote creativity and boost student engagement (Harris et al., 2008). This approach provides opportunities for students to take an active role in their learning and apply concepts and strategies in meaningful and interactive ways, because relying solely on modeling and explaining strategies may prove inadequate for many students (Harris and Graham, 1999). It is also noted that the frequency of class management has a negative impact on student writing achievement in the full model, although this was not an interaction effect. Excessive classroom management activities may impede the time allocated for writing activities and disrupt teachers' planned instruction, leading to a shift in focus away from writing instruction (Marzano et al., 2003). In addition, the frequent use of punitive management strategies during class may decrease students' motivation to learn (Rahimi and Karkami, 2015). Previous research has shown that effective writing classes typically encounter disruptive behavior incidents approximately once every 2 h, while ineffective classes may experience such incidents as frequently as every 12 min (Stronge et al., 2007). It is crucial to maintain a balanced approach to class management that does not detract from writing instruction and avoids frequent disruptions that can interfere with students' learning.
9. Conclusions
Different from prior studies that relied on bivariate correlations or simple regression analyses to explore relationships, the present study addresses a major gap in the literature on cross-level effects by utilizing multilevel analysis within our nested dataset. We aimed to investigate how students with varying levels of motivation may benefit from specific teaching strategies to enhance their writing achievement. Future studies could expand upon our work by incorporating additional student-level predictors, which would allow for targeted instruction based on individual student characteristics. It is also important to acknowledge that our study primarily relied on quantitative observation data to examine the presence or absence of specific writing instructional actions employed by teachers in their writing class, rather than delving into the intricates of their implementation. For instance, we found a negative moderating effect of teaching materials on students' writing achievement. However, it is essential to recognize that simply providing students with tools or resources without adequate guidance may not positively moderate the relationship between motivation and performance. Conversely, if students are provided with the same tools along with the knowledge and skills to effectively utilize these materials, it might yield a positive moderating effect on the relationship between motivation and performance. Future research utilizing qualitative methods can offer a more nuanced exploration of the utilization of these instructional actions, allowing for a richer understanding of their effects on students' writing performance.
Although we did not find any significant effects of teacher personal or professional characteristics on student writing achievement, it is arbitrary to suggest that these factors are not important. In fact, teacher efficacy beliefs and writing expertise can enhance their effectiveness as both writers and educators, and may ultimately influence their instructional efficiency and promote a positive learning environment. Furthermore, our study emphasizes the importance of caution when implementing teaching tactics, given that students with varying levels of motivation may exhibit different levels of response to these instructional approaches. This finding has significant implications for educational practitioners, as it suggests the need for differentiated instruction that caters to the unique needs and characteristics of each student, to ensure that all students are engaged and motivated to learn.
Data availability statement
The original contributions presented in the study are included in the article/Supplementary material, further inquiries can be directed to the corresponding author.
Ethics statement
The studies involving human participants were reviewed and approved by Social Science Behavioral/Education Institutional Review Board, Michigan State University. Written informed consent to participate in this study was provided by the participants' legal guardian/next of kin.
Author contributions
Conceptualization: HW and GT. Methodology, formal analysis, and writing—original draft preparation: HW. Writing—review and editing, project administration, and funding acquisition: GT. All authors have read and agreed to the submit the manuscript.
Funding
This research was supported in part by grant #R305A160049 from the U.S. Department of Education, Institute of Education Sciences, to Michigan State University. Statements do not necessarily reflect the positions or policies of this agency, and no official endorsement by it should be inferred.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyg.2023.1213929/full#supplementary-material
Footnotes
1. ^Interaction term indicates a bidirectional relationship. Therefore, we interpreted both directions of the interaction effects, whether motivation was the moderator or instructional practices were the moderator. The same approach for interpretation was taken for other interaction terms in this study. This allowed us to comprehensively explore the relationship between motivation, instructional practices, and writing outcomes.
References
Alves-Wold, A., Walgermo, B. R., McTigue, E., and Uppstad, P. H. (2023). Assessing writing motivation: a systematic review of K-5 students' self-reports. Educ. Psychol. Rev. 35, 24. doi: 10.1007/s10648-023-09732-6
Anderson, D. (2012). Hierarchical linear modeling (HLM): an introduction to key concepts within cross-sectional and growth modeling frameworks. Technical Report# 1308. Behav. Res. Teach. Available online at: https://files.eric.ed.gov/fulltext/ED545279.pdf (accessed July 7, 2023).
Baez-Hernandez, R. A. (2019). Impact of instructional alignment workshop on teachers' self-efficacy and perceived instruction performance. Educ. Reform J. 4, 1–13. doi: 10.22596/erj2019.04.01.1.13
Boscolo, P., and Gelati, C. (2019). “Motivating writers,” in Best Practices in Writing Instruction, eds S. Graham, C. A. MacArthur, and M. A. Hebert, 3rd ed. (New York, NY: Guilford Press), 51–78.
Boscolo, P., and Hidi, S. (2006). “The multiple meanings of motivation to write,” in Writing and Motivation, eds S. Hidi, and P. Boscolo (Boston, MA: Brill), 1–14. doi: 10.1163/9781849508216_002
Bradshaw, C. P., Koth, C. W., Thornton, L. A., and Leaf, P. J. (2009). Altering school climate through school-wide positive behavioral interventions and supports: findings from a group-randomized effectiveness trial. Prevent. Sci. 10, 100–115. doi: 10.1007/s11121-008-0114-9
Bresina, B. C., and McMaster, K. L. (2020). Exploring the relation between teacher factors and student growth in early writing. J. Learn. Disabil. 53, 311–324. doi: 10.1177/0022219420913543
Brouwer, K. L. (2012). Writing motivation of students with language impairments. Child Lang. Teach. Ther. 28, 189–210. doi: 10.1177/0265659012436850
Bruning, R., and Kauffman, D. F. (2016). “Self-efficacy beliefs and motivation in writing development,” in Handbook of Writing Research, eds C. MacArthur, S. Graham, and J. Fitzgerald (New York, NY: The Guilford Press), 160–173.
Cajkler, W., and Hislam, J. (2002). Trainee teachers' grammatical knowledge: the tension between public expectation and individual competence. Lang. Aware. 11, 161–177. doi: 10.1080/09658410208667054
Camacho, A., Alves, R. A., and Boscolo, P. (2021). Writing motivation in school: a systematic review of empirical research in the early twenty-first century. Educ. Psychol. Rev. 33, 213–247. doi: 10.1007/s10648-020-09530-4
Ciullo, S., and Reutebuch, C. (2013). Computer-based graphic organizers for students with LD: a systematic review of literature. Learn. Disabil. Res. Pract. 28, 196–210. doi: 10.1111/ldrp.12017
Cleary, T. J., and Zimmerman, B. J. (2004). Self-regulation empowerment program: a school-based program to enhance self-regulated and self-motivated cycles of student learning. Psychol. Sch. 41, 537–550. doi: 10.1002/pits.10177
Clunies-Ross, P., Little, E., and Kienhuis, M. (2008). Self-reported and actual use of proactive and reactive classroom management strategies and their relationship with teacher stress and student behaviour. Educ. Psychol. 28, 693–710. doi: 10.1080/01443410802206700
Coker, D. L. Jr., Jennings, A. S., Farley-Ripple, E., and MacArthur, C. A. (2018). When the type of practice matters: the relationship between typical writing instruction, student practice, and writing achievement in first grade. Contemp. Educ. Psychol. 54, 235–246. doi: 10.1016/j.cedpsych.2018.06.013
Collins, J. L. (1998). Strategies for Struggling Writers. New York, NY: Guilford Press. doi: 10.2307/358940
Conroy, M., Marchand, T., and Webster, M. (2009). Motivating Primary Students to Write Using Writer's Workshop. Online Submission. Available online at: https://eric.ed.gov/?id=ED504817 (accessed April 24, 2023).
Cordeiro, C., Limpo, T., Olive, T., and Castro, S. L. (2020). Do executive functions contribute to writing quality in beginning writers? A longitudinal study with second graders. Read. Writ. 33, 813–833. doi: 10.1007/s11145-019-09963-6
Corkett, J., Hatt, B., and Benevides, T. (2011). Student and teacher self-efficacy and the connection to reading and writing. Can. J. Educ. 34, 65–98. Available online at: https://www.jstor.org/stable/canajeducrevucan.34.1.65 (accessed July 7, 2023).
Crossley, S. A., and McNamara, D. S. (2016). Say more and be more coherent: how text elaboration and cohesion can increase writing quality. J. Writ. Res. 7, 351–370. doi: 10.17239/jowr-2016.07.03.02
Cutler, L., and Graham, S. (2008). Primary grade writing instruction: a national survey. J. Educ. Psychol. 100, 907. doi: 10.1037/a0012656
Datnow, A., Borman, G. D., Stringfield, S., Overman, L. T., and Castellano, M. (2003). Comprehensive school reform in culturally and linguistically diverse contexts: implementation and outcomes from a four-year study. Educ. Eval. Policy Anal. 25, 143–170. doi: 10.3102/01623737025002143
Davison, M. L., Kwak, N., Seo, Y. S., and Choi, J. (2002). Using hierarchical linear models to examine moderator effects: person-by-organization interactions. Organ. Res. Methods 5, 231–254. doi: 10.1177/1094428102005003003
De Smedt, F., Merchie, E., Barendse, M., Rosseel, Y., De Naeghel, J., Van Keer, H., et al. (2018). Cognitive and motivational challenges in writing: studying the relation with writing performance across students' gender and achievement level. Read. Res. Q. 53, 249–272. doi: 10.1002/rrq.193
De Smedt, F., and Van Keer, H. (2014). A research synthesis on effective writing instruction in primary education. Proc.-Soc. Behav. Sci. 112, 693–701. doi: 10.1016/j.sbspro.2014.01.1219
Deane, P. (2011). Writing assessment and cognition. ETS Res. Rep. Ser. 2011, i-60. doi: 10.1002/j.2333-8504.2011.tb02250.x
Doubet, K., and Southall, G. (2017). Integrating reading and writing instruction: the role of professional development in shaping teacher perceptions and practices. Lit. Res. Instr. 56, 1–21. doi: 10.1080/19388071.2017.1366607
Fearn, L., and Farnan, N. (2007). The influence of professional development on young writers' writing performance. Action Teach. Educ. 29, 17–28. doi: 10.1080/01626620.2007.10463445
Franklin, H., and Harrington, I. (2019). A review into effective classroom management and strategies for student engagement: Teacher and student roles in today's classrooms. J. Educ. Train. Stud. 7, 1–12. doi: 10.11114/jets.v7i12.4491
Gonzalez, A., Peters, M. L., Orange, A., and Grigsby, B. (2017). The influence of high-stakes testing on teacher self-efficacy and job-related stress. Camb. J. Educ. 47, 513–531. doi: 10.1080/0305764X.2016.1214237
Goroshit, M., and Hen, M. (2016). Teachers' empathy: can it be predicted by self-efficacy? Teach. Teach. 22, 805–818. doi: 10.1080/13540602.2016.1185818
Graham, S. (2018). A revised writer (s)-within-community model of writing. Educ. Psychol. 53, 258–279. doi: 10.1080/00461520.2018.1481406
Graham, S. (2019). Changing how writing is taught. Rev. Res. Educ. 43, 277–303. doi: 10.3102/0091732X18821125
Graham, S., Berninger, V., and Fan, W. (2007). The structural relationship between writing attitude and writing achievement in first and third grade students. Contemp. Educ. Psychol. 32, 516–536. doi: 10.1016/j.cedpsych.2007.01.002
Graham, S., Courtney, L., Marinis, T., and Tonkyn, A. (2017a). Early language learning: the impact of teaching and teacher factors. Lang. Learn. 67, 922–958. doi: 10.1111/lang.12251
Graham, S., Daley, S. G., Aitken, A. A., Harris, K. R., and Robinson, K. H. (2018). Do writing motivational beliefs predict middle school students' writing performance? J. Res. Read. 41, 642–656. doi: 10.1111/1467-9817.12245
Graham, S., and Harris, K. R. (1996). “Self-regulation and strategy instruction for students who find writing and learning challenging,” in The Science of Writing: Theories, Methods, Individual Differences, and Applications, eds C. M. Levy and S. Ransdell (Mahwah, NJ: Lawrence Erlbaum Associates, Inc), 347–360.
Graham, S., and Harris, K. R. (2013). Common core state standards, writing, and students with LD: recommendations. Learn. Disabil. Res. Pract. 28, 28–37. doi: 10.1111/ldrp.12004
Graham, S., Harris, K. R., Fink, B., and MacArthur, C. A. (2001). Teacher efficacy in writing: a construct validation with primary grade teachers. Sci. Stud. Read. 5, 177–202. doi: 10.1207/S1532799Xssr0502_3
Graham, S., Harris, K. R., Kiuhara, S. A., and Fishman, E. J. (2017b). The relationship among strategic writing behavior, writing motivation, and writing performance with young, developing writers. Elem. Sch. J. 118, 82–104. doi: 10.1086/693009
Graham, S., McKeown, D., Kiuhara, S., and Harris, K. R. (2012). A meta-analysis of writing instruction for students in the elementary grades. J. Educ. Psychol. 104, 879. doi: 10.1037/a0029185
Graham, S., and Perin, D. (2007). A meta-analysis of writing instruction for adolescent students. J. Educ. Psychol. 99, 445. doi: 10.1037/0022-0663.99.3.445
Graham, S., and Sandmel, K. (2011). The process writing approach: a meta-analysis. J. Educ. Res. 104, 396–407. doi: 10.1080/00220671.2010.488703
Grossman, P., Hammerness, K., and McDonald, M. (2009). Redefining teaching, re-imagining teacher education. Teach. Teach. Theory Pract. 15, 273–289. doi: 10.1080/13540600902875340
Guskey, T. R. (1982). The effects of change in instructional effectiveness on the relationship of teacher expectations and student achievement. J. Educ. Res. 75, 345–349. doi: 10.1080/00220671.1982.10885407
Handtke, K., and Bögeholz, S. (2019). Self-efficacy beliefs of interdisciplinary science teaching (SElf-ST) instrument: drafting a theory-based measurement. Educ. Sci. 9, 247. doi: 10.3390/educsci9040247
Harris, K. R., and Graham, S. (1999). Programmatic intervention research: illustrations from the evolution of self-regulated strategy development. Learn. Disabil. Q. 22, 251–262. doi: 10.2307/1511259
Harris, K. R., and Graham, S. (2016). Self-regulated strategy development in writing: policy implications of an evidence-based practice. Policy Insights Behav. Brain Sci. 3, 77–84. doi: 10.1177/2372732215624216
Harris, K. R., Santangelo, T., and Graham, S. (2008). Self-regulated strategy development in writing: going beyond NLEs to a more balanced approach. Instr. Sci. 36, 395–408. doi: 10.1007/s11251-008-9062-9
Hayes, A. F. (2006). A primer on multilevel modeling. Hum. Commun. Res. 32, 385–410. doi: 10.1111/j.1468-2958.2006.00281.x
Hayes, J. R. (1996). A new framework for understanding cognition and affect in writing,” in The Science of Writing: Theories, Methods, Individual Differences, and Applications, eds C. M. Levy and S. Ransdell Mahwah, NJ: (Lawrence Erlbaum Associates, Inc), 1–27.
Hidi, S., Berndorff, D., and Ainley, M. (2002). Children's argument writing, interest and self-efficacy: an intervention study. Learn. Instr. 12, 429–446. doi: 10.1016/S0959-4752(01)00009-3
Hidi, S., and Boscolo, P. (2006). Motivation and writing. Handb. Writ. Res. 144, 304–310. doi: 10.1163/9781849508216
Hier, B. O., and Mahony, K. E. (2018). The contribution of mastery experiences, performance feedback, and task effort to elementary-aged students' self-efficacy in writing. Sch. Psychol. Q. 33, 408. doi: 10.1037/spq0000226
Hochweber, J., Hosenfeld, I., and Klieme, E. (2014). Classroom composition, classroom management, and the relationship between student attributes and grades. J. Educ. Psychol. 106, 289. doi: 10.1037/a0033829
Hofstetter, F. (2016). ISeeNcode (Version 1.2.) [Mobile Application Software]. Available online at: https://itunes.apple.com/us/app/iseencode/id1084763871?mt=8 (accessed July 7, 2023).
Huang, F. L., and Moon, T. R. (2009). Is experience the best teacher? A multilevel analysis of teacher characteristics and student achievement in low performing schools. Educ. Assess. Eval. Account 21, 209–234. doi: 10.1007/s11092-009-9074-2
Huang, R., and Shimizu, Y. (2016). Improving teaching, developing teachers and teacher educators, and linking theory and practice through lesson study in mathematics: An international perspective. ZDM Math. Educ. 48, 393–409. doi: 10.1007/s11858-016-0795-7
James, K. H., Jao, R. J., and Berninger, V. (2017). “The development of multileveled writing systems of the brain: brain lessons for writing instruction,” in The Handbook of Writing Research, eds C. A. MacArthur, S. Graham, and J. Fitzgerald, 2nd ed. (New York, NY: Guilford Press), 116–129.
Jayetileke, H. L. (2021). Bias, Bias Reduction and Implications in Predictive Regression [Doctoral dissertation]. Brisbane, QLD: Queensland University of Technology.
Kapka, D., and Oberman, D. A. (2001). Improving Student Writing Skills through the Modeling of the Writing Process. Washington, DC: ERIC Clearinghouse.
Karlen, Y., and Compagnoni, M. (2017). Implicit theory of writing ability: relationship to metacognitive strategy knowledge and strategy use in academic writing. Psychol. Learn. Teach. 16, 47–63. doi: 10.1177/1475725716682887
Kim, Y. S. G., Yang, D., Reyes, M., and Connor, C. (2021). Writing instruction improves students' writing skills differentially depending on focal instruction and children: a meta-analysis for primary grade students. Educ. Res. Rev. 34, 100408. doi: 10.1016/j.edurev.2021.100408
Kosgei, A., Mise, J. K., Odera, O., and Ayugi, M. E. (2013). Influence of teacher characteristics on students' academic achievement among secondary schools. J. Educ. Pract. 4, 76–82. Available online at: https://www.iiste.org/Journals/index.php/JEP/article/view/4495 (accessed July 7, 2023).
Koster, M., Tribushinina, E., de Jong, P. F., and van den Bergh, H. (2015). Teaching children to write: a meta-analysis of writing intervention research. J. Writ. Res. 7, 249–274. doi: 10.17239/jowr-2015.07.02.2
Kunter, M., Baumert, J., and Köller, O. (2007). Effective classroom management and the development of subject-related interest. Learn. Instr. 17, 494–509. doi: 10.1016/j.learninstruc.2007.09.002
Kupermintz, H. (2003). Teacher effects and teacher effectiveness: a validity investigation of the tennessee value added assessment system. Educ. Eval. Policy Anal. 25, 287–298. doi: 10.3102/01623737025003287
Lam, S. F., and Law, Y. K. (2007). The roles of instructional practices and motivation in writing performance. J. Exp. Educ. 75, 145–164. doi: 10.3200/JEXE.75.2.145-164
Lamb, M. (2017). The motivational dimension of language teaching. Lang. Teach. 50, 301–346. doi: 10.1017/S0261444817000088
Land, S. M., Hannafin, M. J., and Oliver, K. (2012). “Student-centered learning environments: foundations, assumptions and design,” in Theoretical Foundations of Learning Environments, eds S. Land, and D?. Jonassen (London: Routledge), 3–25. doi: 10.4324/9780203813799
Lee, Y., Patterson, P. P., and Vega, L. A. (2011). Perils to self-efficacy perceptions and teacher-preparation quality among special education intern teachers. Teach. Educ. Q. 38, 61–76. Available online at: https://www.jstor.org/stable/23479693 (accessed July 7, 2023).
Lembke, E. S., McMaster, K. L., McKevett, N., Simpson, J., and Birinci, S. (2021). Innovations in early writing intervention: what teachers should know,” in The Next Big Thing in Learning and Behavioral Disabilities, Vol. 31, eds B. G. Cook, M. Tankersley, and T. J. Landrum (Bingley: Emerald Publishing Limited), 173–189. doi: 10.1108/S0735-004X20210000031011
Los, R., and Schweinle, A. (2019). The interaction between student motivation and the instructional environment on academic outcome: a hierarchical linear model. Soc. Psychol. Educ. 22, 471–500. doi: 10.1007/s11218-019-09487-5
Maas, C. J., and Hox, J. J. (2005). Sufficient sample sizes for multilevel modeling. Methodology 1, 86–92. doi: 10.1027/1614-2241.1.3.86
Marzano, R. J., Marzano, J. S., and Pickering, D. (2003). Classroom Management That Works: Research-based Strategies for Every Teacher. Alexandria, VA: ASCD.
Maxwell, S., Reynolds, K. J., Lee, E., Subasic, E., and Bromhead, D. (2017). The impact of school climate and school identification on academic achievement: multilevel modeling with student and teacher data. Front. Psychol. 8, 2069. doi: 10.3389/fpsyg.2017.02069
Mo, Y., and Troia, G. A. (2017). Similarities and differences in constructs represented by US States' middle school writing tests and the 2007 National Assessment of Educational Progress writing assessment. Assess. Writ. 33, 48–67. doi: 10.1016/j.asw.2017.06.001
Mojavezi, A., and Tamiz, M. P. (2012). The impact of teacher self-efficacy on the students' motivation and achievement. Theory Pract. Lang. Stud. 2, 483–491. doi: 10.4304/tpls.2.3.483-491
Morphy, P., and Graham, S. (2012). Word processing programs and weaker writers/readers: a meta-analysis of research findings. Read. Writ. 25, 641–678. doi: 10.1007/s11145-010-9292-5
Myhill, D., Jones, S., and Watson, A. (2013). Grammar matters: how teachers' grammatical knowledge impacts on the teaching of writing. Teach. Teach. Educ. 36, 77–91. doi: 10.1016/j.tate.2013.07.005
NCES (2011). U.S. Department of Education. The Nation's Report Card: Writing 2011. Available online at: https://nces.ed.gov/nationsreportcard/pdf/main2011/2012470.pdf (accessed July 7, 2023).
Olinghouse, N. G. (2008). Student-and instruction-level predictors of narrative writing in third-grade students. Read. Writ. 21, 3–26. doi: 10.1007/s11145-007-9062-1
Orakci, S., and Karagöz, S. (2023). A mixed methods study of the teachers' self-efficacy views and their ability to improve self efficacy beliefs during teaching in Turkey. Front. Psychol. 13, 8037. doi: 10.3389/fpsyg.2022.1035829
Pajares, F. (2003). Self-efficacy beliefs, motivation, and achievement in writing: a review of the literature. Read. Writ. Q. 19, 139–158. doi: 10.1080/10573560308222
Pajares, F., Britner, S. L., and Valiante, G. (2000). Relation between achievement goals and self-beliefs of middle school students in writing and science. Contemp. Educ. Psychol. 25, 406–422. doi: 10.1006/ceps.1999.1027
Pajares, F., and Johnson, M. J. (1996). Self-efficacy beliefs and the writing performance of entering high school students. Psychol. Sch. 33, 163–175. doi: 10.1002/(SICI)1520-6807(199604)33:2<163::AID-PITS10>3.0.CO;2-C
Pajares, F., Johnson, M. J., and Usher, E. L. (2007a). Sources of writing self-efficacy beliefs of elementary, middle, and high school students. Res. Teach. English 42, 104–120. Available online at: https://www.jstor.org/stable/40171749 (accessed July 7, 2023).
Pajares, F., and Valiante, G. (2001). Gender differences in writing motivation and achievement of middle school students: a function of gender orientation? Contemp. Educ. Psychol. 26, 366–381. doi: 10.1006/ceps.2000.1069
Pajares, F., Valiante, G., Cheong, Y. F., Hidi, S., and Boscolo, P. (2007b). Writing and Motivation. 141–162.
Perry, N. E. (1998). Young children's self-regulated learning and contexts that support it. J. Educ. Psychol. 90, 715. doi: 10.1037/0022-0663.90.4.715
Philippakos, Z. A. T. (2020). Developing strategic learners: supporting self-efficacy through goal setting and reflection. Lang. Lit. Spectr. 30, n1. Available online at: https://digitalcommons.buffalostate.edu/lls/vol30/iss1/1
Posnanski, T. J. (2002). Professional development programs for elementary science teachers: an analysis of teacher self-efficacy beliefs and a professional development model. J. Sci. Teacher Educ. 13, 189–220. doi: 10.1023/A:1016517100186
Poulou, M. S., Reddy, L. A., and Dudek, C. M. (2019). Relation of teacher self-efficacy and classroom practices: a preliminary investigation. Sch. Psychol. Int. 40, 25–48. doi: 10.1177/0143034318798045
Pritchard, R. J., and Honeycutt, R. L. (2006). “The process approach to writing instruction: examining its effectiveness,” in Handbook of Writing Research, eds C. MacArthur, S. Graham, and J. Fitzgerald (New York, NY: The Guilford Press), 275–290.
Rahimi, M., and Karkami, F. H. (2015). The role of teachers' classroom discipline in their teaching effectiveness and students' language learning motivation and achievement: a path method. Iran. J. Lang. Teach. Res. 3, 57–82.
Rasteiro, I., and Limpo, T. (2023). Examining longitudinal and concurrent links between writing motivation and writing quality in middle school. Writ. Commun. 40, 30–58. doi: 10.1177/07410883221127701
Raudenbush, S. W., and Bryk, A. S. (2002). Hierarchical Linear Models: Applications and Data Analysis Methods, Vol. 1. London: Sage.
Rimm-Kaufman, S. E., Baroody, A. E., Larsen, R. A., Curby, T. W., and Abry, T. (2015). To what extent do teacher–student interaction quality and student gender contribute to fifth graders' engagement in mathematics learning? J. Educ. Psychol. 107, 170. doi: 10.1037/a0037252
Rimm-Kaufman, S. E., Curby, T. W., Grimm, K. J., Nathanson, L., and Brock, L. L. (2009). The contribution of children's self-regulation and classroom quality to children's adaptive behaviors in the kindergarten classroom. Dev. Psychol. 45, 958. doi: 10.1037/a0015861
Ritchey, K. D., Coker, D. L., and Jackson, A. F. (2015). The relationship between early elementary teachers' instructional practices and theoretical orientations and students' growth in writing. Read. Writ. 28, 1333–1354. doi: 10.1007/s11145-015-9573-0
Roberts, C. A. (2002). The Influence of Teachers' Professional Development at the Tampa Bay Area Writing Project on Student Writing Performance. Tampa, FL: University of South Florida.
Roitsch, J., Gumpert, M., Springle, A., and Raymer, A. M. (2021). Writing instruction for students with learning disabilities: quality appraisal of systematic reviews and meta-analyses. Read. Writ. Q. 37, 32–44. doi: 10.1080/10573569.2019.1708221
Saddler, B., and Graham, S. (2007). The relationship between writing knowledge and writing performance among more and less skilled writers. Read. Writ. Q. 23, 231–247. doi: 10.1080/10573560701277575
Sato, E., and Thompson, K. D. (2020). “Standards-based K−12 English language proficiency assessments in the United States: current policies and practices,” in Assessing English language Proficiency in US K−12 Schools, ed M. K. Wolf (London: Routledge), 19–35. doi: 10.4324/9780429491689-2
Scherbaum, C. A., and Ferreter, J. M. (2009). Estimating statistical power and required sample sizes for organizational research using multilevel modeling. Organ. Res. Methods 12, 347–367. doi: 10.1177/1094428107308906
Schrodt, K. E., Elleman, A. M., FitzPatrick, E. R., Hasty, M. M., Kim, J. K., Tharp, T. J., et al. (2019). An examination of mindset instruction, self-regulation, and writer's workshop on kindergarteners' writing performance and motivation: a mixed-methods study. Read. Writ. Q. 35, 427–444. doi: 10.1080/10573569.2019.1577778
Shapiro, S., Cox, M., Shuck, G., and Simnitt, E. (2016). Teaching for agency: from appreciating linguistic diversity to empowering student writers. Compos. Stud. 44, 31–52. Available online at: https://www.jstor.org/stable/10.2307/compstud.44.1.0031
Shaukat, S., and Iqbal, H. M. (2012). Teacher self-efficacy as a function of student engagement, instructional strategies and classroom management. Pak. J. Soc. Clin. Psychol. 9, 82–85.
Shell, D. F., Colvin, C., and Bruning, R. H. (1995). Self-efficacy, attribution, and outcome expectancy mechanisms in reading and writing achievement: grade-level and achievement-level differences. J. Educ. Psychol. 87, 386. doi: 10.1037/0022-0663.87.3.386
Stronge, J. H. (2006). “Teacher evaluation and school improvement: improving the educational landscape,” in Evaluating Teaching: A Guide to Current Thinking and Best Practice, Vol. 2, ed J. H. Stronge (Thousand Oaks, CA: Corwin Press), 1–23. doi: 10.4135/9781412990202.d4
Stronge, J. H., Ward, T. J., Tucker, P. D., and Hindman, J. L. (2007). What is the relationship between teacher quality and student achievement? An exploratory study. J. Pers. Eval. Educ. 20, 165–184. doi: 10.1007/s11092-008-9053-z
Tienken, C. H., and Achilles, C. M. (2003). Changing teacher behavior and improving student writing achievement. Plan. Changing 34, 153–168.
Troia, G. A., Brehmer, J. S., Glause, K., Reichmuth, H. L., and Lawrence, F. (2020). Direct and indirect effects of literacy skills and writing fluency on writing quality across three genres. Educ. Sci. 10, 297. doi: 10.3390/educsci10110297
Troia, G. A., and Graham, S. (2016). Common core writing and language standards and aligned state assessments: a national survey of teacher beliefs and attitudes. Read. Writ. 29, 1719–1743. doi: 10.1007/s11145-016-9650-z
Troia, G. A., Harbaugh, A. G., Shankland, R. K., Wolbers, K. A., and Lawrence, A. M. (2013). Relationships between writing motivation, writing activity, and writing performance: effects of grade, sex, and ability. Read. Writ. 26, 17–44. doi: 10.1007/s11145-012-9379-2
Troia, G. A., Lin, S. C., Monroe, B. W., and Cohen, S. (2009). “The effects of writing workshop instruction on the performance and motivation of good and poor writers,” in Instruction and Assessment for Struggling Writers: Evidence-based Practices, ed G. A. Troia (New York, NY: Guilford Publications), 77–112.
Troia, G. A., Lin, S. J. C., Cohen, S., and Monroe, B. W. (2011). A year in the writing workshop: linking writing instruction practices and teachers' epistemologies and beliefs about writing instruction. Elem. Sch. J. 112, 155–182. doi: 10.1086/660688
Troia, G. A., Shankland, R. K., and Wolbers, K. A. (2012). Motivation research in writing: theoretical and empirical considerations. Read. Writ. Q. 28, 5–28. doi: 10.1080/10573569.2012.632729
Troia, G. A., Wang, H., and Lawrence, F. R. (2022). Latent profiles of writing-related skills, knowledge, and motivation for elementary students and their relations to writing performance across multiple genres. Contemp. Educ. Psychol. 71, 102100. doi: 10.1016/j.cedpsych.2022.102100
Truckenmiller, A. J., McKindles, J. V., Petscher, Y., Eckert, T. L., and Tock, J. (2020). Expanding curriculum-based measurement in written expression for middle school. J. Spec. Educ. 54, 133–145. doi: 10.1177/0022466919887150
Tschannen-Moran, M., and Barr, M. (2004). Fostering student learning: the relationship of collective teacher efficacy and student achievement. Leadersh. Policy Sch. 3, 189–209. doi: 10.1080/15700760490503706
Tschannen-Moran, M., and Hoy, A. W. (2001). Teacher efficacy: capturing an elusive construct. Teach. Teach. Educ. 17, 783–805. doi: 10.1016/S0742-051X(01)00036-1
Tucker, B. (2012). The flipped classroom. Educ. Next 12, 82–83. Available online at: https://www.educationnext.org/wp-content/uploads/2023/04/ednext_XII_1_what_next.pdf
Turner, J., and Paris, S. G. (1995). How literacy tasks influence children's motivation for literacy. Read. Teach. 48, 662–673.
Wechsler, D. (2005). Wechsler Individual Achievement Test (WIAT-II UK): Harcourt Assessment. San Antonio, TX: Psychological Corp.
Wijekumar, K., Graham, S., Harris, K. R., Lei, P. W., Barkel, A., Aitken, A., et al. (2019). The roles of writing knowledge, motivation, strategic behaviors, and skills in predicting elementary students' persuasive writing from source material. Read. Writ. 32, 1431–1457. doi: 10.1007/s11145-018-9836-7
Williams, J. D., and Takaku, S. (2011). Help seeking, self-efficacy, and writing performance among college students. J. Writ. Res. 3, 1–18. doi: 10.17239/jowr-2011.03.01.1
Wilson, K. M., and Trainin, G. (2007). First-grade students' motivation and achievement for reading, writing, and spelling. Read. Psychol. 28, 257–282. doi: 10.1080/02702710601186464
Wright, K. L., Hodges, T. S., Enright, E., and Abbott, J. (2021). The relationship between middle and high school students' motivation to write, value of writing, writer self-beliefs, and writing outcomes. J. Writ. Res. 12, 601–623. doi: 10.17239/jowr-2021.12.03.03
Wyatt, M., and Dikilitaş, K. (2021). English language teachers' self-efficacy beliefs for grammar instruction: implications for teacher educators. Lang. Learn. J. 49, 541–553. doi: 10.1080/09571736.2019.1642943
Yamaç, A., Öztürk, E., and Mutlu, N. (2020). Effect of digital writing instruction with tablets on primary school students' writing performance and writing knowledge. Comput. Educ. 157, 103981. doi: 10.1016/j.compedu.2020.103981
Yilmaz, K., and Çokluk-Bökeoglu, Ö. (2008). Primary school teachers' belief of efficacy. Ankara Univ. J. Fac. Educ. Sci. 41, 143–167. doi: 10.1501/Egifak_0000001128
Yoon, K. S., Duncan, T., Lee, S. W.-Y., Scarloss, B., and Spapley, K. L. (2007). Reviewing the Evidence on How Teacher Professional Development Affects Student Achievement. Washington, DC: Institute for Education Sciences. Available online at: http://ies.ed.gov/ncee/wwc/documentsum.aspx?sid=19
Zimmerman, B. J. (1990). Self-regulated learning and academic achievement: an overview. Educ. Psychol. 25, 3–17. doi: 10.1207/s15326985ep2501_2
Keywords: writing achievement, teacher efficacy beliefs, instructional actions, writing motivation, hierarchical linear modeling
Citation: Wang H and Troia GA (2023) How students' writing motivation, teachers' personal and professional attributes, and writing instruction impact student writing achievement: a two-level hierarchical linear modeling study. Front. Psychol. 14:1213929. doi: 10.3389/fpsyg.2023.1213929
Received: 28 April 2023; Accepted: 03 July 2023;
Published: 20 July 2023.
Edited by:
Kausalai Kay Wijekumar, Texas A&M University, United StatesReviewed by:
Fien De Smedt, Ghent University, BelgiumSungyoon Lee, Middle Tennessee State University, United States
Copyright © 2023 Wang and Troia. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Heqiao Wang, wangheq2@msu.edu