Michel Knigge
Karsten Krauskopf
Simon Wagner- Inclusion and Organizational Development, Department for Educational Science, Faculty for Human Sciences, University of Potsdam, Potsdam, Germany
Relationship quality between teachers and their students is a critical aspect for well-being and effective learning in school. Accordingly, teacher training should promote competencies for creating and maintaining positive relationships in the classroom. The Helga Breuninger Foundation developed a video-based online training (Intus3) that intends to focus on student teachers' interpersonal competencies by reflecting on staged videos. Although this training is well-designed, there is only little empirical evidence in general and so far no experimental research investigating the effects of Intus3. Accordingly, we investigated whether this program is able to improve the capacities of student teachers' interpersonal competencies, affective well-being, and affective attitudes toward challenging students. We conducted two randomized experimental studies (n1 = 132, n2 = 242) within lectures in teacher education at the University of Potsdam, introducing the basics of inclusive education in two consecutive semesters. We compared groups first working with Intus3 to waiting control groups that wrote an expository text based on empirical research discussing the relevance of teacher–student relationships with a longitudinal design with four measurement points. Latent change models showed that prior work with Intus3 showed few effects but complex effects in comparison to the prior text work groups. In the larger and extended study 2, an increase of empathic concern was significant after the prior work with Intus3. The results will be discussed with the perspective of the potential of further development of online training courses for affective learning for teachers and teacher students.
Introduction
Since the study by Hattie (2010), there is ample evidence for us to assume that a good relationship between teachers and their students has a significant positive impact on productive schooling. In his international meta-meta-study, the teacher–student relationship was one of the most important factors predicting competency development in students. On a national basis, there is evidence that proves important effects. For example, in Germany, Aldrup et al. (2018) showed that teacher–student relationships play an important role in the development of teacher enthusiasm and exhaustion, which are in turn important factors that affect students' competency development (Kunter et al., 2013; Gegenfurtner et al., 2019).
A model that elaborates this assumption of the importance of the teacher–student relationships is the prosocial classroom model (Jennings and Greenberg, 2009). Taken together with the mentioned research, the current study is interested in learning more about ways of competency development in teachers and teacher students to enable them to establish beneficial relationships with their students.
State of Research
An approach toward this goal can be derived from the prosocial classroom model (Jennings and Greenberg, 2009), namely focusing on teachers' social and emotional competencies (SEC) as prerequisites for their shaping teacher–student relationships. While there have been attempts to fill the gap of training of SEC and according to research for teachers internationally (e.g., Spilt et al., 2012), in Germany, there is still a lack of research and evidence-based programs, especially with regard to novice teacher students. Accordingly, it seems worthwhile to put more research effort into this endeavor. For our research at hand, we investigate an existing video-based online program that has been developed without our participation and compare it to text-based interventions in a lecture addressing large numbers of teacher students. First, we will elaborate on our conceptualization of SEC and sketch very briefly how it might be related to building productive teacher–student relationships. Subsequently, theory and evidence for interventions compared in the current study are presented before, finally, the investigated video-based program Intus3 will be described in detail.
Socio-Emotional Competencies of Teachers and Productive Teacher–Student Relationship
SEC have been proposed to be of great significance for a healthy and productive work life of teachers. Jennings and Greenberg (2009) developed the prosocial classroom model that states with reference to a broad array of empirical evidence that teachers' SEC and their well-being influence healthy teacher–student relationships alongside an effective classroom management and an effective social and emotional learning (SEL) environment for students. Ultimately, the model assumes a positive influence on a healthy classroom climate and students' social, emotional, and academic outcomes. Rocchi and Pelletier (2018) showed accordingly that congruent positive beliefs of the relationship between coach and professional athletes were associated with higher psychological needs satisfaction. SEC consist of both emotional and social aspects. Both are important to create productive interpersonal relationships. However, given the current focus on the relationship between teachers and students, there is a stronger focus on social aspects while emotional aspects are mostly considered as affective components that are experienced in reference to these relationships. As such, both aspects are considered highly interdependent. However, theoretically, social aspects of SEC can be divided into cognitive and affective components. Such distinctions are rooted in social psychology (Davis, 1983a; Kanske et al., 2016), and two main facets can be described: (cognitive) perspective taking (PT) and (affective) empathic concern (EC). While PT describes the ability to assess situations from the perspective of that of another person, EC refers to a person's tendency to experience similar emotions as an observed person. As research indicates, PT and EC can be quite powerful, and they are distinct in their effects. For example, Vorauer and Quesnel (2016) showed in a study that if a member of a majority group shows high PT toward a member of a minority group, the latter reports more positive self-descriptions, but there is no such effect if the majority group shows higher levels of EC. There is also evidence for interactions between the constructs in such a way that higher EC can inhibit PT in affectively loaded situations (Kanske et al., 2016). Furthermore, there is initial evidence regarding teacher training that EC can be a positive predictor for developing higher teaching-specific self-efficacy (Krauskopf and Knigge, 2019). Accordingly, EC and PT seem to interact in rather complex ways in affective learning.
In inclusive settings, individualized planning (Richter and Pant, 2016) and relationship-sensitive teaching (Dumke, 1991) are customary instructional patterns. At the same time, teachers are specifically worried about establishing such patterns due to the challenges when facing more diverse emotional, social, and behavioral problems of students (de Boer et al., 2011). Accordingly, it can be assumed that SEC are especially important for the context of inclusive education (Krauskopf and Knigge, 2017). In line with this assumption, there is evidence that affective attitudes toward students with special needs might be of special interest as teachers' mental representations of their relationships with disruptive children are associated with negative affect (Spilt and Koomen, 2009). It has been found that such affect could lead to according behavior of teachers (Stuhlman and Pianta, 2002). Thus, it seems to be of importance to find ways to reflect on especially negative affective attitudes and the development of strategies to change or to deal with them for pre-service teachers starting with their university-based training (c.f. Pianta, 1999). In addition, such strategies show positive effects on student development as well as on the psychological functioning of teachers (Mashburn et al., 2006).
Interventions to Support the Development of Socio-Emotional Competencies of Teachers
While there are not many explicit programs focusing to support the development of SEC of teachers and/or accordingly the teacher–student relationships, Spilt et al. (2012) developed the “relationship-focused reflection program (RFRP) to promote teachers' relationships with behaviorally at-risk children” (p. 307). The core component of the program is a guided process for teachers to reflect on their positive and negative emotions toward their students in their daily work life. The objective is to increase teachers' SEC capacity to understand and deal with their affects and as a result change their own perspectives on the teacher–student relationship and the resulting behaviors. Narration and reflection have been used as tools in two blocks of two individual sessions in a 9-week-long time period. They found that closeness and sensitivity in the teacher–student relationships did rise during the duration of the program.
Besides the mentioned reflection sessions, a main component of the RFRP is an “Interpersonal Skills Training […] based on the interpersonal communication model of Leary (1957)” (Spilt et al., 2012, p. 309). It is applied in a combination of a booklet and video examples of interactions between the teachers and the students. This is explicitly used to train the teachers to better understand their affects and cognitions and to use this knowledge to actively change their behavior. Explicit topics in the training are “in terms of the orthogonal dimensions affiliation (cooperation–opposition), and directivity (dominance–submission) and the complementarity principle (i.e., friendliness invites friendly behavior; dominance evokes submissive behavior).”
A German example for a structured and evidence-based intervention is a program applying guided supervision coaching groups for teachers across a time period of at least 6 weeks with 2 h/week (called Freiburg model; Braeuning et al., 2018). The objective of the Freiburg model is to increase teacher health. Nevertheless, in aiming at this goal, teacher–student relationships are a central content of the training. In dealing collaboratively with own cases of the teachers:
“The intervention is conceptualized as a Balint-type group work based on a published manual [7]. It includes five modules dealing with the following issues: (1) basic knowledge of stress physiology and the effects on health parameters; (2) mental attitudes with a particular focus on mental health improvements in school teachers authenticity and identification; (3) competence in handling relationships with students; (4) competence in handling relationships with parents; (5) strengthening collegiality and social support among the staff. Since we have shown that participation in at least five sessions was sufficient for achieving the health benefit [2], the actual program has been shortened from originally 10 to currently six sessions.” (p. 2/3)
Results on the evaluation of the Freiburg model work showed that the program is effective in improving teacher health. Nevertheless, SEC of the teachers have not been addressed in the evaluation accordingly; it is unclear if there are effects as intended. It is not investigated if teacher–student relationships improve after participation of the teachers.
The RFRP and the Freiburg model are very impressive programs and should be considered for broader establishment and further research. Nevertheless, the necessary resources to implement such intensive interventions are limited. Accordingly, it seems necessary to investigate less comprehensive alternatives that apply similar principles while being more economical.
The Online Program Intus3
The Helga Breuninger Foundation developed an online program intended to enhance SEC of teachers to improve their management of teacher–student-relationships, which is called Intus3 (online). The core element of this program are staged videos that show prototypic teacher–student interactions, which were developed iteratively in cooperation with teachers and the lay actor students themselves. Accompanied by expository videos and a pdf textbook, working through this video material is supposed to support teachers in reflecting on their initial emotions, thoughts, and behavioral impulses in order to create increasingly “resonant interactions.” Such interactions are defined as “an expression of mindfulness and appreciation, is based on a resonant mindset.” Intuition, in turn, is conceptualized as openness to one's own impressions and impulses and considered a central concept of the program (online).
The developers designed 40 staged videos in a cocreation process with students in a school in Tübingen, Germany. These short video clips show micro interactions that are supposed to provide prompts for practicing awareness, empathy, and reflection on spontaneous reactions. The expository videos and texts guide through step-by-step reflective processes, encouraging participants to come up with different possible spontaneous solutions in complex interactions of everyday life in the classroom.
Overall, the online training program is completed individually and organized in five modules. In our study, we applied only the first two modules. The first module basic mindset is supposed to support participants to “accept situations, understand scenes intuitively, empathically sensing needs, becoming aware of potentials,” the second module dialogic interventions aims at “how to act proactively by acceptance, how to create productive atmospheres on intuition, how to solve conflicts sensing empathically the needs, how to act self-efficient focusing on potentials,” and the third module deals with body language to “reading body language and intuitively recognize the significance of facial expressions [and] how to use ‘body markers”' (Helga Breuninger Foundation)1.
The Current Study
The goal of this study was to examine whether a video-based online training program can support the development of SEC as described above in samples of pre-service teachers still at the beginning of their training. Although the contribution of Jennings and Greenberg (2009) is now about 10 years old, their conclusions are still valid and guide the research questions of the current study:
“(a) Can interventions be developed to improve SEC?”
“(b) Do these interventions result in reduced teacher stress and burnout and increased well-being?”
The study at hand addresses the research questions (a) and (b) with regard to teacher student training. The hypotheses will be tested, if
- Regarding the immediate effect, the video-based Intus3 program shows different levels of affective and cognitive situational interest and amount of invested mental effort compared to a traditional academic writing task, with both—online program and writing task—focusing on teacher–student relationships.
- The implementation of the video-based Intus3 program shows larger effects over time on teacher students SEC, more concretely on their short-term development of EC, PT, affective attitudes toward students with Special Educational Needs (SEN), attitudes toward teacher–student relationships in general, and their psychological adjustment (emotional exhaustion) compared to a traditional academic writing task, with both—online program and writing task—focusing on teacher–student-relationships.
Methods
Design and Sample
We conducted studies, both following a randomized control group design over the course of two consecutive semesters in 2018 and 2019. Participants attended an introductory lecture to the field of inclusive education (Study 1 n = 114; Study 2 n = 209). The lecture was comparable in content and structure across the semesters; however, they were held by different lecturers. In both studies, students answered an initial online questionnaire (t1) and were randomly assigned to one of two groups, subsequently. In order to ensure comparable learning opportunities for participating students in both conditions, we followed the rationale of a waiting control group. Participants in the intervention group Online Program First received an invitation to their personal Intus3 workspace. There, they could access Module 1 (mindset) and 2 (dialogic interventions), which they were guided to complete over a 7-week period. The online platform and the research questionnaires were accessed via the same anonymous code sent to students at the beginning of the semester. This enabled us to include only participants who had completed both modules. The waiting control group Textual Work First started with a text-based task. Students were asked to complete a prototypic academic task during the same period of 7 weeks. They were instructed to write an expository text (2,500 characters) based on a systematic literature search on the topic of teacher–student relationships. Students were asked to base their writing on empirical research accessed through scientific databases and refer those in their texts explicitly. Students were provided two peer reviews. In Study 1, this peer-review process was supported by the online system Tapaass (Walter et al., 2017) and, in the Study 2, via the workshop module provided by Moodle. Both groups completed second online questionnaire after 7 weeks (t2). Thereafter, the waiting control group (Textual Work First) received access to the digital learning platform Intus3, and the group (Online Program First) was assigned to complete the text-based task. After another period of 7 weeks, subsequent to all students completing the respective tasks, they filled in a third online questionnaire (t3). Finally, all participants completed the last questionnaire online at the end of the semesters (t4).
Regarding the online program, students in study 1 only completed the Intus3 modules, whereas in study 2, students additionally wrote a short paper (1,500 characters) in which they reflected on their learning experience with this video-based online program.
In both studies, a subsample of students was additionally enrolled in a seminar accompanying an educational-psychological internship. Because the learning goals of the internship were associated with observing interactions in pedagogical environments, and thus pedagogical relationships, we controlled for seminar participation in the analyses presented below. We use the term Treatment 1 to indicate group membership (Online Program First vs. Textual Work First) and Treatment 2 to indicate additional seminar participation.
If students did not want to participate in the research, they were provided with an essay task on topics regarding inclusive education to gain all course credit. Students gave informed consent to their participation, and the regulations of the German data protection law (DGSVO) were followed.
Instruments
An array of empirically validated instruments was applied to measure the different aspects of SEC introduced above that were paralleled with the core constructs addressed by the online program Intus3. Table 1 shows an overview of this selection with means, standard deviations, and Cronbach's alpha at t1. All scales showed sufficient internal consistency and will be shortly explained in the following subsections.
Table 1. Internal consistencies for the applied scales at the first time of measurement.
PT and EC
PT and EC were assessed by the respective subscales of the Interpersonal Reactivity Index developed by Davis (1983b) using an established German version by Paulus (2009). Regarding the conceptual framework of Intus3, these constructs tap into participants' development toward an increasingly intuitive understanding of interpersonal scenes and conflicts from multiple perspectives (PT, four items, sample item: “I believe there are always two sides to a problem, and therefore try to consider both.”) and empathically sensing the different needs and emotions of the different agents involved in an interpersonal conflict (EC, four items, sample item: “I experience warm feelings for persons less fortunate than myself”). Items were rated on a 5-point scale (1 = never, 5 = always).
Affective Attitudes Toward Students With Special Needs
Affective attitudes are central to the conceptual framework of Intus3, namely, the goals to foster an overall accepting stance and to increase awareness of students. Accordingly, a self-report measure based on the work of Avramidis et al. (2000), German version by Knigge and Rotter (2015) was applied in a brief version to assess participating pre-service teachers' affective attitude toward teaching in a classroom with a new student who displays (1) behavioral problems or (2) learning difficulties, respectively. Each scale consisted of adjectives describing emotions in the format of four semantic differentials (e.g., positive vs. negative on a 5-point scale) and a short situation description as item stem.
Emotional Exhaustion
If a person comes closer to the goals to solve conflicts sensing empathically the needs [and …] to act self-efficient focusing on potentials, it can be assumed that emotional exhaustion is reduced due to an increase in effective coping mechanisms (c.f. Braeuning et al., 2018). To operationalize this conceptual foundation of the online program, we applied the emotional exhaustion subscale of a German measure by Enzmann and Kleiber (1989) based on the Maslach Burnout Inventory (Maslach et al., 1996). The scale consisted of four items using a 5-point Likert scale (sample item: I often feel exhausted during my studies”).
Student–Teacher Relationship as a Personal Goal
As the enhancement of the quality of student–teacher relationships is an overarching goal of Intus3, we assessed the degree to which students valued this as a professional goal for themselves. We used the respective subscale from a measure by Rüprich (2018) using a 5-point Likert scale (sample item: “I strive to become a teacher who develops a positive attitude toward my students.”).
Measurements of the Perceptions of the Learning Experience
In addition to the measures tapping into the more distal constructs described above, we applied measures to assess the quality of the experience of the participating pre-service teachers while engaging with the video-based online program and the academic writing task, respectively. We chose to assess motivational aspects by measuring the cognitive and the affective dimension of situational interest. These constructs have been shown to be meaningful predictors for learning outcomes (e.g., Tsai et al., 2008). We used scales adapted from Deci et al. (1994) consisting of seven items for each scale (sample item cognitive: “I believe this activity could be of some value to me,” sample item affective interest: “I enjoyed doing this activity very much”). Furthermore, we applied a more specific measure tapping into the cognitive processes associated with learning using video material vs. text material, namely, the amount of invested mental effort (AIME) introduced by Salomon (1984). This scale is an established indicator in research on comparing digital learning environments with regard to how deep the involvement with the presented content is perceived by participants. Thus, higher AIME scores are considered to point to a deeper content elaboration. We applied a validated German scale by Krell (2017) consisting of 12 items [sample item: “At the processing of the tasks, I haven't done my best particularly.” (reversed)]. For all scales, a 7-point Likert scale was applied.
Statistical Analyses
Test for Measurement Invariance Over Time
As we were interested in changes over time in relation to an intervention, we computed latent change scores (LCS) for each time lag. LCS are a useful method to analyze latent change factors between different measurement times within longitudinal structural equation models (McArdle, 2009). To analyze LCS, the latent constructs must have an equal structure at the relevant measurement time. First, we checked if the data met the requirements for LCS.
First, the constructs of each study were checked for their factorial measurement invariance (Little, 2013). Since LCS are to be interpreted in this study, the model must have a strong measurement invariance (same factorial structure across time, factor loadings constrained to be equal across time, and intercepts constrained to be equal across time) (Widaman et al., 2010). The evaluation of the measurement invariance was based on the approach of van de Schoot et al. (2012). Confirmatory Factor Analysis (CFA) was specified to test the measurement invariance. Marsh et al. (1998) recommend to operationalize at least four indicators per construct for an adequate analyzing CFA models in small samples (n = 100). According to the suggestions of Marsh et al. (1998), the sample sizes of the two available studies (study 1 n = 114; study 2 n = 209) are sufficient with regard to validity, as in both studies, the constructs were operationalized by at least four indicators. The full information maximum likelihood (FIML) method was used, so that cases with missing values were also included in the analyses (Schafer and Graham, 2002). The χ2 test, the Comparative Fit Index (CFI), and the Root Mean Square Error of Approximation (RMSEA) were used to evaluate the goodness of fit of the specified models. Since the χ2 test is a sample-sensitive test procedure (Cheung and Rensvold, 2002), comparative and absolute fit indices are used in addition to the χ2 test to check the model fitting (Beauducel and Wittmann, 2005). Within the framework of longitudinal studies, values >0.90 for the CFI indicate an acceptable model fit and values ≥0.95 indicate a good model fit. For the RMSEA, values ≤0.08–0.05 indicate an acceptable model fit, and values ≤0.05 indicate a good model fit (Little, 2013). To assess the level of factorial invariance, the conventions of Cheung and Rensvold (2002) were used. In this approach, the change in the model fit is evaluated by comparing the less restrictive model with the more restrictive one. As long as the ΔCFI does not decrease more than 0.01 units, the next higher level of invariance is assumed. For the ΔRMSEA, Chen (2007) assumes a significant deterioration of the model from a change in the model fit of 0.01 and higher. If the models showed a significant deterioration, it was investigated whether partial measurement invariance can be achieved by free-estimating parameters (Byrne et al., 1989).
In study 1, scalar measurement invariance could be verified for the constructs affective attitudes toward students with behavioral problems, importance of teacher–student relationships, and emotional exhaustion. EC showed partial scalar invariance across time. On the other hand, no scalar measurement invariance could be proven for PT (Table 2). In study 2, partial scalar measuring invariance was established for the construct PT. All other constructs reached scalar measurement invariance (Table 2). The statistical analyses were performed with the statistical software R (R Core Team, 2019) and the package lavaan (Rosseel, 2012).
Table 2. Model fit statistics for testing of measurement invariance.
LCS Models
We estimated LCS between different measurement times as indicated in Figure 1 (McArdle, 2009).
Figure 1. Path diagram for a latent change score model. For the purpose of better clarity, the covariances are not shown.
We consider the parameter Δη2 the most relevant LCS to the present research because it displays the initial difference between treatment (1) and (waiting) control group. The following developments indicated by Δη3 and Δη4 include more complex learning experiences of students and are, therefore, more difficult to interpret.
Results
Perceptions of the Learning Experience
Table 3 shows descriptive results, comparing how participants experienced the two online program and the text-based control task with regard to motivational and cognitive aspects. A clear picture arises that Intus3 is experienced as cognitively and affectively more interesting, while the text-based task was rated higher on AIME. Overall, these results mirror prior findings that watching “TV” is more “easy,” whereas textual work is perceived as more strenuous.
Table 3. Mean differences in cognitive interest, affective interest, and AIME between students working with a text and students working with an online tool for two measurement times.
Latent Change Models
Longitudinal results showed few small results (Tables 4, 5), which are rather inconsistent across both studies. The LCS considered most relevant here (Δη2), in study 1, there was only a negative effect, showing a less positive affective attitude toward students with learning disabilities. In study 2, Δη2 showed an increase in EC for those who worked on the Intus3 modules first.
Table 4. Results from LCS modeling (study 1).
Table 5. Results from LCS modeling (study 2).
Additional significant effects were found for change scores referring to developments later in the semester. At Δη4, attending the reflective practice module of the additional seminar (Treatment 2) was related to a decrease in perceived emotional exhaustion in study 2. In study 1, students who first worked with Intus3 reported less significance of their professional goal to aim for positive teacher–student relationships at the last measurement point.
Discussion
The goal of the present research was to investigate whether a video-based online learning environment designed to reflect on difficult interactions between teachers and students in the classroom could function as a tool for promoting SEC in pre-service teachers. This endeavor was based on the research desideratum formulated by Jennings and Greenberg (2009). Based on basic research on differences between learning with text vs. learning with video, we expected a video-based online training program—compared to a traditional reading and writing assignment—to show greater impact on certain aspects of pre-service teachers' SEC, namely, their EC, PT, affective attitudes toward students with special needs, and emotional exhaustion. As an extended manipulation check, we assessed affective and cognitive interest as well as participants' amount of mental effort with regard to learning with either task. Overall, we followed a waiting control group design to ensure that all participants were able to benefit from both assignments over the course of a semester. To test the effects, we applied LCS modeling using data from four measurement points along the semester. In summary, the results of two studies with consecutive cohorts of pre-service secondary teachers yielded only few small effects, and across studies, there was no clear pattern. With regard to the immediate learning experiences, situational interest was consistently higher for working with the video-based online program; however, the amount of invested mental effort was higher for the writing assignment.
In study 1, we found that pre-service teachers who worked with the video-based online program Intus3 showed less positive affective attitudes toward students with learning difficulties after 7 weeks compared to the waiting control group who was engaged in a writing assignment. This was an unexpected finding. A possible explanation could be Intus3 creating a more realistic and immersive picture of how difficult interactions between teachers and students can be on the emotional level. In addition, in study 1, students were not asked to write a short reflection on their learning process (as they were in study 2). This could have left them with unresolved questions elicited by the video sequences. This, however, does not necessarily have to reflect a negative intervention effect as Spilt and Koomen (2009) have discussed for declines in desired outcomes (perceived relationship quality in their case). For example, a teacher could report more anxiety or less positive attitudes because of an increased awareness of his/her own negative emotions and interactions with the child. In this case, this could be an important first step to a positive change in classroom practices if the teacher training program can productively take up such developments subsequently.
In study 2, participating pre-service teachers who worked with the video-based online training program displayed higher EC after 7 weeks compared to the waiting control group. We consider two aspects relevant for discussing this finding. First, in study 2, a systematical reflection process was implemented, that is, participants had to hand in a written reflection discussing their learning experiences with the online modules, which could also include critical points and questions that were left open to them. Considering the notion of reflective practice (Schön, 1983; Beauchamp, 2015), this additional intervention can be considered a necessary scaffold for producing this effect. Second, in study 2, we had a larger sample size, which could have produced a significant result according higher test power.
The few other significant effects were found at later measurement points. In study 2, there was a buffering effect toward the end of the semester (Δη4) of attending a reflection-oriented seminar accompanying an internship on perceived emotional exhaustion regarding the teacher training program. We consider this additional potential evidence that implementing learning opportunities for guided reflective practice might play an important role in the development of pre-service teachers SEC. In study 1, we found that other students who first worked with the video-based online training program lowered their goal intentions to aim for good teacher–student relationships at the last measurement point.
In summary, results for the scales tapping into pre-service teachers' SEC were inconsistent across studies, which limits the generalizability of the effects found. However, perceptions of the learning processes were consistent, with video being more interesting than text and text being more mentally effortful. These findings are in line with the early work by Salomon (1984) and need to be considered further in the future because mental effort is considered an important precursor for deeper elaboration of content. We did not assess participants' mastery of the content, that is, their declarative knowledge about teacher–student relationships acquired by the different tasks. This will be an important variable in future research to disentangle the differential effects of interest and invested mental effort. However, this rationale again strengthens our interpretation that writing a reflective text on their video-based learning might have added a deeper elaboration to the learning environment with regard to developing empathic competencies. With regard to future research, we would endeavor to investigate whether the lack of a guided reflection process could also be an explanation for negative effects of the video-based online training program on participants' affective attitudes toward students with learning difficulties and the goal to build good teacher–student relationships in study 1.
Furthermore, we consider the confirmation of the expected effects on EC in study 2 to indicate the potential effectiveness of the video-based online program as an exemplar for the development of social-emotional competencies of pre-service teachers in university-based teacher training. However, given that no similar result pattern was found in study 1, this interpretation will need to be supported by further empirical research.
An interesting result emerged from our efforts to control for the potential effects of a second treatment variable that was not in the focus of this study. In study 2, pre-service teachers who attended an additional seminar at the end of their internship where they guided to collaboratively reflect on interpersonal situations they had experienced during their internship felt less emotionally exhausted. On the one hand, this supports the assumption that collaborative case reflection could help reduce stress and, thus, emulate the effects of supervision. Similar results have been found in a study implementing the Freiburg model coaching program (Braeuning et al., 2018). On the other hand, there might be more complex statistical interaction effects at work that differ between study 1 and study 2, in addition to the different sample sizes. Maybe these different results are due to a three-partite interaction between participating in the collaborative case work and working with the video-based online program including the written reflection task. It could be an objective to test this post-hoc explanation in future research.
All these interpretations need to be considered with caution due to several limitations of our investigation. First, we only investigated short-term effects. The time lag of the most relevant intervention period was 7 weeks only, with a total time lag of 4 months for the whole investigation. It could make a difference if such an intervention study would be conducted over a longer period of time, including follow-up measures before the waiting group starts with the intervention. Second, we did not measure or observe behavior or tested participants' gain in declarative or procedural knowledge but only relied on self-report data. Although we applied established instruments, the answers could be subject to social desirability tendencies and other biases. Finally, we investigated pre-service teachers early on in their studies. If a video-based online program does not show all intended effects with this group does, this does not necessarily imply similar results with more experienced pre-service or even in-service teachers.
Besides all limitations mentioned, the research design chosen also has several strengths. First of all, the applied randomized waiting control group design provides a comparatively rigid research protocol regarding the internal validity while simultaneously working with field data. A field setting at the university can also be considered quite high in external validity. Subsequently, two independent yet comparable studies were conducted, and both could implement a longitudinal design with four measurement points using sophisticated statistical methods (LCS) based on established measurement invariance over time. By this waiting control group design, we were able to ensure that all students worked on meaningful tasks with a comparable content. Given the implementation into a regular (mandatory) university lecture, this was also done to avoid unfairness due to different tasks to fulfill within the class. Based on our interpretations, the most valid next step regarding empirical research would be to more explicitly focus on structured opportunities of reflective practice within the context of video-based online learning and SEC. One approach would be to compare different implementations of the Intus3 program while varying the form and function of the written reflection. Another approach could be to observe SEC development using more nuanced measures and longer intervention lags. On the longer term, a sound intervention design with in-service teachers should be conducted as well, and behavioral measures and process data of the online application should be included. Finally, effects for the behavior in the classroom are an important aspect to investigate as it is always a very important question what interventions on teachers and teacher students finally mean for what is happening in the classroom.
Data Availability Statement
The datasets generated for this study are available on request to the corresponding author.
Author Contributions
MK wrote the larger part of the manuscript, mainly aquised, designed, and coordinated the study. KK did co-acquise, co-design, and coordinated the study. He also wrote substantial parts of the manuscript and revised it fully. SW did almost all calculations and tables and wrote significant parts of the methods.
Funding
This work was supported by University of Potsdam. This project was part of the “Qualitätsoffensive Lehrerbildung”, a joint initiative of the Federal Government and the Länder which aims to improve the quality of teacher training. The programme was funded by the Federal Ministry of Education and Research. The authors are responsible for the content of this publication.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Footnotes
1. ^Helga-Breuninger-Foundation. Available online at: Intus3. www.intushochdrei.de/?lang=en (accessed January 31, 2019).
References
Aldrup, K., Klusmann, U., Lüdtke, O., Göllner, R., and Trautwein, U. (2018). Student misbehavior and teacher well-being: testing the mediating role of the teacher-student relationship. Learn. Instr. 58, 126–136. doi: 10.1016/j.learninstruc.2018.05.006
Avramidis, E., Bayliss, P., and Burden, R. (2000). A survey into mainstream teachers' attitudes towards the inclusion of children with special educational needs in the ordinary school in one local education authority. Educ. Psychol. 20, 191–211. doi: 10.1080/713663717
Beauchamp, C. (2015). Reflection in teacher education: issues emerging from a review of current literature. Reflect. Pract. 16, 123–141. doi: 10.1080/14623943.2014.982525
Beauducel, A., and Wittmann, W. W. (2005). Simulation study on fit indexes in CFA based on data with slightly distorted simple structure. Struct. Equ. Model. 12, 41–75. doi: 10.1207/s15328007sem1201_3
Braeuning, M., Pfeifer, R., Schaarschmidt, U., Lahmann, C., and Bauer, J. (2018). Factors influencing mental health improvements in school teachers. PLoS ONE 13:e0206412. doi: 10.1371/journal.pone.0206412
Byrne, B. M., Shavelson, R. J., and Muthen, B. O. (1989). Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. Psychol. Bull. 105, 456–466. doi: 10.1037/0033-2909.105.3.456
Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Struct. Equat. Model. 14, 464–504. doi: 10.1080/10705510701301834
Cheung, G. W., and Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Struct. Equat. Model. 9, 233–255. doi: 10.1207/S15328007SEM0902_5
Davis, M. H. (1983a). Measuring individual differences in empathy: evidence for a multidimensional approach. J. Pers. Soc. Psychol. 44:113. doi: 10.1037//0022-3514.44.1.113
Davis, M. H. (1983b). The effects of dispositional empathy on emotional reactions and helping: a multidimensional approach. J. Pers. 51, 167–184. doi: 10.1111/j.1467-6494.1983.tb00860.x
de Boer, A., Pijl, S. J., and Minnaert, A. (2011). Regular primary schoolteachers' attitudes towards inclusive education: a review of the literature. Int. J. Incl. Educ. 15, 331–353. doi: 10.1080/13603110903030089
Deci, E. L., Eghrari, H., Patrick, B. C., and Leone, D. R. (1994). Facilitating internalization: the self-determination theory perspective. J. Pers. 62, 119–142. doi: 10.1111/j.1467-6494.1994.tb00797.x
Dumke, D. (1991). Soziale Kontakte behinderter Schüler in Integrationsklassen. Heilpädagogische Forschung 17, 21–26.
Enzmann, D., and Kleiber, D. (1989). Helfer-Leiden: Streβ und Burnout in Psychosozialen Berufen. Heidelberg: Asanger.
Gegenfurtner, A., Fryer, L., Järvelä, S., Harackiewicz, J., and Narciss, S. (2019). Affective learning in digital education. Front. Educ.
Hattie, J. (2010). Visible Learning. A Synthesis of Over 800 Meta-analyses Relating to Achievement. London: Routledge.
Jennings, P. A., and Greenberg, M. T. (2009). The prosocial classroom: teacher social and emotional competence in relation to student and classroom outcomes. Rev. Educ. Res. 79, 491–525. doi: 10.3102/0034654308325693
Kanske, P., Böckler, A., Trautwein, F.-M., Lesemann, F. H. P., and Singer, T. (2016). Are strong empathizers better mentalizers? Evidence for independence and interaction between the routes of social cognition. Soc. Cogn. Affect. Neurosci. 11, 1383–1392. doi: 10.1093/scan/nsw052
Knigge, M., and Rotter, C. (2015). Unterrichtsplanungen bei Lehramtsstudierenden im Falle der Wahrnehmung von vermeintlich “besonderen” Schülerinnen und Schülern und ihr Zusammenhang mit Selbstwirksamkeits-überzeugungen und Einstellungen in Bezug zu Inklusion – beispielhafte mixed-method-analysen aus der EiLInk-Studie. Empirische Sonderpädagogik 7, 223–240.
Krauskopf, K., and Knigge, M. (2017). Die komplexität kognitiver emotions-repräsentationen als facette sozio-emotionaler kompetenzen von lehrkräften. Eine pilotstudie zur entwicklung von items zur erfassung der levels of emotional awareness im lehramtsstudium. Empirische Sonderpädagogik 1, 66–89.
Krauskopf, K., and Knigge, M. (2019). Die entwicklung von selbstwirksamkeitserwartungen bei lehramtsstudierenden bezogen auf die gestaltung inklusiven unterrichts - eine längsschnittliche untersuchung zum einfluss sozio-emotionaler kompetenzfacetten. Empirische Pädagogik 33, 228–243.
Krell, M. (2017). Evaluating an instrument to measure mental load and mental effort considering different sources of validity evidence. Cogent Educ. 4:1280256. doi: 10.1080/2331186X.2017.1280256
Kunter, M., Klusman, U., Baumert, J., Richter, D., Voss, T., and Hachfeld, A. (2013). Professional competence of teachers: effects on istructional quality and student development. J. Educ. Psychol. 105, 805–820. doi: 10.1037/a0032583
Marsh, H., Hau, K., Balla, J., and Grayson, D. (1998). Is more ever too much? The number of indicators per factor in confirmatory factor analysis. Multivar. Behav. Res. 33, 181–220. doi: 10.1207/s15327906mbr3302_1
Mashburn, A. J., Hamre, B. K., Downer, J. T., and Pianta, R. C. (2006). Teacher and classroom characteristics associated with teachers' ratings of prekindergartners' relationships and behaviors. J. Psychoeduc. Assess. 24, 367–380. doi: 10.1177/0734282906290594
Maslach, C., Jackson, S. E., and Leiter, M. P. (1996). The Maslach Burnout Inventory, 3rd Edn. Palo Alto, CA: Consulting Psychologists Press.
McArdle, J. J. (2009). Latent variable modeling of differences and changes with longitudinal data. Annu. Rev. Psychol. 60, 577–605. doi: 10.1146/annurev.psych.60.110707.163612
Paulus, C. (2009). Der Saarbrücker Persönlichkeitsfragebogen SPF (IRI) zur Messung von Empathie: Psychometrische Evaluation der deutschen Version des Interpersonal Reactivity Index. Available online at: http://psydok.sulb.uni-saarland.de/volltexte/2009/2363/ (accessed November 11, 2018).
Pianta, R. C. (1999). “Assessing child–teacher relationships,” in Enhancing Relationships Between Children and Teachers, ed R. C. Pianta (Washington, DC: American Psychological Association, 85–104.
R Core Team (2019). R: A Language and Environment for Statistical Computing. Vienna: R Foundation for Statistical Computing.
Richter, D., and Pant, H. A. (2016). Lehrerkooperation in Deutschland: Eine Studie zu Kooperativen Arbeitsbeziehungen bei Lehrkräften der Sekundarstufe I. Gütersloh: Bertelsmann Stiftung; Robert Bosch Stiftung; Stiftung Mercator; und Deutsche Telekom Stiftung.
Rocchi, M., and Pelletier, L. (2018). How does coaches‘ reported interpersonal behavior align with athletes' perceptions? Consequences for female athletes' psychological needs in sport. Sport Exerc. Perform. Psychol. 7, 141–154. doi: 10.1037/spy0000116
Rosseel, Y. (2012). Lavaan: an R package for structural equation modeling. J. Stat. Softw. 48, 1–36. doi: 10.18637/jss.v048.i02
Rüprich, C. (2018). Ziele und Handlungen von Lehrkräften – Eine Untersuchung zu Lehrerzielen, ihrer Struktur und den Zusammenhängen zu subjektivem Wohlbefinden, Unterrichtsqualität und der wahrgenommenen Wirksamkeit von Unterrichtsmethoden. (Dissertation), Universität Passau, Passau, Deutschland.
Salomon, G. (1984). Television is “easy” and print is “tough”: the differential investment of mental effort in learning as a function of perceptions and attributions. J. Educ. Psychol. 76, 647–658. doi: 10.1037/0022-0663.76.4.647
Schafer, J. L., and Graham, J. W. (2002). Missing data: our view of the state of the art. Psychol. Methods 7, 147–177. doi: 10.1037/1082-989X.7.2.147
Schön, D. A. (1983). The Reflective Practitioner: How Professionals Think in Action. New York, NY: Basic Books.
Spilt, J. L., and Koomen, H. M. Y. (2009). Widening the view on teacher–child relationships: teachers' narratives concerning disruptive versus non-disruptive children. Sch. Psychol. Rev. 38, 86–101.
Spilt, J. L., Koomen, H. M. Y., Thijs, J. T., and van der Leij, A. (2012). Supporting teachers' relationships with disruptive children: the potential of relationship-focused reflection. Attach. Hum. Dev. 14, 305–318. doi: 10.1080/14616734.2012.672286
Stuhlman, M. W., and Pianta, R. C. (2002). Teachers' narratives about their relationships with children: associations with behavior in classrooms. School Psych. Rev. 31, 148–163.
Tsai, Y. M., Kunter, M., Lüdtke, O., Trautwein, U., and Ryan, R. M. (2008). What makes lessons interesting? The role of situational and individual factors in three school subjects. J. Educ. Psychol. 100, 460–472. doi: 10.1037/0022-0663.100.2.460
van de Schoot, R., Lugtig, P., and Hox, J. (2012). A checklist for testing measurement invariance. Eur. J. Dev. Psychol. 9, 486–492. doi: 10.1080/17405629.2012.686740
Vorauer, J. D., and Quesnel, M. (2016). Don't bring me down: divergent effects of being the target of empathy versus perspective-taking on minority group members' perceptions of their group's social standing. Group Proc. Intergr. Relat. 19, 94–109. doi: 10.1177/1368430215586273
Walter, S., Knigge, M., and Pirnay-Dummer, P. (2017). “TaPaAsS – elaboriertes feedback in Großen gruppen durch technologiegestützte automatisierte peer-prozesse,” in Conference of the Arbeitsgruppe für Empirische Pädagogische Forschung (AEPF) and the Kommission Bildungsorganisation, [Tübingen: Bildungsplanung, Bildungsrecht (KBBB) of the German Society for Educational Research (DGfE)].
Keywords: affective learning, socio-emotional competencies, empathy, perspective taking, online training, digital
Citation: Knigge M, Krauskopf K and Wagner S (2019) Improving Socio-Emotional Competencies Using a Staged Video-Based Learning Program? Results of Two Experimental Studies. Front. Educ. 4:142. doi: 10.3389/feduc.2019.00142
Received: 23 June 2019; Accepted: 18 November 2019;
Published: 11 December 2019.
Edited by:
Susanne Narciss, Dresden University of Technology, GermanyReviewed by:
Hu Jian, Jiangxi University of Finance and Economics, ChinaWenqing Wu, Tianjin University, China
Copyright © 2019 Knigge, Krauskopf and Wagner. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Michel Knigge, michel.knigge@uni-potsdam.de