Skip to main content

SYSTEMATIC REVIEW article

Front. Psychol., 13 December 2019
Sec. Cognitive Science
This article is part of the Research Topic Twenty Years after Implicit Association Test: The Role of Implicit Social Cognition in Human Behavior View all 8 articles

Teachers' Implicit Attitudes Toward Students From Different Social Groups: A Meta-Analysis

  • 1Luxembourg Centre for Educational Testing, University of Luxembourg, Esch-sur-Alzette, Luxembourg
  • 2Institut für Bildungsforschung, Universität Wuppertal, Wuppertal, Germany

Teachers' attitudes toward their students have been associated with differential teachers' expectations and, in turn, with students' educational pathways. Theories of social cognition can explain the link between attitudes and behavior. In this regard, the distinction between implicit and explicit attitudes is worth to be considered, whereby implicit attitudes are automatically activated when the attitude object is present and guide automatic behavior. In contrast, explicit attitudes infer deliberation and reflection, hence affecting controlled behavior. As teachers often are required to act immediately in situations that do not allow for thoughtful reflection due to time restraints, teachers' implicit attitudes concerning different student groups with shared characteristics, such as gender or ethnicity, may be especially important when considering teachers' behavior in relation to students' educational pathways. This notion is reflected by an increased interest in adopting implicit methodology in the educational domain. Over the last 10 years, several studies have been conducted in different countries, involving in- and pre-service teachers and investigating their attitudes toward different student groups. Estimates of effects have varied and may be affected by sampling bias. To systematically review and integrate data from different studies, this meta-analysis focuses on teachers' implicit attitudes. Following the systematic search of the database and initial screening, 43 articles were identified from which 22, describing 34 studies, were retained for the meta-analysis after further inspection. First analyses revealed an estimated average effect size of 0.56 for implicit attitudes in favor of non-marginalized groups. As there was a large extent of heterogeneity between studies, several moderator variables were investigated. Results showed that the employed implicit measure and stimulus materials as well as the student target group affected the effect sizes. Low or non-significant relationships were reported between implicit and explicit attitudes. Findings are discussed in terms of theory and future research.

Introduction

In educational systems around the world, students experience disadvantages in school because of the distinct attributes they share. One such attribute concerns students' ethnicity or immigrant background. A common US definition specifies ethnic minorities as people who are grouped by their race or their cultural origin (Phinney, 1996). Research has shown that ethnic minority students lag behind their ethnic majority peers in academic achievement (Haycock, 2001; Dee, 2005; Marx and Stanat, 2012; Ehmke et al., 2013), tend to drop out of school earlier and often without certification (Rumberger, 1995; Coneus et al., 2009), and receive harsher punishments for misbehavior than their ethnic majority peers (Raffaele Mendez and Knoff, 2003; Peguero and Shekarkhar, 2011; Glock, 2016). Teachers greatly influence their students' academic achievement because they interact with the students in the classroom, assign grades, and refer the students to different school tracks. These interactions and decisions concerning grades and progression through school can partly explain the finding that ethnic minority students are overrepresented in special education programs (Sullivan and Artiles, 2011; Irvine, 2012) and more often classified as having special educational needs (SEN). Students with SEN can have different educational needs arising from medical conditions, learning or behavioral difficulties, or social disadvantages (OECD, 2007). These students also do less well-academically and are more likely to repeat a grade (Landrum et al., 2003). Teachers have lower academic expectations for students with learning or behavioral difficulties (Hornstra et al., 2010; Shifrer, 2013; Hafen et al., 2015), which in turn may influence their decision making and hence contribute to educational inequalities. A third group being disadvantaged in educational attainment concerns students who are overweight or obese. These students do not only suffer from social discrimination (Neumark-Sztainer et al., 2002; Warschburger, 2005), perform less well in school (Latinen et al., 2002; Datar et al., 2004; Shore et al., 2008), miss many days in school (Schwimmer et al., 2003; Geier et al., 2007), are more like to be held back a grade (Falkner et al., 2001), and have low prospects for personal growth (Pingitore et al., 1994; Cawley, 2004; Puhl and Heuer, 2009). Again, teachers contribute to these processes and teachers' expectations in particular are discussed to play a pivotal role when it comes to students with such distinct attributes (Jussim and Harber, 2005). Further vulnerable student groups include students from lower income families (Auwarter and Aruguete, 2008; OECD, 2010) and male students in terms of behavior (e.g., Arbuckle and Little, 2004) and language proficiency (e.g., Hopf and Hatzichristou, 1999; Krkovic et al., 2014) and female students in terms of their mathematical and science abilities (e.g., Keller, 2001; Shapiro and Williams, 2012).

In relation to expectations, attitudes might be vital when teachers are confronted with students representing the above introduced student groups. Attitudes are assumed to influence judgments as well as behavior (Olson and Fazio, 2009). Over the last 30 years, the distinction between implicit and explicit attitudes has been taken into account in social psychological research in many domains. However, in the educational context, the consideration of teachers' implicit attitudes is still in its infancy. In the last 10 years, several studies have been published which have provided mixed results. The aim of this meta-analysis is therefore: (1) to provide an average effect size, (2) to investigate potential moderators of implicit attitudes, and (3) to investigate the relationship between teachers' implicit and explicit attitudes.

Attitudes as Theoretical Construct

Attitudes are defined as the tendency to evaluate a “particular entity with some degree of favor or disfavor” (Eagly and Chaiken, 1993, p. 1). In their multi-component model, Eagly and Chaiken (1993) differentiate three different components, which add to the overall attitude. They define the cognitive component as knowledge and beliefs about the entity, while the affective component is constituted by the feelings associated with the entity. In case the entity is a social group, the cognitive component is compromised by stereotypes (Eagly and Mladinic, 1989), which are defined as generalized knowledge about the traits, attributes, and behaviors the members of a social group share (Smith, 1998). The last component is the behavioral one and consolidates two different ideas. Firstly, according to the self-perception theory formulated by Bem (1972) people may infer their attitudes from observing their behavior toward objects or persons. However, others argue that people's attitudes guide their behavior and in case of negatively evaluated groups, judgment bias or discrimination is likely to occur (Brewer and Kramer, 1985; Eagly and Chaiken, 1993). Hence the relationship between attitudes and behavior is considered bi-directional, whereby the strength of the attitude determines its impact on behavior and susceptibility to self-perception effects (Holland et al., 2002).

Attitudes are assumed to be the result of life-long experiences with the social group in question (Rudman, 2004). The same assumption underlies stereotypes as the cognitive component of attitudes (Taylor and Crocker, 1981). However, some additional factors come into play. In the early socialization processes, children learn and adopt initial attitudes from their parents (Aboud and Amato, 2001), but in time, attitudes change according to children's own experiences. Mostly, attitudes change in a more positive direction due to intergroup contact (Pettigrew, 1998). In the school context, the contact with students with SEN or students from ethnic minorities creates opportunities that might influence attitudes. Research on intergroup contact theory shows that particularly friendships with members from the negatively evaluated groups can change attitudes (Pettigrew and Tropp, 2008). This may be especially relevant for pre-service teachers that may have had opportunities to interact with students from diverse backgrounds, as in the last 20 years classrooms have become increasingly heterogeneous. Although such contact cannot be easily established if somebody chooses to not have contact with the members of such groups (Pettigrew, 2008), teachers may not have much choice as they usually cannot decide about the composition of their students in class. Other factors, which also fit the school context, are increasing the knowledge about different student groups and reducing the anxiety about interacting with members of these groups (Pettigrew and Tropp, 2008). The two factors are clearly related to teachers' professional experience (Berliner, 2001) and to effective teaching (Bransford et al., 2005; Sharma and Sokal, 2015). Hence, teachers' professional experience can make a difference in attitudes.

Another factor concerns the group membership of teachers themselves (although this may not equally apply to all student categories). Such group membership has a great influence on the socialization processes teachers underwent during their lifetime. For example, research concerning ethnicity has shown that ethnic minority children's attitudes already differ from those of children from ethnic majority groups (see Aboud and Amato, 2001, for an overview). These differences can stem from the dialogue with their parents, who often talk about the ethnic differences and social discrimination with their children (Aboud and Amato, 2001), which in turn makes them more sensitive for such ethnic issues. Additionally, research has shown that people, who belong to an ethnic minority group themselves, show a more differentiated view of their own group (Nosek et al., 2002) rather than the in-group favoritism often reported in ethnic majorities (Dasgupta, 2004). Nonetheless, when people from ethnic minorities perceive their group to be threatened by the majority, in-group favoritism occurs (Crocker et al., 1999). To this extent, teachers from ethnic minority groups might have experienced threat and disadvantages in school as ethnic minority students experience today, and therefore have a better understanding of the concerns ethnic minority students worry about (Gay, 2002; Villegas and Irvine, 2010).

Dual Modes of Attitudes

When talking about attitudes, the distinction between implicit and explicit attitudes should be taken into consideration. While explicit attitudes are suggested to be conscious evaluations and the result of deliberative processes, implicit attitudes are conceptualized as automatic evaluations (Gawronski and Bodenhausen, 2006) that come immediately into mind when the attitude object is present (Fazio, 2007; Olson and Fazio, 2009). Importantly, the distinction taps into the multicomponent model (Eagly and Chaiken, 1993) outlined above. Hence, implicit attitudes reflect the affective component, as they are suggested to be associations between the object and its evaluations (Fazio, 2007), which is taken into account in all implicit methods. The assessed evaluations mirror the feelings and valences related to the object, which are the result of automatic processes (Gawronski and Bodenhausen, 2007). In contrast, the explicit attitudes reflect the cognitive component because these often rely on beliefs about the attitude object (Gawronski and Bodenhausen, 2007).

The distinction is also taken into account in dual process models, such as the MODE (Motivation and Opportunity as Determinants; Fazio, 1990; Olson and Fazio, 2009). This model builds on the implicit-explicit distinction because it assumes that attitudes guide behavior via two different modes. The automatic path suggests that implicit attitudes mainly guides automatic and spontaneous behavior, while the controlled path assumes that the explicit attitudes guide controlled and conscious behavior. Such thoughtful and effortful processes however, can only occur when the cognitive resources are plentiful and people have much time and motivation to extensively reflect on their behavior and attitudes (Fazio, 1990; Fazio and Towles-Schwen, 1999). Therefore, people's motivation and the possibility to reflect influence which process occurs. Nonetheless, this stringent dichotomy cannot be easily maintained, as most of the processes are mixed with automatic and controlled processes and attitudes contributing to behavior (Olson and Fazio, 2009). Moreover, because of the automatic character of implicit attitudes, they are always activated in presence of the attitude object (Fazio, 2001) even when people do have the motivation and the possibility to reflect. Hence, implicit attitudes might contribute even to controlled behavior.

All these processes are of particular relevance in the school context. Teaching is stressful (van Dick and Wagner, 2001); teachers—and novice teachers in particular—feel overwhelmed by all the tasks they are required to fulfill (Anderson and Olsen, 2006) mostly under time constraints (Santavirta et al., 2007). This makes the influence of implicit attitudes on behavior more likely, particularly in situations in which teachers have to manage many tasks simultaneously. Such situations result in cognitive overload which paves the way for implicit attitudes and often leads to spontaneity and automaticity in behavior (Gawronski and Bodenhausen, 2006). Not only teacher behavior and their teaching practices in the classroom can be influenced by implicit attitudes but also teachers' judgments about students. To this extent, research has shown that attitudes are also related to judgments (Fazio, 1993; Fazio et al., 1995). Teachers are not only required to manage plentiful tasks, they are also confronted with distinct student groups in their class. Hence, the mere presence of students who share distinct attributes, activates implicit attitudes which, in turn, have the potential to impact subsequent teachers' judgment processes or behavioral decisions.

Implicit and Explicit Methods to Measure Attitudes

The distinction between implicit and explicit attitudes does not only hold for the differential theoretical conceptualization, but is also a measurement issue (Hofmann et al., 2005). Obviously, people often are not aware of their implicit attitudes (Fazio, 2007) and this automaticity requires different measurement methods than the consciousness of explicit attitudes. While explicit attitudes are assessed via self-reports such as questionnaires, Likert-scales, or semantic differentials, implicit methods often rely on reaction times (Wittenbrink and Schwarz, 2007). One of the most prominent methods is the Implicit Association Test (IAT; Greenwald et al., 1998), which is based on the assumption of the associative network theory (Wyer and Carlston, 1994). Within such a network, there are nodes and links. The nodes represent different constructs such as ethnic minority students or positive affect, and the different nodes are connected via links, which vary in strength, depending on how closely the different concepts and nodes are interrelated (Smith, 1998). The IAT utilizes these principals in a categorization task. If for instance, the construct and positive affect are strongly linked and interrelated, people should be able to categorize words or pictures representing the construct and positive affect more easily and faster when they share the same response key as when they share different keys or when the construct is paired with negative affect. The IAT is well-established and its validity (Greenwald et al., 2009) and reliability (Hofmann et al., 2005) is extensively documented. Another method, which is often used in empirical studies (De Houwer et al., 2009), is the Affective Priming Task (APT; Fazio et al., 1995). Like the IAT, this method relies on reaction times (De Houwer et al., 2009) and on associative network models, but does not only utilize the links between concepts, but also the idea of spreading activation (Collins and Loftus, 1975). In the APT, objects or constructs are shown, which should automatically activate the corresponding evaluation or affect. The evaluation is still active when people are asked to categorize words as pleasant or unpleasant directly afterwards. Other measure, such as the Affect Misattribution Procedure (AMP; Payne et al., 2005) or the Sorting Paired Features Task (Bar-Anan et al., 2009) rely on similar theoretical frameworks, but have not been used to the extent of the IAT or the APT.

Research to Date and Aim of the Meta-Analysis

Although numerous studies have focused on teachers' attitudes toward specific student groups, only a few reviews have been published (Sleeter, 2001; Sze, 2001; McCoach and Siegle, 2007; Glock and Kovacs, 2013). Only one of these focused specifically on studies concerning teachers' attitudes employing implicit measures (Glock and Kovacs, 2013). This review highlighted differences between teachers' implicit and explicit attitudes toward students from ethnic minorities or students with special educational needs and argued research should consider both to better understand their differential effects on teachers' classroom behaviors. As there typically is considerable methodological variation between studies, it remains unclear to what extent teachers hold differential implicit attitudes toward different groups of students. Therefore, the primary objective of the current meta-analysis was to estimate the average effect size of the relationship between student groups and teachers' implicit attitudes. In addition, we aimed to investigate variables that may affect teachers' implicit attitudes (moderator variables). We assumed studies using the IAT would yield stronger effects as the IAT—in contrast to the APT—requires participants to explicitly categorize the target. We also expected an effect for the modality of the prime target, as previous research indicates stronger effects for pictures than words (Spruyt et al., 2002). Furthermore, we expected that teachers' implicit attitudes may vary in accordance with the group of students that were considered. Given the fact that students with ethnic minority background are one of the most marginalized groups in educational systems (OECD, 2010), we expected that studies focusing on ethnicity would report stronger effects than studies focusing on other groups of students. In regards to professional status of teachers (pre- vs. in-service teachers), we expected stronger effects in studies involving pre-service teachers, as more positive attitudes have been reported for teachers with more teaching experience and contact with different groups of students (Pettigrew and Tropp, 2008; Glock et al., 2019). Lastly, we expected differences between European and non-European studies, given historical, political, cultural and educational differences between continents in regards to the perception of students from different target groups. In a final step, we considered to what extent teachers' implicit attitudes are related explicit attitudes.

Methods

Search Strategy

In order to identify studies focusing on teachers' implicit attitudes toward different student groups, a search within the electronic databases ERIC, PsychINfo, and Web of Science was conducted using the keywords: implicit attitudes AND teach* OR implicit attitudes AND education.

Only publications in English, as the shared scientific language, were considered, even though studies within this domain may have been published in other languages. In addition, the reference lists of identified papers were searched as well as content lists of journals in which more than two of these articles were published (i.e., Social Psychology of Education and Studies in Educational Evaluation). Only studies published in scientific journals were considered, excluding doctoral dissertations, book chapters, conference proceedings, and reports, to ensure that the studies had been subjected to a relative standardized procedure of peer-review.

Criteria for Including and Excluding Studies

To be included in the meta-analysis, studies had to be published in English in the last 20 years (1998–May 2019) and quantitative; implicit attitudes had to be measured as dependent variable and to be related to specific student attributes rather than to abstract constructs (e.g., “inclusion”); the implicit assessment had to reflect affective responses (like/dislike; positive/negative; good/bad) rather than perceived attributes (e.g., stereotype based expectations concerning students' behavior). Moreover, participants had to be pre- or in-service teachers; and studies had to provide effect sizes or provide sufficient data within the manuscript to compute these. We excluded studies focusing solely on explicit attitudes, studies measuring implicit stereotypes, studies involving peers or parents, qualitative studies, and studies published in languages other than English or in (edited) books, dissertations, or conference proceedings.

Our search identified 6,497 potentially relevant studies. Initial screening and removing duplicates reduced this pool to 53 articles which were subjected to further screening, after which an additional of 10 articles were excluded. After screening the full texts of the 43 articles, an additional of 21 were excluded (please see Figure 1 for specific criteria based on which these articles were excluded). We were able to extract 34 effects from the remaining 22 articles (see Figure 1).

FIGURE 1
www.frontiersin.org

Figure 1. Schematic presentation of selecting studies for meta-analysis (in accordance with PRISMA guidelines; Moher et al., 2009).

Data Preparation

For all studies, effect sizes were (re)coded in favor of the non-marginalized groups. More specifically, for all studies, positive d-scores reflect negative implicit attitudes toward the marginalized student groups (e.g., students with special needs or from ethnic minorities). Effect sizes were retrieved either as reported in the original manuscripts or computed based on reported descriptive statistics (Means and pooled SD), or reported test statistics such as correlations or ηP2 in accordance with the guidelines of Borenstein et al. (2009) and using an online tool (Lenhard and Lenhard, 2016).

For two studies (Conaway and Bethune, 2015; Krischler and Pit-ten Cate, 2019), multiple dependent effect-sizes related to multiple comparisons were reported. In accordance with the guidelines of Borenstein et al. (2009), these were averaged into a composite score. Some studies reported whole sample or average effect sizes, as well as additional effect sizes for separate social groups (e.g., attitudes toward male and female students from ethnic minorities), in which case only whole sample or average effect sizes were used. For studies that reported different effect sizes for different groups of teachers (e.g., pre- and in-service teachers) these were considered as separate studies (Borenstein et al., 2009; van Rhee et al., 2015) and all effect sizes were considered in the meta-analyses. For one study (Glock and Karbach, 2015), in which three different measures assessing implicit attitudes were compared employing a within-subjects design, we only considered the effect size based on the IAT, as the most commonly used instrument across the studies included in the meta-analysis.

In preparation for the meta-analysis, we noted the student group under investigation, direction of effect, effect size and SDES, number of participants, and professional status of the teachers, and country of study. If available, we added more detailed information on the participants (e.g., ethnic minority status). If the SD of the effect size was not available, we computed the variance based on the reported or estimated correlation, from with the standard error could be derived.

Statistical Analysis

We conducted the meta-analyses using an MS Excel workbook adapted from Suurmond et al. (2017). In a first step, we conducted a meta-analysis based on the individual effect size, standard error, and sample size. We used a random effects model, which assumes true effects to vary between studies (Borenstein et al., 2009; Field and Gillett, 2010) to estimate a mean effect. In addition, tests of heterogeneity were considered (Q, pq, T2, and I2). In a second step, we conducted moderator analyses to investigate the influence of four variables: country of study (European vs. non-European); assessment method (IAT vs. APT); professional status (pre-service vs. in-service); and student group (ethnic minority vs. other). Although other variables may be important (e.g., characteristics of the participants), such information was not systematically reported resulting in too many missing data points to reliably conduct a moderator analysis. Finally, we summarized results concerning the relationship between implicit and explicit attitudes.

Results

The data included 22 publications reporting 34 studies. Studies were published between 2010 and 2019. Implicit attitudes concerned students with varying ethnic minority backgrounds (23 studies), students with obesity (five studies), students with special educational needs (three studies), gifted students (two studies), or students from families with low socio-economic status (one study). These studies involved a total of 2,674 in- and pre-service teachers (number of participants per study ranged from 5 to 241). Studies were conducted in Europe (Germany, Italy, Luxembourg, the Netherlands), Asia (Hong Kong) and the United States of America. Most studies assessed implicit attitudes with a variation of the IAT (27 studies), whereas seven used the APT. Materials varied considerably between studies, with 18 studies using student names for the target category or prime and others using student photos (seven studies) or words (e.g., “learning difficulty” for SEN; nine studies). For the attributes, most studies (21 studies) used positive/negative categories, others good/bad (eight studies), or pleasant/unpleasant (five studies). Seventeen studies involved in-service teachers, 16 pre-service teachers, and one study both. Samples included in-service teachers in primary education (five studies), secondary or tertiary education (six studies), or both (five studies). Samples of pre-service teachers were generally mixed (five studies), but some only included pre-service teachers majoring in primary education (one study), secondary education (one study), or special education (one study). For 10 studies (nine involving pre-service teachers), the school type was not specified. Mostly, teachers were considered as a generic group, however, in some studies, they represented specific groups such as Physical Education (PE) teachers (three studies) or teachers with ethnic minority background (three studies). Detailed characteristics of the studies are presented in Table 1.

TABLE 1
www.frontiersin.org

Table 1. Studies included in the meta-analysis.

We firstly estimated a standardized mean effect using random effects weights (Borenstein et al., 2009). Assigned weights ranged from 2.68 to 3.01. Figure 2 illustrates the effect sizes for individual studies as well as the estimated average effect size for teachers' implicit attitudes.

FIGURE 2
www.frontiersin.org

Figure 2. Forest plot for effect size d and SE for each study (1–34) in the meta-analysis (Mean d = 0.56).

The analyses revealed a moderate estimated average effect size (Cohen's d) of 0.56, with a 95% confidence interval of 0.38–0.79 (Z = 6.61, p < 0.001). As the confidence interval does not contain zero, this result indicates that, on average, student characteristics affect teachers' implicit attitudes in favor of the majority group. This result should however be interpreted with caution given the range of observed effect sizes as indicated by the 95% prediction interval.

Sensitivity

We checked the sensitivity of this estimation by repeating the computations after (a) removing the study reporting the most negative attitudes toward the marginalized group (d = 2.00); (b) removing the study reporting the strongest positive attitudes toward the marginalized group (d = −0.41); and (c) excluding studies with specific groups of teachers (i.e., PE teachers and teachers with ethnic minority background). Summary statistics are reported in Table 2. Results indicate that the exclusion of certain studies, resulted in only small changes of the estimated average effect size and confidence intervals. However, excluding the studies which included specific groups of teachers (i.e., teachers with ethnic minority background, PE teachers and SEN teachers) reduced the 95% prediction range. Together these findings indicate that the results of the meta-analysis are relatively stable and do not vary substantially as a function of more stringent inclusion criteria.

TABLE 2
www.frontiersin.org

Table 2. Results of the sensitivity analyses.

Heterogeneity

Additional tests were conducted to investigate the degree of heterogeneity. Results showed that there was a significant variation around the estimated mean (Q = 13,907.90, p < 0.001) and that a very high proportion of the variability in effects was due to differences between the studies (I2 = 99.76%).

Moderator Analyses

Results of the sensitivity and heterogeneity tests indicate that there is a need for additional investigation of potential moderators. Therefore, in a second set of analyses, we tested the effect of the measure (IAT vs. APT); materials (student names vs. pictures and vs. words); student group (ethnicity vs. other, ethnicity vs. obesity and ethnicity vs. SEN); country of study (Europe vs. other), and teachers' professional status (pre-service vs. in-service). Results of these analyses, using a random effects model, are presented in Table 3.

TABLE 3
www.frontiersin.org

Table 3. Results of the Moderator analyses.

The first moderator was the measurement method. We expected differences between studies using the IAT and studies using the APT as previous research has indicated they may measure different constructs (Olson and Fazio, 2003). Even though the impact of the covariate was not significant, observation of the estimated average effect sizes are in line with our assumptions. More specifically, the estimated average effect for studies employing the IAT was moderate and positive, whereas for studies using the APT the estimated average effect is small. In addition to the between measure variation, we also investigated the possible impact of materials used. Results showed a significant effect for the materials used. However, in contrast with our expectations, effect sizes in studies using pictures as target or prime yielded lower effect than studies employing student names or words. The third moderator we investigated was the target group. Results of the analysis did not confirm our assumption as estimated average effects sizes were moderate for both groups and did not differ significantly. However, additional analyses comparing studies focusing on ethnicity with studies focusing on obesity and SEN, respectively, indicated that target groups did influence the effect sizes. Estimated average effect sizes for studies focusing on ethnicity were larger than those in studies focusing on SEN, but smaller than those in studies concerning obesity. Next, we investigated the effect of professional status of the teachers. Results did not confirm our assumption that in-service teachers would have more positive implicit attitudes than pre-service teachers. However, the differences between estimated effects was neither substantial nor significant. Lastly, we investigated the impact of the country in which the studies were conducted. Again, results yielded no substantial or significant differences. Although the impact of the individual covariates was not significant, of the 99.76% (I2) of between studies variance, 8.68% can be explained by the assessment method (measure), 5.62% by student category (increasing to 12.81% when comparing specific target groups), 3.94% by teachers' professional status, and only 0.37% by country.

Relations Between Implicit Attitudes and Explicit Attitudes

In a final step we considered relationships between implicit and explicit attitudes (see Table 4).

TABLE 4
www.frontiersin.org

Table 4. Relationship between teachers' implicit and explicit attitudes.

Given the debate on the theoretical difference between implicit and explicit attitudes, we checked the studies for the relations between the constructs. Within fifteen studies, correlations between implicit and explicit attitudes were reported. Only three studies reported a significant correlation, whereby in two studies (Glock and Kleen, 2019) more negative implicit attitudes toward ethnic minority students were associated with more prejudiced beliefs, whereas in the other (Harrison and Lakin, 2018b) pre-service teachers that expressed more positive explicit attitudes toward students with ethnic minority background (English learners) had more negative implicit attitudes toward this student group. For the other 12 studies, the association between implicit and explicit attitudes was small and not statistically significant.

Discussion

The meta-analysis considered studies focusing on teachers' implicit attitudes toward different student groups. Although the IAT was introduced 20 years ago (Greenwald et al., 1998), studies concerning implicit attitudes of teachers only appeared in the last 10 years. From our review of 22 articles comprising 34 studies, we conclude that on average teachers have more negative implicit attitudes toward marginalized groups. The estimated average effect size of 0.56 indicates that this effect is moderate. More specifically, teachers' implicit attitudes differ by half a standard deviation (range 0.38–0.73) in favor of the non-marginalized groups. Several sensitivity checks for the influence of outliers or specific participant groups did not alter the result. Additional results however indicated a large extent of heterogeneity between studies, which implies, the estimated average effect should be interpreted with caution as the effect may differentiate for specific groups of studies. In this regard several moderator analyses were conducted. Results of these analyses indicate that the measure used to assess implicit attitudes may impact the findings. This finding is in line with research showing mixed results concerning the convergent validity of both measures (Olson and Fazio, 2003). The dissociation may stem from differences between the measures. The IAT relies on the associative strength between target categories and attributes. In contrast, the APT is based on the extent to which a prime activates and subsequently facilitates the evaluation of adjectives presented afterwards (evaluative congruent response), whereby responses relate to individual objects rather than to the underlying category. Hence, the IAT and the APT may measure different constructs (Olson and Fazio, 2003) and hence yield different results. In this regard, it is also important to note that the analyzed studies used different stimulus materials within the measures. Where some used student names as a proxy of certain student characteristics, others used pictures or words. Although these variations may not impact the underlying principles of the assessment method, they do produce different effects. More specifically, results of our analyses indicate that using pictures as prime or target may result in smaller effects than when using student names or words. This finding is in contrast with previous findings for the APT, which indicated that using pictures as primes or target produced stronger effects than words (Spruyt et al., 2002). Hence, the influence of the modality of the target or prime may be method specific. Previous research has shown that inconsistent results may stem from the implicit measurement tool used (Glock and Karbach, 2015), especially as different measures apply different categorization tasks (Olson and Fazio, 2003) and hence responses may not only reflect automatic associations but also vary as a function of particular features of the stimuli or categories (De Houwer, 2003). Hence, employing multiple measures of implicit attitudes is recommended in implicit attitudes research.

Variations in findings between studies may also be related to contextual factors of implicit attitudes or its measurement (De Houwer, 2006). Such context sensitivity of implicit attitudes has previously been shown in the context of addictive behaviors (e.g., Glock and Pit-ten Cate, 2015), prejudice (Sherman et al., 2008; Allen et al., 2010), or Antiaging (Gonsalkorale et al., 2014) and should be considered more systematically in future research. Similarly, the context sensitivity of measurements has been demonstrated for both the IAT (e.g., Gonsalkorale et al., 2014) and the APT (e.g., Allen et al., 2010), and hence more advanced measures or models that are able to distinguish between different constructs or components (e.g., Conrey et al., 2005) could further advance this research field.

To this extent, it may also be important to consider the psychometric properties of the implicit measures. Several studies have evaluated the reliability and validity of the IAT (Nosek et al., 2005, 2007; Greenwald et al., 2009). For example, studies have shown that the reliability of the IAT depends on the selection of stimulus materials (Nosek et al., 2007) and may also be related to the scoring algorithm for computing the D-score (Greenwald et al., 2003). In regards to the validity, studies generally support the convergent and predictive validity of the IAT (Nosek et al., 2007; Greenwald et al., 2009), whereas for the construct validity, results are mixed (Nosek et al., 2005; Schimmack, 2019). Therefore, a multimethod, multimodal research design may be preferred to study to what extent people's feelings, thought, or beliefs affect their behaviors, especially when studying sensitive issues (Schimmack, 2019). Given these results, researchers should be aware of differences between and within measures and choose and interpret their method accordingly.

Effect sizes were also affected by the target group under consideration. Estimated average effect sizes varied from small (SEN) to moderate (ethnicity) to large (obesity). It may not be surprising that teachers' implicit attitudes vary based on target group. Teachers' affective responses are based on their experiences and beliefs, which may vary in relation to the group of students under consideration. In this regard, it should be noted that the different samples may have had an additional effect on these findings. For example, in three of the five studies concerning obesity, the sample consisted of PE teachers. These teachers may have different expectations about their students, especially in relation to their ability to do well in sports. In this vein, the weight of a student can more profoundly influence his or her achievement in sport than in the academic subjects. Lau et al. (2018) tested for differences between PE and non-PE teachers but—although implicit stereotypes varied between teacher groups—their implicit attitudes did not. In contrast, for studies focusing on ethnicity, differences between different groups of teachers have been shown, whereby teachers from ethnic minorities (Glock and Kleen, 2019; Kleen et al., 2019) or teachers working in ethnically diverse settings (Glock et al., 2019) show less biased attitudes toward ethnic minority students than teachers belonging to the majority group or working in ethnically homogeneous school settings.

Interestingly, professional status of the teachers (pre- vs. in-service) did not affect the estimated average effect sizes. Previous research indicated that teachers with more teaching experience, especially experience in teaching specific groups of students (de Boer et al., 2011; Glock et al., 2019), show less biased attitudes, which may be explained by increased intergroup contact (Pettigrew, 1998). It may be that the pre-service teachers in the reviewed studies (all published in the last 10 years) already have had opportunities for intergroup contact (Castro and Murray, 2012) or that teacher education programs have specifically prepared them for teaching multicultural (e.g., Sleeter and Owuor, 2011) and diverse (e.g., Sharma and Sokal, 2015) student groups. In addition, intergroup contact may have differential effects on attitudes and beliefs, whereby intergroup contact especially reduces stereotype based prejudice (Weber and Crocker, 1983; Pettigrew and Tropp, 2006). To this extent, some studies in our meta-analysis reported that contact (Hein et al., 2011) or professional status (Krischler and Pit-ten Cate, 2019) resulted in differences in explicit attitudes and beliefs but not implicit attitudes. In contrast, Glock et al. (2019) found that teachers working in heterogeneous schools had less biased implicit attitudes than teachers in homogeneous settings.

The country, in which the studies were conducted, also did not affect the estimated average affect size. This indicates that teachers' implicit attitudes toward certain groups of students are universal (in the western world). This notion is supported by research showing comparable educational inequalities for marginalized groups, especially students from ethnic minorities (Haycock, 2001; Van de Werfhorst and Mijs, 2010; Marx and Stanat, 2012; Peterson et al., 2016).

Findings reported in the studies in this meta-analysis indicate there may be other moderators, such as student gender (Glock and Klapproth, 2017; Kleen and Glock, 2018; Kleen et al., 2019), teacher background or school environment (Kleen and Glock, 2018; Glock et al., 2019; Glock and Kleen, 2019; Kleen et al., 2019) or school track (e.g., Glock and Klapproth, 2017). However, such information was only systematically considered and reported for a very few studies and hence could not be considered in the meta-analysis. Furthermore, it may well be possible that interactions between moderator variables affect effect sizes. However, the program used to conduct the meta-analysis only allows for the assessment of individual moderators (van Rhee et al., 2015) and hence interactions could not be investigated.

Given the theoretical and methodological differences between implicit and explicit attitudes, it is not surprising that all the considered studies reported small or non-significant correlations. These consistent finding validate the distinction between the constructs and indicate both should be considered in attitude research. Only few studies investigate the link between implicit attitudes and teachers' expectations and students' achievement and provide mixed results. More specifically, only in one study (van den Bergh et al., 2010) implicit attitudes were associated with differential expectations, whereas in others this association was not significant (Hornstra et al., 2010; Kumar et al., 2015). Only two studies investigated the association between implicit attitudes and students' actual achievement outcomes (Hornstra et al., 2010; van den Bergh et al., 2010), both supporting the notion that teachers' negative implicit attitudes were related to differences in achievement between student groups. Kumar et al. (2015) were able to show that teachers' with more negative implicit attitudes toward ethnic minority students were less likely to promote respect among the students and resolve interethnic conflicts. Due to the correlational nature of the analysis, cause-effect relationships remain unclear. Other studies have relied on theoretical frameworks to reason about the implications of differential implicit attitudes in favor of non-marginalized groups for students' school trajectories and educational inequalities. These findings indicate that future research should investigate possible links between implicit attitudes and other constructs more systematically to test the suitability of the theoretical models concerning attitudes within the educational domain and to gain better understanding of underlying mechanisms that contribute to the educational inequalities that different groups of students experience.

Limitations

Some limitations should be noted. First, we only considered English journal articles. The exclusion of other publication formats and publications in other languages may have biased the result and may have resulted in a stronger estimated average effect size. However, due to the observed heterogeneity, the estimated average effect size should already be interpreted with caution. Second, the program used to conduct the meta-analysis does not allow for testing simultaneous or interaction effects of moderators. This may limit the extent to which the complexity of relationships between variables and constructs can be fully understood. As the field develops further and the number of publications increases, future analyses could consider different statistical methods which allow for clustering of effects and enable the investigation of interaction effects (Cheung, 2014; Li et al., 2019). Similarly, the number and details of the included studies only allowed a few moderators to be investigated. As the number of studies increases, additional moderator and subgroup analyses may be conducted. Lastly, not all studies reported sufficient details to draw conclusions on specific characteristics of the sample or to distinguish between subgroups within the sample. Nonetheless, such details may be important to determine variations in implicit attitudes between groups, which in turn, may provide guidance for teacher education programs.

Conclusion

Although the reviewed research concerning implicit attitudes is characterized by methodological variability, results of the meta-analysis indicate teachers' implicit attitudes are on average moderately biased in favor of non-marginalized groups. The meta-analysis allowed us to investigate different sources of variation and hence provide some directions for future research. Studies in the meta-analysis varied most notably in the use of the implicit attitudes measure, stimulus materials, and target group. Although variation in teachers' professional status was present, this did not seem to affect the results. Instead, it may be specific teacher characteristics (e.g., demographic differences) or differences in school environments that impact their attitudes toward different student groups. Future research should more systematically consider group differences to better understand underlying mechanisms in the formation of implicit attitudes. Of course, methodological differences may also account for differences between studies and future research should consider how differences in design or measurement may affect results. In this context it should be noted that previous research has indicated that implicit attitudes measurement may be affected by both the strength of the association between the object and its evaluations as well as non-associative processes (e.g., self-regulation, context sensitivity). To this extent, more advanced modeling may be used to distinguish between different cognitive processes in the regulation of responses (e.g., Quad model, Conrey et al., 2005; Trip model, Nadarevic and Erdfelder, 2011; ReAL model, Meissner and Rothermund, 2013). Furthermore, one could consider using multimodal measures to further investigate cognitive processes involved in completing implicit measures. For example, Healy et al. (2015) demonstrated that Electroencephalography could be used to examine the extent to responses to implicit measures are resulting from automatic association (activation) or context factors, by relating neural activity to different phases in the IAT. Both the advanced modeling and multimodal approaches could contribute to our understanding of implicit attitudes within the educational area.

The IAT measure may provide the strongest effects, possibly linked to the explicit categorization of groups. For this measure, student names or words may be more suitable for use as targets/primes than pictures. The greatest caveat is, however, formed by the lack of research regarding the association between implicit attitudes, teacher expectations and behavior and, in turn, student outcomes.

Author Contributions

SG contributed to the conceptualization of the study, the selection of the studies to be included in the meta-analysis, and the theoretical framework of the paper. She edited and approved the final manuscript. IP contributed to the conceptualization of the study, conducted the systematic search, contributed to selection of the studies to be included, and conducted the meta-analysis. She produced the final draft of the manuscript.

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

References

Aboud, F. E., and Amato, M. (2001). “Developmental and socialisation influences on intergroup bias,” in Blackwell Handbook of Social Psychology: Intergroup Processes, eds R. Brown and S. L. Gaertner (Malden, MA: Blackwell Publishers), 65–85. doi: 10.1002/9780470693421.ch4

CrossRef Full Text | Google Scholar

Allen, T. J., Sherman, J. W., and Klauer, K. C. (2010). Social context and the self-regulation of implicit bias. Group Process. Intergroup Relat. 13, 137–149. doi: 10.1177/1368430209353635

CrossRef Full Text | Google Scholar

Anderson, L., and Olsen, B. (2006). Investigating early career urban teachers' perspectives on and experiences in professional development. J Teach. Educ. 57, 359–377. doi: 10.1177/0022487106291565

CrossRef Full Text | Google Scholar

Arbuckle, C., and Little, E. (2004). Teachers' perceptions and management of disruptive classroom behaviour during the middle years (years five to nine). Aust. J. Educ. Dev. Psychol. 4, 59–70.

Google Scholar

Auwarter, A. E., and Aruguete, M. S. (2008). Effects of student gender and socioeconomic status on teacher perceptions. J. Educ. Res. 101, 242–246. doi: 10.3200/JOER.101.4.243-246

CrossRef Full Text | Google Scholar

Bar-Anan, Y., Nosek, B. A., and Vianello, M. (2009). The sorting paired features task. Exp. Psychol. 56, 329–343. doi: 10.1027/1618-3169.56.5.329

PubMed Abstract | CrossRef Full Text | Google Scholar

Bem, D. J. (1972). Self-perception theory. Adv. Exp. Soc. Psychol. 6, 1–62. doi: 10.1016/S0065-2601(08)60024-6

CrossRef Full Text | Google Scholar

Berliner, D. C. (2001). “Expert teachers: their characteristics, development and accomplishments,” in de la Teoria a l'aula: Formacio del Professorat Ensenyament de las Ciències Socials, eds R. Batollori, A. Ernesto-Gómez, M. Oller, and J. Pages (Barcelona: Departament de Didàctica de la Llengua de la Literatura I de les Ciències Socials; Universitat Autònoma de Barcelona), 13–28.

Google Scholar

Borenstein, M., Hedges, L. V., Higgins, J. P. T., and Rothsetin, H. R. (2009). Introduction to Meta-Analysis. Chichester: Wiley. doi: 10.1002/9780470743386

PubMed Abstract | CrossRef Full Text | Google Scholar

Bransford, J., Darling-Hammond, L., and LePage, P. (2005). “Introduction,” in Preparing Teachers for Changing World, eds L. Darling-Hammond and J. Bransford (San Francisco, CA: Jossey-Bass), 1–39.

Google Scholar

Brewer, M. B., and Kramer, R. M. (1985). The psychology of intergroup attitudes and behavior. Annu. Rev. Psychol. 36, 219–243. doi: 10.1146/annurev.ps.36.020185.001251

CrossRef Full Text | Google Scholar

Castro, F. G., and Murray, K. E. (2012). “Cultural adaptation and resilience: controversies, issues and emerging models,” in Handbook of Adult Resilience, eds J. W. Reich, A. J. Zautra, and J. S. Hall (New York, NY: Guildford Press), 375–403.

Google Scholar

Cawley, J. (2004). The impact of obesity on wages. J. Hum. Resour. 39, 451–474. doi: 10.3368/jhr.XXXIX.2.451

CrossRef Full Text | Google Scholar

Cheung, M. W. L. (2014). Modeling dependent effect sizes with three-level meta-analyses: a structural equation modeling approach. Psychol. Methods 19, 211–229. doi: 10.1037/a0032968

PubMed Abstract | CrossRef Full Text | Google Scholar

Collins, A. M., and Loftus, E. F. (1975). A spreading activation theory of semantic processing. Psychol. Rev. 82, 407–428. doi: 10.1037//0033-295X.82.6.407

CrossRef Full Text | Google Scholar

Conaway, W., and Bethune, S. (2015). Implicit bias and first name stereotypes : what are the implications for online instruction? Online Learn. 19, 162–178. doi: 10.24059/olj.v19i3.674

CrossRef Full Text | Google Scholar

Coneus, K., Gernandt, J., and Saam, M. (2009). Noncognitive skills, school achievements and educational dropout. ZEW Discussion Papers, No. 09-019. doi: 10.2139/ssrn.1403224

CrossRef Full Text | Google Scholar

Conrey, F. R., Sherman, J. W., Gawronski, B., Hugenberg, K., and Groom, C. J. (2005). Separating multiple processes in implicit social cognition: the quad model of implicit task performance. J. Pers. Soc. Psychol. 89, 469–487. doi: 10.1037/0022-3514.89.4.469

PubMed Abstract | CrossRef Full Text | Google Scholar

Crocker, J., Luhtanen, R., Broadnax, S., and Blaine, B. E. (1999). Belief in U.S. government conspiracies against blacks among black and white college students: powerlessness or system blame? Pers. Soc. Psychol. Bull. 25, 941–953. doi: 10.1177/01461672992511003

CrossRef Full Text | Google Scholar

Dasgupta, N. (2004). Implicit ingroup favoritism, outgroup favoritism, and their behavioral manifestations. Soc. Justice Res. 17, 143–169. doi: 10.1023/B:SORE.0000027407.70241.15

CrossRef Full Text | Google Scholar

Datar, A., Sturm, R., and Magnabosco, J. L. (2004). Childhood overweight and academic performance: national study of kindergartners and first-graders. Obes. Res. 12, 58–68. doi: 10.1038/oby.2004.9

PubMed Abstract | CrossRef Full Text | Google Scholar

de Boer, A., Pijl, S. J., and Minnaert, A. (2011). Regular primary schoolteachers' attitudes towards inclusive education: a review of the literature. Int. J. Inclusive Educ. 15, 331–353. doi: 10.1080/13603110903030089

CrossRef Full Text | Google Scholar

De Houwer, J. (2003). The extrinsic affective simon task. Exp. Psychol. 50, 77–85. doi: 10.1026//1618-3169.50.2.77

PubMed Abstract | CrossRef Full Text | Google Scholar

De Houwer, J. (2006). “What are implicit measures and why are we using them?” in The Handbook of Implicit Cognition and Addiction, eds R. W. Wiers and A. W. Stacy (Thousand Oaks, CA: Sage Publisher), 11–28. doi: 10.4135/9781412976237.n2

CrossRef Full Text | Google Scholar

De Houwer, J., Teige-Mocigemba, S., Spruyt, A., and Moors, A. (2009). Implicit measures: a normative analysis and review. Psychol. Bull. 135, 347–368. doi: 10.1037/a0014211

PubMed Abstract | CrossRef Full Text | Google Scholar

Dee, T. S. (2005). A teacher like me: does race, ethnicity, or gender matter? Am. Econ. Rev. 95, 158–165. doi: 10.1257/000282805774670446

CrossRef Full Text | Google Scholar

Eagly, A. H., and Chaiken, S. (1993). The Psychology of Attitudes. Fort Worth, TX: Harcourt Brace Jovanovich.

Google Scholar

Eagly, A. H., and Mladinic, A. (1989). Gender stereotypes and attitudes toward women and men. Pers. Soc. Psychol. Bull. 15, 543–558. doi: 10.1177/0146167289154008

CrossRef Full Text | Google Scholar

Ehmke, T., Klieme, E., and Stanat, P. (2013). Veränderungen der Lesekompetenz von PISA 2000 nach PISA 2009. Die Rolle von Unterschieden in den Bildungswegen und in der Zusammensetzung der Schülerschaft. Zeitschrift Für Pädagogik. 59, 132–150.

Google Scholar

Falkner, N. H., Neumark-Sztainer, D., Story, M., Jeffery, R. W., Beuhring, T., and Resnick, M. D. (2001). Social, educational, and psychological correlates of weight status in adolescents. Obes. Res. 9, 32–42. doi: 10.1038/oby.2001.5

PubMed Abstract | CrossRef Full Text | Google Scholar

Fazio, R. H. (1990). “Multiple processes by which attitudes guide behavior: the MODE model as an integrative framework,” in Advances in Experimental Social Psychology, ed M. P. Zanna (New York, NY: Academic Press), 75–109. doi: 10.1016/S0065-2601(08)60318-4

CrossRef Full Text | Google Scholar

Fazio, R. H. (1993). Variability in the likelihood of automatic attitude activation: data reanalysis and commentary on Bargh, Chaiken, Govender, and Pratto (1992). J. Pers. Soc. Psychol. 64, 753–758. doi: 10.1037//0022-3514.64.5.753

PubMed Abstract | CrossRef Full Text | Google Scholar

Fazio, R. H. (2001). On the automatic activation of associated evaluations: an overview. Cogn. Emotion 15, 115–141. doi: 10.1080/02699930125908

CrossRef Full Text | Google Scholar

Fazio, R. H. (2007). Attitudes as object-evaluation associations of varying strength. Soc. Cogn. 25, 664–703. doi: 10.1521/soco.2007.25.5.603

PubMed Abstract | CrossRef Full Text | Google Scholar

Fazio, R. H., Jackson, J. R., Dunton, B. C., and Williams, C. J. (1995). Variability in automatic activation as an unobtrusive measure of racial attitudes: a bona fide pipeline? J. Pers. Soc. Psychol. 69, 1013–1027. doi: 10.1037/0022-3514.69.6.1013

PubMed Abstract | CrossRef Full Text | Google Scholar

Fazio, R. H., and Towles-Schwen, T. (1999). “The MODE model of attitude-behavior processes,” in Dual Process Theories in Social Psychology, eds S. Chaiken and Y. Trope (New York, NY: Guildford Press), 97–119.

Google Scholar

Field, A. P., and Gillett, R. (2010). How to do a meta-analysis. Br. J. Math. Stat. Psychol. 63, 665–694. doi: 10.1348/000711010X502733

PubMed Abstract | CrossRef Full Text | Google Scholar

Fontana, F. E., Furtado, O., Marston, R., Mazzardo, O., and Gallagher, J. (2013). Anti-fat bias among physical education teachers and majors. Phys. Educ. 70, 15–31.

Google Scholar

Gawronski, B., and Bodenhausen, G. V. (2006). Associative and propositional processes in evaluation: an integrative review of implicit and explicit attitude change. Psychol. Bull. 132, 692–731. doi: 10.1037/0033-2909.132.5.692

PubMed Abstract | CrossRef Full Text | Google Scholar

Gawronski, B., and Bodenhausen, G. V. (2007). Unraveling the processes underlying evaluation: attitudes from the perspective of the APE model. Soc. Cogn. 25, 687–717. doi: 10.1521/soco.2007.25.5.687

CrossRef Full Text | Google Scholar

Gay, G. (2002). Preparing for culturally responsive teaching. J. Teach. Educ. 53, 106–116. doi: 10.1177/0022487102053002003

CrossRef Full Text | Google Scholar

Geier, A. B., Foster, G. D., Womble, L. G., McLaughlin, J., Borradaile, K. E., Nachmani, J., et al. (2007). The relationship between relative weight and school attendance among elementary schoolchildren. Obesity 15, 2157–2161. doi: 10.1038/oby.2007.256

PubMed Abstract | CrossRef Full Text | Google Scholar

Glock, S. (2016). Stop talking out of turn: the influence of students' gender and ethnicity on preservice teachers' intervention strategies for student misbehavior. Teach. Teach. Educ. 56, 106–114. doi: 10.1016/j.tate.2016.02.012

CrossRef Full Text | Google Scholar

Glock, S., and Karbach, J. (2015). Preservice teachers' implicit attitudes toward racial minority students: evidence from three implicit measures. Stud. Educ. Eval. 45, 55–61. doi: 10.1016/j.stueduc.2015.03.006

CrossRef Full Text | Google Scholar

Glock, S., and Klapproth, F. (2017). Bad boys, good girls? Implicit and explicit attitudes toward ethnic minority students among elementary and secondary school teachers. Stud. Educ. Eval. 53, 77–86. doi: 10.1016/j.stueduc.2017.04.002

CrossRef Full Text | Google Scholar

Glock, S., and Kleen, H. (2019). Attitudes toward students from ethnic minority groups: the roles of preservice teachers' own ethnic backgrounds and teacher efficacy activation. Stud. Educ. Eval. 62, 82–91. doi: 10.1016/j.stueduc.2019.04.010

CrossRef Full Text | Google Scholar

Glock, S., Kneer, J., and Kovacs, C. (2013). Preservice teachers? implicit attitudes toward students with and without immigration background: a pilot study. Stud. Educ. Eval. 39, 204–210. doi: 10.1016/j.stueduc.2013.09.003

CrossRef Full Text | Google Scholar

Glock, S., and Kovacs, C. (2013). Educational psychology: using insights from implicit attitude measures. Educ. Psychol. Rev. 25, 503–522. doi: 10.1007/s10648-013-9241-3

CrossRef Full Text | Google Scholar

Glock, S., Kovacs, C., and Pit-ten Cate, I. M. (2019). Teachers' attitudes towards ethnic minority students: effects of schools' cultural diversity. Brit. J. Educ. Psychol. 89, 616–634. doi: 10.1111/bjep.12248

PubMed Abstract | CrossRef Full Text | Google Scholar

Glock, S., Oude Groote Beverborg, A., and Müller, B. C. N. (2016). Pre-service teachers' implicit and explicit attitudes toward obesity influence their judgments of students. Soc. Psychol. Educ. 19, 97–115. doi: 10.1007/s11218-015-9315-9

CrossRef Full Text | Google Scholar

Glock, S., and Pit-ten Cate, I. M. (2015). “Smoking, implicit attitudes, and context-sensitivity: an overview,” in Exploring Implicit Cognition: Learning, Memory, and Social Cognitive Processes, ed Z. Jin (Hershey, PA: IGI Global), 138–161. doi: 10.4018/978-1-4666-6599-6.ch007

CrossRef Full Text | Google Scholar

Gonsalkorale, K., Sherman, J. W., and Klauer, K. C. (2014). Measures of implicit attitudes may conceal differences in implicit associations: the case of antiaging bias. Soc. Psychol. Pers. Sci. 5, 271–278. doi: 10.1177/1948550613499239

CrossRef Full Text | Google Scholar

Greenwald, A. G., McGhee, D. E., and Schwartz, J. K. L. (1998). Measuring individual differences in implicit cogntion: the implicit association test. J. Pers. Soc. Psychol. 74, 1464–1480. doi: 10.1037//0022-3514.74.6.1464

PubMed Abstract | CrossRef Full Text | Google Scholar

Greenwald, A. G., Nosek, B. A., and Banaji, M. R. (2003). Understanding and using the implicit association test: I. An improved scoring algorithm. J. Pers. Soc. Psychol. 85, 197–216. doi: 10.1037/0022-3514.85.2.197

PubMed Abstract | CrossRef Full Text | Google Scholar

Greenwald, A. G., Poehlman, T. A., Uhlmann, E. L., and Banaji, M. R. (2009). Understanding and using the implicit association test: III. Meta-analysis of predictive validity. J. Pers. Soc. Psychol. 97, 17–41. doi: 10.1037/a0015575

PubMed Abstract | CrossRef Full Text | Google Scholar

Hafen, C. A., Ruzek, E. A., Gregory, A., Allen, J. P., and Mikami, A. Y. (2015). Focusing on teacher-student interactions eliminates the negative impact of students disruptive behavior on teacher perceptions. Int. J. Behav. Dev. 39, 426–431. doi: 10.1177/0165025415579455

PubMed Abstract | CrossRef Full Text | Google Scholar

Harrison, J., and Lakin, J. (2018a). Mainstream teachers' implicit beliefs about English Language Learners: an implicit association test study of teacher beliefs. J. Lang. Identity Educ. 17, 85–102. doi: 10.1080/15348458.2017.1397520

CrossRef Full Text | Google Scholar

Harrison, J., and Lakin, J. (2018b). Pre-service teachers' implicit and explicit beliefs about English language learners?: an implicit association test study. Teach. Teacher Educ. 72, 54–63. doi: 10.1016/j.tate.2017.12.015

CrossRef Full Text | Google Scholar

Haycock, K. (2001). Closing the achievement gap. Educ. Leadersh. 58, 6–11.

Google Scholar

Healy, G. F., Boran, L., and Smeaton, A. F. (2015). Neural patterns of the implicit association test. Front. Hum. Neurosci. 9, 1–16. doi: 10.3389/fnhum.2015.00605

PubMed Abstract | CrossRef Full Text | Google Scholar

Hein, S., Grumm, M., and Fingerle, M. (2011). Is contact with people with disabilities a guarantee for positive implicit and explicit attitudes? Eur. J. Spec. Needs Educ. 26, 509–522. doi: 10.1080/08856257.2011.597192

CrossRef Full Text | Google Scholar

Hofmann, W., Gschwendner, T., Nosek, B. A., and Schmitt, M. (2005). What moderates implicit—explicit consistency? Eur. Rev. Soc. Psychol. 16, 335–390. doi: 10.1080/10463280500443228

CrossRef Full Text | Google Scholar

Holland, R. W., Verplanken, B., and Van Knippenberg, A. (2002). On the nature of attitude-behavior relations: the strong guide, the weak follow. Eur. J. Soc. Psychol. 32, 869–876. doi: 10.1002/ejsp.135

CrossRef Full Text | Google Scholar

Hopf, D., and Hatzichristou, C. (1999). Teacher gender-related influences in Greek schools. Br. J. Educ. Psychol. 69, 1–18. doi: 10.1348/000709999157527

CrossRef Full Text | Google Scholar

Hornstra, L., Denessen, E., Bakker, J., van den Bergh, L., and Voeten, M. (2010). Teacher attitudes toward dyslexia: effects on teacher expectations and the academic achievement of students with dyslexia. J. Learn. Disabil. 43, 515–529. doi: 10.1177/0022219409355479

PubMed Abstract | CrossRef Full Text | Google Scholar

Irvine, J. J. (2012). Complex relationships between multicultural education and special education: an African American perspective. J. Teach. Educ. 63, 268–274. doi: 10.1177/0022487112447113

CrossRef Full Text | Google Scholar

Jussim, L., and Harber, K. D. (2005). Teacher expectations and self-fulfilling prophecies: knowns and unknowns, resolved and unresolved controversies. Pers. Soc. Psychol. Rev. 9, 131–155. doi: 10.1207/s15327957pspr0902_3

PubMed Abstract | CrossRef Full Text | Google Scholar

Keller, C. (2001). Effect of teachers' stereotyping on students' stereotyping of mathematics as a male domain. J. Soc. Psychol. 141, 165–173. doi: 10.1080/00224540109600544

PubMed Abstract | CrossRef Full Text | Google Scholar

Kleen, H., Bonefeld, M., Glock, S., and Dickhäuser, O. (2019). Implicit and explicit attitudes toward Turkish students in Germany as a function of teachers' ethnicity. Soc. Psychol. Educ. 22, 883–899. doi: 10.1007/s11218-019-09502-9

CrossRef Full Text | Google Scholar

Kleen, H., and Glock, S. (2018). The roles of teacher and student gender in German teachers' attitudes toward ethnic minority students. Stud. Educ. Eval. 59, 102–111. doi: 10.1016/j.stueduc.2018.04.002

CrossRef Full Text | Google Scholar

Krischler, M., and Pit-ten Cate, I. M. (2019). Pre- and in-service teachers' attitudes toward students with learning difficulties and challenging behavior. Front. Psychol. 10, 1–10. doi: 10.3389/fpsyg.2019.00327

PubMed Abstract | CrossRef Full Text | Google Scholar

Krkovic, K., Greiff, S., Kupiainen, S., Vainikainen, M. P., and Hautamäki, J. (2014). Teacher evaluation of student ability: what roles do teacher gender, student gender, and their interaction play? Educ. Res. 56, 244–257. doi: 10.1080/00131881.2014.898909

CrossRef Full Text | Google Scholar

Kumar, R., Karabenick, S. A., and Burgoon, J. N. (2015). Teachers' implicit attitudes, explicit beliefs, and the mediating role of respect and cultural responsibility on mastery and performance-focused instructional practices. J. Educ. Psychol. 107, 533–545. doi: 10.1037/a0037471

CrossRef Full Text | Google Scholar

Landrum, T., Tankersley, M., and Kauffmann, J. (2003). What is special about special education for students with emotional or behavioral disorders? J. Spec. Educ. 37, 148–156. doi: 10.1177/00224669030370030401

CrossRef Full Text | Google Scholar

Latinen, J., Power, C., Ek, E., Sovio, U., and Järvelin, M. R. (2002). Unemployment and obesity among young adults in a northern Finland 1966 birth cohort. Int. J. Obes. 26, 1329–1338. doi: 10.1038/sj.ijo.0802134

CrossRef Full Text | Google Scholar

Lau, P. W. C., Leung, B. W. C., Pitkethly, A. J., and Ransdell, L. (2018). Do physical education teachers and general teachers differ in their implicit anti-fat bias? Int. J. Phys. Educ. 55, 27–37.

Google Scholar

Lenhard, W., and Lenhard, A. (2016). Calculation of Effect Sizes. Dettelbach. Retrieved from: https://www.psychometrica.de/effect_size.html

Google Scholar

Li, X., Dusseldorp, E., and Meulman, J. J. (2019). A flexible approach to identify interaction effects between moderators in meta-analysis. Res. Synth. Methods 10, 134–152. doi: 10.1002/jrsm.1334

PubMed Abstract | CrossRef Full Text | Google Scholar

Markova, M., Pit-ten Cate, I. M., Krolak-Schwerdt, S., and Glock, S. (2016). Preservice teachers? attitudes toward inclusion and toward students with special educational needs from different ethnic backgrounds. J. Exp. Educ. 84, 554–578. doi: 10.1080/00220973.2015.1055317

CrossRef Full Text | Google Scholar

Marx, A. E., and Stanat, P. (2012). Reading comprehension of immigrant students in Germany: research evidence on determinants and target points for intervention. Reading Writing 25, 1929–1945. doi: 10.1007/s11145-011-9307-x

CrossRef Full Text | Google Scholar

McCoach, D. B., and Siegle, D. (2007). What predicts teachers' attitudes toward the gifted? Gifted Child Q. 51, 246–254. doi: 10.1177/0016986207302719

CrossRef Full Text | Google Scholar

Meissner, F., and Rothermund, K. (2013). Estimating the contributions of associations and recoding in the implicit association test: the ReAL model for the IAT. J. Pers. Soc. Psychol. 104, 45–69. doi: 10.1037/a0030734

PubMed Abstract | CrossRef Full Text | Google Scholar

Moher, D., Liberati, A., Tetzlaff, J., and Altman, D. G. (2009). Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ 339:b2535. doi: 10.1136/bmj.b2535

PubMed Abstract | CrossRef Full Text | Google Scholar

Nadarevic, L., and Erdfelder, E. (2011). Cognitive processes in implicit attitude tasks: an experimental validation of the trip model. Eur. J. Soc. Psychol. 41, 254–268. doi: 10.1002/ejsp.776

CrossRef Full Text | Google Scholar

Neumark-Sztainer, D., Falkner, N., Story, M., Perry, C., Hannan, P. J., and Mulert, S. (2002). Weight-teasing among adolescents: correlations with weight status and disordered eating behaviors. Int. J. Obes. 26, 123–131. doi: 10.1038/sj.ijo.0801853

PubMed Abstract | CrossRef Full Text | Google Scholar

Nosek, B. A., Banaji, M. R., and Greenwald, A. G. (2002). Harvesting implicit group attitudes and beliefs from a demonstration web site. Group Dyn. 6, 101–115. doi: 10.1037//1089-2699.6.1.101

CrossRef Full Text | Google Scholar

Nosek, B. A., Greenwald, A. G., and Banaji, M. R. (2005). Understanding and using the implicit association test: II. Method variables and construct validity. Pers. Soc. Psychol. Bull. 31, 166–180. doi: 10.1177/0146167204271418

PubMed Abstract | CrossRef Full Text | Google Scholar

Nosek, B. A., Greenwald, A. G., and Banaji, M. R. (2007). “The implicit association test at age 7: a methodological and conceptual review,” in Automatic Processes in Social Thinking and Behavior, ed J. A. Bargh (New York, NY: Psychology Press), 265–292.

Google Scholar

OECD (2007). Students With Disabilities, Learning Difficulties and Disadvantages: Policies, Statistics, and Indicators. Paris: OECD.

Google Scholar

OECD (2010). PISA 2009 Results: Overcoming Social Background–Equity in Learning Opportunities and Outcomes, Vol. II. Paris: OECD Publishing. doi: 10.1787/9789264091504-en

CrossRef Full Text | Google Scholar

Olson, M. A., and Fazio, R. H. (2003). Relations between implicit measures of prejudice: what are we measuring? Psychol. Sci. 14, 636–639. doi: 10.1046/j.0956-7976.2003.psci_1477.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Olson, M. A., and Fazio, R. H. (2009). “Implicit and explicit measures of attitudes: the perspective of the MODE Model,” in Attitudes: Insights From the New Wave of Implicit Measures, eds R. E. Petty, R. H. Fazio, and P. Brinol (Mahwah, NJ: Erlbaum), 20–62.

Google Scholar

Payne, B. K., Cheng, S. M., Govorun, O., and Stewart, B. D. (2005). An inkblot for attitudes: affect misattribution as implicit measurement. J. Pers. Soc. Psychol. 89, 277–293. doi: 10.1037/0022-3514.89.3.277

PubMed Abstract | CrossRef Full Text | Google Scholar

Peguero, A. A., and Shekarkhar, Z. (2011). Latino/a student misbehavior and school punishment. Hisp. J. Behav. Sci. 33, 54–70. doi: 10.1177/0739986310388021

CrossRef Full Text | Google Scholar

Peterson, E. R., Rubie-Davies, C., Osborne, D., and Sibley, C. (2016). Teachers' explicit expectations and implicit prejudiced attitudes to educational achievement: relations with student achievement and the ethnic achievement gap. Learn. Instr. 42, 123–140. doi: 10.1016/j.learninstruc.2016.01.010

CrossRef Full Text | Google Scholar

Pettigrew, T. F. (1998). Intergroup contact theory. Annu. Rev. Psychol. 49, 65–85. doi: 10.1146/annurev.psych.49.1.65

PubMed Abstract | CrossRef Full Text | Google Scholar

Pettigrew, T. F. (2008). Future directions for intergroup contact theory and research. Int. J. Intercult. Relat. 32, 187–199. doi: 10.1016/j.ijintrel.2007.12.002

CrossRef Full Text | Google Scholar

Pettigrew, T. F., and Tropp, L. R. (2006). A meta-analytic test of intergroup contact theory. J. Pers. Soc. Psychol. 90, 751–783. doi: 10.1037/0022-3514.90.5.751

PubMed Abstract | CrossRef Full Text | Google Scholar

Pettigrew, T. F., and Tropp, L. R. (2008). How does intergroup contact reduce prejudice? Meta-analytic test of three mediators. Eur. J. Soc. Psychol. 38, 922–934. doi: 10.1002/ejsp.504

CrossRef Full Text | Google Scholar

Phinney, J. S. (1996). When we talk about American ethnic groups, what do we mean? Am. Psychol. 51, 918–927. doi: 10.1037//0003-066X.51.9.918

CrossRef Full Text | Google Scholar

Pingitore, R., Dugoni, B. L., Tindale, R. S., and Spring, B. (1994). Bias against overweight job applicants in a simulated employment interview. J. Appl. Psychol. 79, 909–917. doi: 10.1037//0021-9010.79.6.909

PubMed Abstract | CrossRef Full Text | Google Scholar

Pit-ten Cate, I. M., and Glock, S. (2018). Teachers' attitudes towards students with high- and low-educated parents. Soc. Psychol. Educ. 21, 725–742. doi: 10.1007/s11218-018-9436-z

CrossRef Full Text | Google Scholar

Preckel, F., Baudson, T. G., Krolak-Schwerdt, S., and Glock, S. (2015). Gifted and Maladjusted? Implicit attitudes and automatic associations related to gifted children. Am. Educ. Res. J. 52, 1160–1184. doi: 10.3102/0002831215596413

CrossRef Full Text | Google Scholar

Puhl, R. M., and Heuer, C. A. (2009). The stigma of obesity: a review and update. Obesity 17, 941–964. doi: 10.1038/oby.2008.636

PubMed Abstract | CrossRef Full Text | Google Scholar

Raffaele Mendez, L. M., and Knoff, H. M. (2003). Who gets suspended from school and why: a demographic analysis of schools and disciplinary infractions in a large school district. Educ. Treat. Child. 26, 30–51.

Google Scholar

Rudman, L. A. (2004). Sources of implicit attitudes. Curr. Dir. Psychol. Sci. 13, 79–82. doi: 10.1111/j.0963-7214.2004.00279.x

CrossRef Full Text | Google Scholar

Rumberger, R. W. (1995). Dropping out of middle school: a multilevel analysis of students and schools. Am. Educ. Res. J. 32, 583–625. doi: 10.3102/00028312032003583

CrossRef Full Text | Google Scholar

Santavirta, N., Solovieva, S., and Theorell, T. (2007). The association between job strain and emotional exhaustion in a cohort of 1.028 Finnish teachers. Br. J. Educ. Psychol. 77, 213–228. doi: 10.1348/000709905X92045

PubMed Abstract | CrossRef Full Text | Google Scholar

Schimmack, U. (2019). The implicit association test: a method in search of a construct. Perspect. Psychol. Sci. doi: 10.1177/1745691619863798. [Epub ahead of print].

PubMed Abstract | CrossRef Full Text | Google Scholar

Schwimmer, J. B., Burwinkle, T. M., and Varni, J. W. (2003). Health-related quality of life of severely obese children and adolescents. JAMA 289, 1813–1819. doi: 10.1001/jama.289.14.1813

PubMed Abstract | CrossRef Full Text | Google Scholar

Shapiro, J. R., and Williams, A. M. (2012). The role of stereotype threats in undermining girls' and women's performance and interest in STEM fields. Sex Roles 66, 175–183. doi: 10.1007/s11199-011-0051-0

CrossRef Full Text | Google Scholar

Sharma, U., and Sokal, L. (2015). The impact of a teacher education course on pre-service teachers' beliefs about inclusion: an international comparison. J. Res. Spec. Educ. Needs 15, 276–284. doi: 10.1111/1471-3802.12043

CrossRef Full Text | Google Scholar

Sherman, J. W., Gawronski, B., Gonsalkorale, K., Hugenberg, K., Allen, T. J., and Groom, C. J. (2008). The self-regulation of automatic associations and behavioral impulses. Psychol. Rev. 115, 314–335. doi: 10.1037/0033-295X.115.2.314

PubMed Abstract | CrossRef Full Text | Google Scholar

Shifrer, D. (2013). Stigma of a label: educational expectations for high school students labeled with learning disabilities. J. Health Soc. Behav. 54, 462–480. doi: 10.1177/0022146513503346

PubMed Abstract | CrossRef Full Text | Google Scholar

Shore, S. M., Sachs, M. L., Lidicker, J. R., Brett, S. N., Wright, A. R., and Libonati, J. R. (2008). Decreased scholastic achievement in overweight middle school students. Obesity 16, 1535–1538. doi: 10.1038/oby.2008.254

PubMed Abstract | CrossRef Full Text | Google Scholar

Sleeter, C. E. (2001). Preparing teachers for culturally diverse schools. J. Teach. Educ. 52, 94–106. doi: 10.1177/0022487101052002002

CrossRef Full Text | Google Scholar

Sleeter, C. E., and Owuor, J. (2011). Research on the impact of teacher preparation to teach diverse students: the research we have and the research we need. Action Teach. Educ. 33, 524–536. doi: 10.1080/01626620.2011.627045

CrossRef Full Text | Google Scholar

Smith, E. R. (1998). “Mental representation and memory,” in Handbook of Social Cognition, eds D. T. Gilbert, S. T. Fiske, and G. Lindzey (New York, NY: McGraw-Hill),391–445.

Google Scholar

Spruyt, A., Hermans, D., de Houwer, J., and Eelen, P. (2002). On the nature of the affective priming effect: affective priming of naming responses. Soc. Cogn. 20, 227–256. doi: 10.1521/soco.20.3.227.21106

CrossRef Full Text | Google Scholar

Sullivan, A. L., and Artiles, A. J. (2011). Theorizing racial inequity in special education: applying structural inequity theory to disproportionality. Urban Educ. 46, 1526–1552. doi: 10.1177/0042085911416014

CrossRef Full Text | Google Scholar

Suurmond, R., van Rhee, H., and Hak, T. (2017). Introduction, comparison, and validation of meta-essentials : a free and simple tool for meta-analysis. Res. Synth. Methods 8, 537–553. doi: 10.1002/jrsm.1260

PubMed Abstract | CrossRef Full Text | Google Scholar

Sze, S. (2001). A literature review: pre-service teachers' attitudes towards students with disabilities. Education 130, 53–56.

Google Scholar

Taylor, S. E., and Crocker, J. (1981). “Schematic bases of social information processing,” in Social Cognition: The Ontario Symposium, eds E. T. Higgins, C. P. Herman, and M. P. Zanna (Hillsdale, NJ: Lawrence Erlbaum Associates), 89–134.

Google Scholar

Van de Werfhorst, H. G., and Mijs, J. J. B. (2010). Achievement inequality and the institutional structure of educational systems: a comparative perspective. Annu. Rev. Sociol. 36, 407–428. doi: 10.1146/annurev.soc.012809.102538

CrossRef Full Text | Google Scholar

van den Bergh, L., Denessen, E., Hornstra, L., Voeten, M., and Holland, R. W. (2010). The implicit prejudiced attitudes of teachers: relations to teacher expectations and the ethnic achievement gap. Am. Educ. Res. J. 47, 497–527. doi: 10.3102/0002831209353594

CrossRef Full Text | Google Scholar

van Dick, R., and Wagner, U. (2001). Stress and strain in teaching: a structural equation approach. Br. J. Educ. Psychol. 71, 243–259. doi: 10.1348/000709901158505

PubMed Abstract | CrossRef Full Text | Google Scholar

van Rhee, H. J., Suurmond, R., and Hak, T. (2015). User Manual for Meta-Essentials: Workbooks for Meta-analysis (Version 1.4). Rotterdam: Erasmus Research Institute of Management. doi: 10.2139/ssrn.3241355

CrossRef Full Text | Google Scholar

Vezzali, L., Giovannini, D., and Capozza, D. (2012). Social antecedents of children's implicit prejudice: direct contact, extended contact, explicit and implicit teachers? prejudice. Eur. J. Dev. Psychol. 9, 569–581. doi: 10.1080/17405629.2011.631298

CrossRef Full Text | Google Scholar

Villegas, A. M., and Irvine, J. J. (2010). Diversifying the teaching force: an examination of major arguments. Urban Rev. 42, 175–192. doi: 10.1007/s11256-010-0150-1

CrossRef Full Text | Google Scholar

Warschburger, P. (2005). The unhappy obese child. Int. J. Obes. 29, S127–S129. doi: 10.1038/sj.ijo.0803097

PubMed Abstract | CrossRef Full Text | Google Scholar

Weber, R., and Crocker, J. (1983). Cognitive processes in the revision of stereotypic beliefs. J. Pers. Soc. Psychol. 45, 961–977. doi: 10.1037//0022-3514.45.5.961

CrossRef Full Text | Google Scholar

Wittenbrink, B., and Schwarz, N. (2007). “Introduction,” in Implicit Measures of Attitudes, eds B. Wittenbrink and N. Schwarz (New York, NY: Guilford Press), 1–16.

Google Scholar

Wyer, R. S., and Carlston, D. E. (1994). “The cognitive representation of persons and events,” in Handbook of Social Cognition, eds R. S. Wyer and T. Srull (Hillsdale, NJ: Erlbaum), 41–98.

Google Scholar

Keywords: implicit attitudes, teachers, bias, meta-analysis, student group, educational inequality

Citation: Pit-ten Cate IM and Glock S (2019) Teachers' Implicit Attitudes Toward Students From Different Social Groups: A Meta-Analysis. Front. Psychol. 10:2832. doi: 10.3389/fpsyg.2019.02832

Received: 12 August 2019; Accepted: 29 November 2019;
Published: 13 December 2019.

Edited by:

Zheng Jin, Zhengzhou Normal University, China

Reviewed by:

Kane Meissel, The University of Auckland, New Zealand
Rosalba Morese, Università della Svizzera italiana, Switzerland

Copyright © 2019 Pit-ten Cate and Glock. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Ineke M. Pit-ten Cate, ineke.pit@uni.lu

ORCID: Ineke M. Pit-ten Cate orcid.org/0000-0002-9847-9683
Sabine Glock orcid.org/0000-0003-1678-2337

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.