Applying the SRL vs. ERL Theory to the Knowledge of Achievement Emotions in Undergraduate University Students

The SRL vs.ERL Theory predicts that a student's own self-regulation and the regulatory nature of the context are factors that jointly determine the student's level of motivational-affective variables. However, this principle has not yet been verified in the case of achievement emotions. The aim of this research was to test this prediction, with the hypothesis that students' level of self-regulation (low-medium-high), in interaction with the regulatory nature of the teaching (low-medium-high), would determine positive or negative emotions as well as the degree of burnout/engagement. A total of 440 university students completed validated questionnaires on self-regulation; regulatory teaching; achievement emotions in class, in study and in testing situations; and on burnout/engagement. Using a quasi-experimental design by selection, ANOVAs and MANOVAs (3 × 3; 5 × 1) were carried out. The results confirmed that the level of self-regulation and the level of external regulation jointly determined university students' level of achievement emotions, as well as their level of burnout/engagement. Based on these results, a five-level progressive scale was configured. We conclude that this scale may be useful and adequate as a heuristic technique or model for understanding and analyzing the type of student-teacher interaction that is taking place in the university classroom, and thereby learn the probability of stressful effects and the students' level of emotional health.

Introduction

Classic Educational Psychology research on individuals' learning variables has focused on two large groups of constructs that would establish individual differences in learning and so predict achievement. On one hand is intelligence, with its related lines of research, such as the study of cognitive and metacognitive factors in learning processes. On the other hand is personality, as well as students' motivational-affective and meta-motivational processes. Detailed analysis over the past years has produced a considerable amount of research evidence, and a paradigm has emerged for the study of emotions and non-cognitive or “soft” skills in the educational sphere (Pekrun et al., 2009, 2019; Frenzel et al., 2016, 2018; Lüftenegger, 2016; Dicke et al., 2018; Muis et al., 2018). In a complementary fashion, research on contextual variables of teaching has analyzed the role of the teaching process and its elements, with special attention to the role of effective teaching (Pekrun et al., 2014a; Murayama et al., 2017; Gentsch et al., 2018; Mainhard et al., 2018). However, a precise analysis of the joint, interactive and interdependent relationships between the two sets of factors—pertaining to the learning process and the teaching process—remains to be achieved. Notwithstanding, certain interactive models have laid the foundation for this area of study (Vermunt, 1989, 2007; Bigg, 2001). Consequently, the present study aims to offer conceptual foundations and empirical evidence in this direction.

Academic Emotions as a Learning Variable

Positive vs. Negative Academic Emotions

Emotions having to do with learning/achievement situations and outcomes are referred to as academic emotions (Pekrun et al., 2005, 2011, 2017a,b; Schutz and Pekrun, 2010; Pekrun and Stephens, 2012; Pekrun, 2014). Academic emotions therefore include achievement emotions experienced at school, but they also address emotions related to the instruction or the process of studying. Pekrun (1992) expanded on earlier conceptualizations of emotions by classifying academic emotions using a three-way taxonomy, namely, their focus, valence, and activation. Two types of academic or achievement emotions can be distinguished if we consider their origin: activity emotions originate in ongoing activities that relate to achievement, while outcome emotions stem from focusing on the outcomes of such activities (Pekrun, 2006). Both activity and outcome emotions are further classified by their valence (positive vs. negative or pleasant vs. unpleasant) and their role in activation (activating vs. deactivating). Students' activity emotions in academic settings have been addressed in recent research: for example, enjoyment as a positive, activating emotion (for an overview, see Ainley and Hidi, 2014) and boredom as a negative, deactivating emotion. Positive, activating emotions (enjoyment, hope, pride) are generally assumed to have positive effects on achievement, while negative (anger, anxiety, shame, hopelessness), and deactivating emotions (boredom, relief) would affect achievement and learning behavior in a negative fashion. This assumption is supported by empirical evidence (Frenzel et al., 2007; Pekrun et al., 2014b).

Empirical findings increasingly support that academic enjoyment and boredom are aligned with specific domains (Goetz et al., 2004, 2007a, 2014). Findings showed that enjoyment was the most domain-specific emotion, after comparing emotions assessed in six different subject domains. Adolescents' emotions in different subjects were shown to have relatively little relationship to each other; different levels of enjoyment and boredom were experienced in different subjects. While evidence increasingly confirms the domain specificity of academic emotions, little attempt has been made to search out the underlying mechanisms.

The Effect of Positive vs. Negative Emotions on Students

Several studies have reported positive effects of enjoyment on students' achievement (Pekrun, 2014; Pekrun et al., 2019), while boredom shows detrimental effects (Goetz et al., 2014), across scholastic domains. Motivation, meta-cognitive activities, and cognitive resources have been theorized as mediating factors. Students' mastery goals, interest, intrinsic motivation, attention, invested effort, self-regulation, elaboration and use of metacognitive strategies have been found in positive association with enjoyment, and in negative association with boredom; these elements have the same positive and negative associations with achievement (Goetz et al., 2007b).

In the academic context, we find enjoyment and boredom among the emotions most often reported (Goetz et al., 2007b; Linnenbrink-Garcia and Pekrun, 2011; Pekrun and Linnenbrink-Garcia, 2014). Because these two emotions are so prevalent in academic settings and so visible across academic domains (e.g., Goetz et al., 2007b; D'Mello, 2013), and because they affect learning and achievement in opposing directions, positive and negative emotions were selected as the object of the present study. From a complementary approach, the Transactional Analysis (TA) theory has also found a relationship between positive emotions and specific learning domains, in the teacher-student relations (Pishghadam and Khajavy, 2014).

Relationships of academic emotions with burnout vs. engagement have also been found. Burnout represents fatigue, depersonalization, lack of expectations and disaffection for a task (Maslach and Jackson, 1981); engagement represents taste, commitment and enjoyment with a given task (Maslach and Leiter, 1997). Previous research has reported factors that predict and probabilize both (Uludag and Yaratan, 2010). Thus, it has been found that academic emotions (positive vs. negative) are differentially associated with burnout (Burr and Dallaghan, 2019). It has also been found that engagement probabilizes metacognitive self-regulation and knowledge construction (Khosa and Volet, 2014). More recently, both have been conceptualized as positive (engagement) vs. negative (burnout) learning (Dormann et al., 2017). On the other hand, burnout has consistently appeared as a negative predictor of motivation and performance (Salanovaa et al., 2010; Stoeber et al., 2011), although the authors of the inventories, they have recognized that the direction between both constructs is not simple but complex, and requires more specific analysis through profiles (Leiter and Marlach, 2017a,b).

Academic Emotions as Teaching Variable

Regulatory Teaching

Regulatory teaching is refers to encouragement of self-regulation in students and it's characteristic of effective teaching. In empirical research, high quality teachers are those who have a positive impact on their students' engagement with learning activities (Reeve et al., 2004). Some authors have explained self-regulation promoting teaching strategies (Paris and Winograd, 2003, pp. 12–14):

1. Self-regulation can be taught with explicit instruction, directed reflection, and metacognitive discussions. Cognitive research has shown that expertise can develop in many ways and explicit instruction is not always necessary. However, many children do not gain metacognitive insights or use SRL effectively without direct instruction and it seems plausible that many teachers can increase their own metacognitive understanding through explicit instruction. The most direct method of making new teachers aware of SRL is to incorporate it in the curriculum as a topic of study.

2. Self-regulation can be promoted indirectly by modeling and by activities that entail reflective analyses of learning. SRL can be taught indirectly with classroom activities, tools to evoke reflection and metacognitive understanding. One excellent method is the use of journals because they can be used with students of any age. Prospective teachers who use journals in classes learn to distinguish superficial entries and responses from analytic entries and responsive comments, so they are less likely to “do journals” as an activity and more likely to use journal writing as an avenue for self-exploration, self-discovery, and self-disclosure. A second tool that translates easily from teachers to students is conferences. Conferences can be focused on cooperative projects, report cards and grades, planning and brainstorming, and other classroom events but in all the endeavors, the focus of the conference can include analyses of thinking, learning, and teaching.

3. Self-regulation can be promoted by assessing, charting, and discussing evidence of personal growth. SRL can be promoted through record keeping of goals met, grades received, and progress made in behavior management and learning. Teachers who use these records will understand how periodic self-appraisal can lead to feelings of pride or to renewed efforts. This simple technique is often used by people who monitor their diets, exercise, expenditures, and so forth and it can easily be extended to academic performance.”

Recent research has shown that the perceived classroom learning environment variables were good predictors of students' self-regulation. Additionally, teacher variables (effectiveness teaching) were found to have direct relations with students' self-regulation and moderate the relationships between the learning environment and self-regulation variables (Yerdelen and Sungur, 2019).

The Influence of the Teaching Context on Students' Academic Emotions

Formerly, when researchers have attempted to predict students' academic emotions in social environments, they have relied mainly on parents' and teachers' observations, set by their own expectations, and their child raising or teaching practices, respectively. For example, Pekrun (2006) asserted that parents' and teachers' achievement expectations, and the structure of their interaction with the student (e.g., feedback practices, established goal structures, autonomy support vs. control) influences the source of the student's emotions (i.e., control- and value-related appraisals). The importance of social influences on students' enjoyment and boredom is specifically identified in other theoretical models (Goetz et al., 2007b). The social environment is considered a third type of predictor in model of academic boredom; how the subject domain is valued by teachers, parents and peers impacts the student's experiences of academic boredom. This perspective is adopted in the present study, where we apply it to the context of regulatory teaching.

SRL vs. ERL Theory as Heuristic of Research

The theory of Self-Regulated Learning vs. Externally-Regulated Learning (de la Fuente, 2017) is founded on the following theoretical assumptions. Behavioral regulation of the individual can be defined as different types along a behavioral continuum:

Principle 1. Self-Regulated Behavior, Non-regulated Behavior or Dysregulated Behavior as a Personal Characteristic

(1) Self-Regulation (SR) has to do with positive proactivity, that is, the individual actively and adequately regulates and manages his or her own conduct. This level is referred to as high level, in terms of the degree to and quantity of behaviors used to regulate one's own behavior (level 3).

(2) Non-Regulation (NR) may be conceptually defined as a person's lack of proactivity, or the absence of self-regulating behaviors. This is the conceptual equivalent of reactivity. This level is referred to as medium level, in terms of the degree to and quantity of behaviors used to regulate one's own behavior (level 2).

(3) Dysregulation (DR) has to do with negative proactivity, that is, the individual actively but inadequately regulates and manages his or her own conduct. Examples include the use of self-handicapping strategies or procrastination. This level is referred to low level, in terms of the degree to and quantity of behaviors used to regulate one's own behavior (level 1). The three behavior types are shown in Table 1.

TABLE 1

Table 1. Conceptual continuum and typologies of each self-regulatory behavior.

Principle 2. External Regulation, Non-regulation, or Dysregulation Provided by the Context

(1) External Regulatory (ER) context. Positive or adequate proactivity is promoted through the context, which clearly fosters self-regulation. This context features high levels (level 3) of external signs or encouragements to promote self-regulated behavior and increases its likelihood at each moment of learning acts: beginning, middle and end. Such encouragement can be in the form of antecedents (patterns, norms, limits, expectations of success in self-regulation, value given to self-regulation) or contextual consequences (positive and negative contingencies favoring self-regulation, adaptation, etc.).

(2) External Non-Regulatory (ENR) context. The context neither encourages self-regulation nor does it tend to dysregulate students' learning. Medium level or no external signs (level 2) or other aspects promote self-regulated behavior or dysregulated behavior, so as to make either of these more likely at the beginning, middle and end of learning acts. A non-regulatory context supposes that the individual would engage in a moderate level of self-regulated behavior, in the absence of contextual elements that enhance or discourage such action. The context is characterized by a lack of predictability of action.

(3) External Dys-Regulatory (EDR) context, actively promotes dysregulation or low levels of self-regulation (level 1). The context promotes proactivity that is not positive, but inadequate or negative. Many external signs make dysregulated behavior more likely, and encourage active dysregulation at the beginning, middle and end of learning acts. These signs can also be in the form of antecedents (modeling, rules, limits, expectations of success in self-regulation, value given to self-regulation) or contextual consequences (positive and negative contingencies, molding, etc.) that favor dysregulation. This kind of context would require the individual to make a great effort if self-regulation is pursued. The context is a strong predictor of negative action (see Table 2).

TABLE 2

Table 2. Conceptual continuum of the context dimension, Externally-Regulated Learning (ERL).

Principle 3. Academic Emotions as an Internally (SR) and Externally (ER) Mediated Process

According to this principle, academic emotions are produced in a probabilistic fashion, with both internal mediation (self-regulation as a personal characteristic) and external mediation (favoring or discouraging regulation). Human learning is thus envisioned as the combination of a person's self-regulating ability and the external regulatory features of the context, with four types of interactions. Self-regulated learning, therefore, may be explained and predicted by an individual's self-regulation in conjunction with the external characteristics of the context. Consequently, the prediction of the model is that the 1st combination (low self-regulation and low externally-regulation) should produce few positive and many negative emotions, high burnout and low engagement. The 2nd combination (low self-regulation and medium/high externally-regulation) should produce medium-low positive emotions and negative medium-high, medium-high burnout and medium-low engagement. The 3rd combination (medium/high self-regulation and medium-low externally-regulation) should produce medium/high positive emotions and low negative emotions, medium-high engagement and medium-low burnout. The 4th combination (high self-regulation and high externally-regulation) should produce high positive emotions and low negative emotions, high engagement and low burnout (see Table 3).

TABLE 3

Table 3. Positive vs. negative emotions in the SRL vs. ERL Theory.

Aims and Hypothesis

Based on the foregoing models and empirical data, this investigation had several objectives: (1) to improve the heuristic technique for assessing the type of combination—as established by SRL vs. ERL Theory—using five types or levels; (2) to establish whether these interaction levels determined positive and negative achievement emotions, as defined in Pekrun's model; (3) to analyze whether there was a similar impact in the correlates of engagement and burnout. Hypotheses consistent with these objectives were defined as follows: (1) The possible combinations of student's level of self-regulation and level of external regulation offered by the teaching can be ordered in five progressive levels (averaging the level of personal self-regulation and the regulation promoted by the context, on a range between 1 and 3, and on a scale from 1 to 5); (2) the gradual increase of interaction level, ranging from 1 to 5, will lead to a proportionate increase in positive emotionality and a decrease in negative emotionality, as conceptualized by the Pekrun model; (3) using the same logic, these levels will correspond to a progressive increase in student engagement and a decrease in burnout.

Method

Participants

For the interdependence relations among low-medium-high levels of Personal Self-Regulation (SR), and Regulatory Teaching (RT), we used a total sample of 440 undergraduate students from two universities in Spain. A selected sample of 336 students was used to analyze the type of combination. The sample was composed of students enrolled in Psychology, Primary Education, and Educational Psychology degree programs; 86.5% were women and 13.5% were men. Their ages ranged from 19 to 49, with a mean age of 23.08 (σ_X = 4.4) years.

Instruments (see Annex I. Complementary Material)

Learning Process

Personal self-regulation (meta-behavioral variable)

This variable was measured using the Short Self-Regulation Questionnaire (SSRQ) (Miller and Brown, 1991). It has already been validated in Spanish samples (Pichardo et al., 2014, 2018), and possesses acceptable validity and reliability values, similar to the English version. The Short SRQ is composed of four factors (goal setting-planning, perseverance, decision making and learning from mistakes) and 17 items (all of them with saturations >0.40), with a consistent confirmatory factor structure (Chi-Square = 250.83, df = 112, CFI = 0.95, GFI = 0.94, AGFI = 0.96, RMSEA = 0.05. Internal consistency was acceptable for the total of questionnaire items (α = 0.86) and for the factors of goal setting-planning (α = 0.79), decision making (α = 0.72) and learning from mistakes (α = 0.72). Correlations have been studied, between each item and its factor total, among the factors, and between each factor and the complete questionnaire, with good results in all cases, except for the decision-making factor, which had a lower correlation with other factors (range: 0.41–0.58). The correlations between the original version and the complete version, and between the original and the short versions with a Spanish sample (complete SRQ with 32 items and short SRQ with 17 items) are better for the short version (short-original: r = 0.85 and short-complete: r = 0.94; p < 0.01) than for the complete version (complete-original: r = 0.79; p < 0.01).

Teaching Process

Regulatory teaching (meta-instructional variable)

The Scales for Assessment of the Teaching-Learning Process, ATLP, student version (de la Fuente et al., 2012) were used to evaluate students' perception of the teaching process. The scale entitled Regulatory Teaching is Dimension 1 of the confirmatory model. IATLP-D1 comprises 29 items structured along five factors: Specific regulatory teaching, regulatory assessment, preparation for learning, satisfaction with the teaching, and general regulatory teaching. The scale was validated in university students (de la Fuente et al., 2012) and showed a factor structure with adequate fit indices (Chi-Square = 590.626; df = 48, p < 0.001, CF1 = 0.958, TLI = 0.959, NFI = 0.950, NNFI = 0.967; RMSEA = 0.068) and adequate internal consistency (IATLP D1: α = 0.83; Specific regulatory teaching, α = 0.897; regulatory assessment, α = 0.883; preparation for learning, α = 0.849; satisfaction with the teaching, α = 0.883 and general regulatory teaching, α = 0.883). The ATLP is a self-report instrument completed by the teacher and the students, available in Spanish and English versions. It also includes a qualitative part where students can make recommendations for improving each of the processes evaluated. As for the instrument's external validity, results are also consistent, since there are different interdependent relationships among perceptions of variables that exist in an academic environment.

Learning Product

Achievement emotions

The Achievement Emotions Questionnaire, AEQ (Pekrun et al., 2005) is a multidimensional self-report instrument designed to assess university students' achievement emotions. This questionnaire was generated on the basis of a quantitative and qualitative research program analyzing the emotions that students experienced in academic achievement situations. Several discrete emotions are measured within each of the three main academic achievement situations: attending class, studying, and completing tests and exams. The current version of the AEQ can measure eight class-related emotions, eight learning-related emotions, and eight test emotions. Three corresponding scales—class-related, learning-related, and test-related emotions—make up the three sections of the AEQ. Eighty items in the class-related emotions scale (CRE) measure the following eight emotions: class-related enjoyment, hope, pride, anger, anxiety, shame, hopelessness, and boredom. The learning-related emotions scale (LRE) contains 75 items and measures the same eight emotions in study situations. The test emotions scale (TES) contains 77 items that assess test-related enjoyment, hope, pride, relief, anger, anxiety, shame, and hopelessness. Each section is formed by three blocks of items, for assessment of emotions experienced either before, during, or after the achievement situations addressed in that section. Trait achievement emotions are assessed, that is, the student's typical, individual emotional reactions in achievement situations. The AEQ instructions can be altered for the purpose of measuring emotions experienced in a particular class subject (course-specific emotions), or in specific situations at a specific time (state achievement emotions).

The AEQ assesses four positive emotions (enjoyment, hope, pride, and relief) and five negative emotions (anger, anxiety, hopelessness, shame, and boredom). Two main criteria were used to decide which emotions to include. First, the emotions identified are frequently experienced by college students (Pekrun, 1992). Second, the emotions can be classified along two dimensions, each with two possible values: valence (positive vs. negative) and activation (activating vs. deactivating). Their combination results in four categories of emotions that can summarize how emotions affect learning, achievement, personality development, and health. Emotions are classified into the four categories as follows, positive activating: enjoyment, hope, pride; positive deactivating: relief; negative activating: anger, anxiety, shame; negative deactivating: hopelessness, boredom.

The three main types of achievement situations at university—attending class, studying, and taking tests and exams—differ according to function and social structure. This implies that emotions toward these situations would also differ. Enjoyment of classroom instruction, for example, would differ from enjoying the challenge of an exam. Some students may feel excited about going to class, others when taking exams. The AEQ takes this into account by providing separate scales for emotions that are class-related, learning-related, and test-related.

Confirmatory Factor Analysis and Reliability

(1) Class-Related Emotions (translation: Paoloni, 2014). The psychometric properties of the CRE were satisfactory in students from Spain. In this sample, the model obtained good fit indices. Unidimensionality of the scale and metric invariance were confirmed in the samples evaluated (Chi Square = 10,885,597, Degrees of freedom = 3052, p < 0.001; CFI = 0.951, TLI = 0.952, IFI = 0.963, TLI = 0.958, and CFI = 0.952; RMSEA = 0.041; HOELTER = 458, p < 0.05; 466 p < 0.01). The Cronbach alpha for this sample was 0.904, 0.803 (40 items), and 0.852 (40 items), for each part, respectively (80 items).

(2) Learning-Related Emotions (translation: de la Fuente, 2015a). The psychometric properties of the LRE were satisfactory in students from Spain. In this sample, the model obtained good fit indices. Unidimensionality of the scale and metric invariance were confirmed in the samples evaluated (Chi Square = 10885,597, Degrees of freedom = 3052, p < 0.001; CFI = 0.959, TLI = 0.942, IFI = 0.969, TLI = 0.955, and CFI = 0.958; RMSEA = 0.038; HOELTER = 501, p < 0.05; 511 p < 0.01). The Cronbach alpha for this sample was 0.930, 0.880 (38 items), and 0.846 (37 items), for each part, respectively (75 items).

(3) Test-Related Emotions (translation: de la Fuente, 2015b). The psychometric properties of the TRE were satisfactory in students from Spain. In this sample, the model obtained good fit indices. Unidimensionality of the scale and metric invariance were confirmed in the samples evaluated (Chi Square = 10885,597, Degrees of freedom = 3052, p < 0.001; CFI = 0.954, TLI = 0.946, IFI = 0.964, TLI = 0.959, and CFI = 0.953; RMSEA = 0.039; HOELTER = 492, p < 0.05; 502 p < 0.01). The Cronbach alpha for this sample was 0.913, 0.824, and 0.869, for each part, respectively (77 items).

Engagement-burnout

This version has shown adequate reliability and construct validity indices in a cross-cultural study.

Engagement was assessed with a validated Spanish version of the Utrecht Work Engagement Scale for Students (Shaufeli et al., 2002). The psychometric properties of the TRE were satisfactory in students from Spain. In this sample, the model obtained good fit indices. Unidimensionality of the scale and metric invariance were confirmed in the samples evaluated (Chi-square = 792,526, df = 74, p < 0.001; CFI = 0.954, TLI = 0.976, IFI = 0.954, TLI = 0.979, and CFI = 0.973; RMSEA = 0.083; HOELTER = 153, p < 0.05; 170 p < 0.01). The Cronbach alpha for this sample was 0.900 (14 items), 0.856 (7 items), and 0.786 (7 items), for each part, respectively.

Burnout was assessed with a validated Spanish version of the Burnout Scale for Students (Shaufeli et al., 2002). The psychometric properties of this version scale were satisfactory in students from Spain. In this sample, the model obtained good fit indices. Unidimensionality of the scale and metric invariance were confirmed in the samples evaluated (Chi Square = 767,885, df = 87, p < 0.001; CFI = 0.956, TLI = 0.964, IFI = 0.951, TLI = 0.951, and CFI = 0.953; RMSEA = 0.071; HOELTER = 224, p < 0.05; 246 p < 0.01). The Cronbach alpha for this sample was 0.874 (15 items), 0.853 (8 items), and 0.793 (7 items), for each part, respectively.

Procedure

Participants voluntarily completed the scales using an online platform (de la Fuente et al., 2015a). A total of five specific teaching-learning processes in different university subjects, imparted over two academic years, were evaluated. Presage variables were evaluated in September to October of 2017 and 2018, Process variables in February to March of 2017 and 2018, and Product variables in May to June of 2017 and 2018. The procedure was approved by the respective Ethics Committees of the two universities, in the context of an R & D Project (2018–2020).

Data Analysis

A previous confirmatory factor analysis was conducted in this sample as evidence of factorial validity and to ensure the previous structural fit of each inventory (Chi Square, NFI, TLI, RFI, RMSEA and HOELTER), using the statistical program AMOS (v. 22) Reliability was also calculated (Cronbach Alpha) through SPSS (v.25).

Using an ex-post-facto design, first, a 3 K-means cluster analysis was conducted to establish low-medium-high groups in each of the two variables: Personal Self-Regulation (SR) and Regulatory Teaching (RT). In the case of the SR variable, the values (Low = 2.70; Medium = 3.48; High = 4.20) formed the centers of the clusters, response ranges being low (1.00–3.09), medium (3.10–3.84), and high (3.85–5.00). In the case of the RT variable (Low = 2.72; Medium = 3.58; High = 4.34), formed the centers of the clusters, response ranges being low (1.00–2.34), medium (2.35–2.83) and high (2.84–5.00). In addition, several ANOVAs and MANOVAs were carried out, to ascertain the effect of low-medium-high levels of the dependent variable, achievement emotions. Also, using a 3-factor design (low-medium-high self-regulation levels) × 3 (low-medium-high levels of regulatory teaching), several MANOVAs were conducted, taking the aforementioned levels as the independent variable. Finally, based on the low-medium-high groups in both variables (SR and RT), five combinations were configured, according to the theoretical model proposed (see Table 4). MANOVAs were conducted to establish statistical suitability of these groupings, as well as the effects of the dependent variables defined, with Pillai's trace and Sheffé test index.

TABLE 4

Table 4. Interdependence relations between the low-medium-high levels of Self-Regulation and External Regulation (Regulatory Teaching) as independent variables, in achievement emotions, burnout and engagement.

Results

Interdependent Relations Among Levels of Personal Self-Regulation (SR) and Levels of Regulatory Teaching (RT) in the Achievement Emotions

Class Achievement Emotions (CAE)

A statistically significant main effect of the SR IV (low-medium-high levels) [F_{(4, 714)} = 14.831 (Pillai's Trace), p < 0.001, n² = 0.077], and RT IV (low-medium-levels) [F_{(4, 714)} = 8.975 (Pillai's Trace), p < 0.001, n² = 0.048], was noted on the CAE. The statistically significant partial effect was maintained of the SR IV (low-medium-high levels) for both Positives Emotions [F_{(2, 365)} = 25.945, p < 0.001, n² = 0.127, 1>2>3], and Negatives Emotions [F_{(2, 365)} = 18.314 (Pillai's Trace), p < 0.001, n² = 0.127; 3 >2 >1]. The statistically significant partial effect was maintained of the PR IV (low-medium-high levels) for both Positive Emotions [F_{(2, 365)} = 15.847, p < 0.001, n² = 0.082, 3>2,1], and Negative Emotions [F_{(2, 365)} = 9.884 (Pillai's Trace), p < 0.001, n² = 0.052; 3 <2,1]. No statistical effect of significant interaction appeared.

Complementarily, a statistically significant main effect of the SR IV (low-medium-high levels) [F_{(16, 702)} = 4.865 (Pillai's Trace), p < 0.001, n² = 0.100], and RT IV (low-medium-levels) [F_{(16, 702)} = 3.804 (Pillai's Trace), p < 0.001, n² = 0.080], was noted on the factors of CAE. The statistically significant partial effect was retained for enjoyment [F_{(2, 366)} = 5.385, p < 0.001, n² = 0.037; post-hoc: 3>2>1], for hope [F_{(2, 366)} = 13.463, p < 0.001, n² = 0.164; post-hoc: 3>2>1], for pride [F_{(2, 366)} = 15.540, p < 0.001, n² = 0.080; post-hoc: 3>2>1], for boredom [F_{(2, 366)} = 9.749, p < 0.001, n² = 0.952; post-hoc: 1>2>3], for anger [F_{(2, 366)} = 9.448, p < 0.001, n² = 0.050; post-hoc: 1>2>3], for anxiety [F_{(2, 366)} = 13.033, p < 0.001, n² = 0.068; post-hoc: 1>2>3], for shame [F_{(2, 366)} = 11.080, p < 0.001, n² = 0.062; post-hoc: 1>2>3], and for hopelessness [F_{(2, 366)} = 17.667, p < 0.001, n² = 0.090, post-hoc: 1 >2>3].

Learning Achievement Emotions (LAE)

A statistically significant main effect of the SR IV (low-medium-high levels) [F_{(4, 696)} = 16.145 (Pillai's Trace), p < 0.001, n² = 0.085], and RT IV (low-medium-levels) [F_{(4, 696)} = 8.833 (Pillai's Trace), p < 0.001, n² = 0.048], was noted on the LAE. The statistically significant partial effect was maintained of the SR IV (low-medium-high levels) for both Positive Emotions [F_{(2, 348)} = 27.716, p < 0.001, n² = 0.135, 1 <2 <3], and Negative Emotions [F_{(2, 348)} = 21.804 (Pillai's Trace), p < 0.001, n² = 0.111; 1>2>3]. The statistically significant partial effect was maintained of the PR IV (low-medium-high levels) for both Positive Emotions [F_{(2, 348)} = 15.028, p < 0.001, n² = 0.079, 3>2,1], and Negative Emotions [F_{(2, 348)} = 8.205 (Pillai's Trace), p < 0.001, n² = 0.045; 3 <2,1]. No statistical effect of significant interaction appeared.

Complementarily, a statistically significant main effect of the SR IV (low-medium-high levels) [F_{(16, 684)} = 4.943 (Pillai's Trace), p < 0.001, n² = 0.104], and RT IV (low-medium-levels) [F_{(16, 684)} = 2.964 (Pillai's Trace), p < 0.001, n² = 0.065], was noted on the factors of LAE. The statistically significant partial effect of SR IV was retained for enjoyment [F_{(2, 348)} = 18.713, p < 0.001, n² = 0.097; post-hoc: 3>2>1], for hope [F_{(2, 348)} = 29.686, p < 0.001, n² = 0.146; post-hoc: 3>2>1], for pride [F_{(2, 348)} = 17.887, p < 0.001, n² = 0.093; post-hoc: 3>2>1], for boredom [F_{(2, 348)} = 15.194, p < 0.001, n² = 0.080; post-hoc: 1>2>3], for anger [F_{(2, 348)} = 9.746, p < 0.001, n² = 0.053; post-hoc: 1>2>3], for anxiety [F_{(2, 348)} = 16.603, p < 0.001, n² = 0.097; post-hoc: 1>2>3], for shame [F_{(2, 348)} = 19.089, p < 0.001, n² = 0.099; post-hoc: 1>2>3], and for hopelessness [F_{(2, 348)} = 19.308, p < 0.001, n² = 0.100, post-hoc: 1 >2>3]. A statistically significant partial effect of RT IV was retained for enjoyment [F_{(2, 348)} = 9.841, p < 0.001, n² = 0.054; post-hoc: 3>2,1], for hope [F_{(2, 348)} = 13,123, p < 0.001, n² = 0.170; post-hoc: 3>2,1], for pride [F_{(2, 348)} = 13.693, p < 0.001, n² = 0.073; post-hoc: 3>2>1], for boredom [F_{(2, 348)} = 13.165, p < 0.001, n² = 0.070; post-hoc: 1,2>3], for anger [F_{(2, 348)} = 6.645, p < 0.001, n² = 0.037; post-hoc: 1,2>3], for anxiety [F_{(2, 348)} = 3.090, p < 0.001, n² = 0.037; post-hoc: 1>2>3], for shame [F_{(2, 348)} = 2.676, p < 0.001, n² = 0.015; post-hoc: 1,2>3], and for hopelessness [F_{(2, 348)} = 7.935, p < 0.001, n² = 0.044, post-hoc: 1,2>3].

Test Achievement Emotions (TAE)

A statistically significant main effect of the SR IV (low-medium-high levels) [F_{(4, 716)} = 14.276 (Pillai's Trace), p < 0.001, n² = 0.074], and RT IV (low-medium-levels) [F_{(4, 716)} = 5.8705 (Pillai's Trace), p < 0.001, n² = 0.032], was noted on the TAE. The statistically significant partial effect was maintained of the SR IV (low-medium-high levels) for both Positive Emotions [F_{(2, 358)} = 21.361, p < 0.001, n² = 0.107, 3>2>1], and Negative Emotions [F_{(2, 358)} = 17.415 (Pillai's Trace), p < 0.001, n² = 0.087; 1 >2 >3]. The statistically significant partial effect was maintained of the PR IV (low-medium-high levels) for both Positive Emotions [F_{(2, 358)} = 11.268, p < 0.001, n² = 0.059, 3>2,1], and Negative Emotions [F_{(2, 3585)} = 0,595 (Pillai's Trace), ns, n² = 0.052]. No statistical effect of significant interaction appeared.

Complementarily, a statistically significant main effect of the SR IV (low-medium-high levels) [F_{(16, 704)} = 4.613 (Pillai's Trace), p < 0.001, n² = 0.095], and RT IV (low-medium-levels) [F_{(16, 704)} = 2.981 (Pillai's Trace), p < 0.001, n² = 0.063], was noted on the factors of TAE. The statistically significant partial effect was retained for enjoyment [F_{(2, 358)} = 7.161, p < 0.001, n² = 0.038; post-hoc: 3>2,1], for hope [F_{(2, 358)} = 11.813, p < 0.001, n² = 0.062; post-hoc: 3>2,1], for pride [F_{(2, 358)} = 9.958, p < 0.001, n² = 0.053; post-hoc: 3>2,1], for relief [F_{(2, 358)} = 4.789, p < 0.01, n² = 0.952; post-hoc: 1>2,3], for anger [F_{(2, 358)} = 2.518, p < 0.05, n² = 0.014; post-hoc: 1,2>3], for anxiety [F_{(2, 358)} = 0.341, ns, n² = 0.002], for shame [F_{(2, 358)} = 0.225, ns, n² = 0.001], and for hopelessness [F_{(2, 358)} = 2.405, p < 0.09 ns, n² = 0.013].

Engagement-Burnout

A statistically significant general main effect of the Self-Regulation IV (low-medium-high levels) [F_{(4, 1808)} = 38.541 (Pillai's Trace), p < 0. 001, n² = 0.079; post-hoc: 3 >2 > 1], and Regulatory Teaching IV (low-medium-high levels) [F_{(4, 1808)} = 21.850 (Pillai's Trace), p < 0. 001, n² = 0.046; post-hoc: 3 >2 > 1] was observed on Engagement-Burnout levels. The statistically significant partial effect was maintained of Self-Regulation IV both Engagement [F_{(2, 914)} = 44.886, p < 0.001, n² = 0.090, 1>2>3], and Burnout [F_{(2, 914)} = 76.096 (Pillai's Trace), p < 0.001, n² = 0.144; 3 >2 >1]. A statistically significant general main effect of the Regulatory Teaching IV (low-medium-high levels) both Engagement-Burnout [F_{(4, 1808)} = 21.850, p < 0.001, n² = 0.946, 1>2>3].

The combined analysis of the Self-Regulation IV's effect (low-medium-high levels) on the components of engagement-burnout yielded a statistically significant main effect [F_{(12, 1800)} = 17535 (Pillai's Trace), p < 0.001, n² = 0.105]. The statistically significant partial effect was retained for vigor [F_{(2, 904)} = 48.663, p < 0.001, n² = 0.097; post-hoc: 3>2>1], for dedication [F_{(2, 904)} = 24.995, p < 0.001, n² = 0.092; post-hoc: 3>2>1], for absorption [F_{(2, 904)} = 23.660, p < 0.001, n² = 0.093; post-hoc: 3>2>1], for exhaustion [F_{(2, 904)} = 48.474, p < 0.001, n² = 0.097; post-hoc: 1>2>3], for cynicism [F_{(2, 904)} = 30.573, p < 0.001, n² = 0.063; post-hoc: 1>2>3], for lack of effectiveness [F_{(2, 904)} = 84.497, p < 0.001, n² = 0.156; post-hoc: 1>2>3].

In a complementary way, a statistically significant general main effect of the Regulatory Teaching IV (low-medium-high levels) was observed on the components of engagement-burnout levels [F_{(12, 1800)} = 9,218 (Pillai's Trace), p < 0. 001, n² = 0.058]. The statistically significant partial effect was retained for vigor [F_{(2, 904)} = 35.222, p < 0.001, n² = 0.072; post-hoc: 3>2>1], for dedication [F_{(2, 904)} = 33.156, p < 0.001, n² = 0.068; post-hoc: 3,2>1], for absorption [F_{(2, 904)} = 21.111, p < 0.001, n² = 0.041; post-hoc: 3,2>1], for exhaustion [F_{(2, 904)} = 21.111, p < 0.001, n² = 0.145; post-hoc: 1, 2>3], for cynicism [F_{(2, 904)} = 17.524, p < 0.001, n² = 0.037; post-hoc: 1,2>3], for lack of effectiveness [F_{(2, 904)} = 37.543, p < 0.001, n² = 0.077 post-hoc: 1>2>3] (see Tables 4, 5, and Figure 1).

TABLE 5

Table 5. Combined and Interdependent effects (3 × 3) between the independent variables of low-medium-high levels of Self-Regulation (SR) and low-medium-high levels of Regulatory Teaching (RT), i.e., external regulation, on dependent variables (n = 201).

FIGURE 1

Figure 1. Graphic representation of the effect of the low (1)-medium (2)-high (3) levels in Self- Regulation IV (GRUPSRQ) and low (1)-medium (2)-high (3) in Regulatory Teaching IV (GRUPER) on the positive and negative academic emotions of each situation: class (CRE), study (LRE) and exam (TE). Complementarily, effects on ENGAGEMENT and BURNOUT.

Combined Effects of Regulation Variables: A Utility Model™ for Types of Interactions Between Levels of Self-Regulation and External Regulation (Regulatory Teaching)

Building a Combination Typology for Understanding Academic Emotions and Effects

The multivariate analyses (MANOVAs) showed a statistically significant main effect of the five interaction types on the low-medium-high levels of SR and of RT (see Table 6):

TABLE 6

Table 6. Combination between the parameters of the model hypothesized by the SRL vs. ERL Theory: the Utility Model™ (de la Fuente, 2019).

Combination 1 presented a statistically significant low level in SR and low level in RT (1 and 1). The average regulation level of 1.0, and the rank level is 1. The range of regulation tends toward low SR and low RT, associated with a high level of dysregulation. The most probable emotions are low levels of positive emotions and high levels of negatives emotions. Consequently, the effects are a high level of stress: high burnout and low engagement.

Combination 2 had a statistically significant low-medium level in SR and medium-low level in RT and vice versa (2 and 1, or 1 and 2). The average regulation level is 1.5, and the rank level is 2. The range of regulation tends toward low-medium SR and low-medium RT, and vice versa, associated with medium-low level of dysregulation. The most probable emotions are medium-low level of positive emotions and medium-low level of negative emotions. Consequently, the effects are a medium-high level of stress: medium-high burnout and medium-low engagement.

Combination 3 presented a statistically significant medium SR level (2) and medium RT level (2 and 2). The average regulation level of 2.0, and the rank level is 3. The range of regulation tends toward medium SR and medium RT, associated with medium level of dysregulation. The most probable emotions are medium level of positive emotions and medium level of negative emotions. Consequently, the effects are a medium level of stress: medium burnout and medium engagement.

Combination 4 had a statistically significant medium SR- high RT and high RT- medium SR (2 and 3, or 3 and 2). The average regulation level is 2.5, and the rank level is 4. The range of regulation tends toward high SR–medium RT and medium SR and high RT, associated with a good level of regulation. The most probable emotions are medium-high level of positive emotions and medium-low level of negative emotions. Consequently, the effects are a medium-low level of stress: medium-low burnout and medium-high engagement.

Combination 5 presented statistically significant high SR- high RT and high RT- high SR (3 and 3). The average regulation level is 3.0, and the rank level is 5. The range of regulation tends toward high SR–high RT, associated with a high level of regulation. The most probable emotions are high level of positive emotions and low level of negative emotions. Consequently, the effects are a low level of stress: low engagement and high burnout.

Empirical Evidence for Combination Typology in Understanding Achievement Emotions

Preliminary analysis

The MANOVA produced statistically significant differences among the five groups in levels of self-regulation (SR) and regulatory teaching (RT); both variables were adequately configured as established in Table 6. See Table 7 for statistical effects.

TABLE 7

Table 7. Combined Effects of Levels in Regulatory Type variables (5 × 2; 5 × 8): Mean score, standard deviation and specific effects (n = 336).

Effects

A statistically significant main effect of the five combinations of SR and RT as IV was noted in Class Achievement Emotions (CAE), Learning Achievement Emotions (LAE) and Test Achievement Emotions (TAE). The statistically significant partial effect was maintained of the five combinations of SR and RT IV for both Positive Emotions and Negative Emotions. In the case of positive emotions, a significant statistical effect appeared in favor of higher levels [4, 5 > 3 > 2, 1], while for negative emotions the effect was reversed, in favor of lower levels [1, 2 > 3 > 4, 5]. The statistically significant partial effect was maintained for each positive emotion (enjoyment, hope, pride), and for negative emotions (boredom -or relief-, anger, anxiety, shame, and hopelessness). Complementarily, in the case of engagement, a significant statistical effect appeared in favor of higher levels [4, 5 > 3 > 2, 1], while for burnout the effect was reversed, in favor of lower levels [1, 2 > 3 > 4, 5]. The statistically significant partial effect was maintained for engagement factors (vigor, dedication, absorption), and for burnout factors (depletion, cynicism, and lack of effectiveness) (see Table 7). The graphic representation of the differential progressive effect of the combination between SR and RT levels is shown in Figure 2. Thus, while positive academic emotions and engagement progressively increase through the 5 levels of interaction, negative academic emotions and burnout decrease in the same proportion. Specifically, the clearest effects are increased vigor as the degree of interaction rises, and greater loss of effectiveness with lower interaction levels.

FIGURE 2

Figure 2. Graphic representation of the effects of the five types of interactions (levels 1–5) in achievement emotions (positive and negative) and in engagement-burnout, in the three situations: class (CRE), study (LRE), and exam (TAE).

Discussion

SRL vs. ERL Theory (de la Fuente, 2017) predicts that achievement emotions may be determined jointly by the students' degree of self-regulation and the level of external regulation offered by the teaching process. Furthermore, this type of interaction can be understood as the combination of low-medium-high levels of both factors, as seen in prior evidence (de la Fuente et al., 2015b, 2017). This hypothesis, however, has not been tested in reference to achievement emotions, even though there is recent research that considers this focus (Frenzel et al., 2018).

In the case of the first hypothesis, the evidence presented here shows the plausibility of ordering the combinations of students' levels of self-regulation (low-medium-high) and the regulatory level of the teaching process (low-medium-high), along a continuum. This allows for an improved combination model that organizes this interactive reality, as compared to the prior version of this theoretical model (de la Fuente, 2017). The previous model had only four levels of interaction and was more inaccurate (see Table 3). This means that the university teaching-learning process can be measured and classified along such a continuum.

In the case of the second and third hypotheses, the predictions were fulfilled quite accurately. The increase in the level of self-regulation level of students, significantly determined an increase in positive emotions (enjoyment, hope, pride…) and engagement, and a decrease in negative emotions (anger, anxiety, haplessness…), deactivation (boredom and relief) and burnout. On one hand, this lends empirical support to the construct of self-regulation, by showing that it has the potential to discriminate degrees of positive and negative emotions in students. This result is consistent with plentiful prior evidence that has shown a positive, significant correlation between self-regulation and the personality factor of conscientiousness, leading us to consider that self-regulation is a meta-behavioral variable that materializes this personality variable, associated with less stress, in contrast to the variable of neuroticism (Cheng et al., 2017). Also, consistent would be the expectancy-value theory (Pekrun, 2006; Stark et al., 2017), if we take degree of self-regulation as a correlate of a higher level of expectancy, of the task value, the effort and the success of university students (Garzón-Umerenkova et al., 2018).

On the other hand, there is evidence to support the construct of a regulatory teaching level, by establishing that this variable also determines the degree of students' positive and negative emotions, engagement and burnout. Thus, the positive emotion that is prompted by greater levels of external regulation is confidence—resulting from a more predictable context—while a negative emotion of anger or hopelessness results from the lack of contextual regulation or from dysregulation. These results are consistent with evidence-based recommendations and are required in order to implement the regulatory teaching or effective teaching (Roehrig et al., 2012): (1) Cognitive quality of the instruction task; (2) Quality of motivation during the instruction; (3) Support for autonomy through teaching self-regulation; (4) Goal structures, practices and performance expectations; (5) Design of tests and quizzes; (6) Performance consequences.

In general, this classification would reveal the interdependence between the self-regulation level, and regulatory teaching level, and type of academic emotionality. Greater levels of positive or negative emotionality, ultimately entail, greater experiences of engagement or burnout.

Limitations and Future Directions

Beyond the evidence of the positive and negative emotionality that characterizes the interactions described above, there is still a need to establish whether the different interactions produce different specific stress factors coming from the context, therefore resulting in stress responses from the students. This aspect has not been addressed in the present research study. This would mean looking further into scientific evidence that would confirm the precise origin of positive or negative emotionality that stems from the teaching context. Future research studies should also establish the relationship between regulatory teaching and the teacher's own achievement emotions (Frenzel et al., 2016) or the emotional intelligence of the teacher (Pishghadam et al., 2017). It is plausible that a teacher who deploys a regulatory teaching process—taking into account his/her own high expectancy-value—will probably experience their teaching situation with positive emotionality, while a teacher who teaches in a non-regulating or dysregulating fashion will have greater negative emotionality. This interesting hypothesis should be tested in the future.

Conclusions and Implications

Conclusions

The most interesting result of this study has to do with the cumulative or combined effect, of the effects produced jointly by both variables. This is seen in the consistent, linear function that explains the combined effect of each variable on university students' emotional experience, as well as their place on the engagement-burnout continuum. This effect is especially important because it shows that all students benefit from external regulation, while they are also harmed by non-regulation or dysregulation. Similarly, it shows that students with high self-regulation call for and are more committed to highly regulatory contexts. This step forward in the interactive, contextualized study of students' achievement emotions represents progress toward consolidating contextualized (i.e., third level) molar psycho-educational models in real settings, and not only knowledge about relations between achievement emotions and personality variables, in molecular-level models (de la Fuente et al., 2019). This contribution allows us to more accurately and interactively reconceptualize the relative weight of variables pertaining to the subject and to the teaching context, when explaining university students' experiences with achievement emotions. A remarkable similarity was found between emotional experiences in the different situations -class, study and test- (Pekrun, 2006; Pekrun and Perry, 2014), which may suggest a certain unified emotional experience or an experience of the teaching-learning process as one overall stimulus.

Implications for the Practice of Educational Psychology

Several implications from this investigation can be noted. First, it is important to know students' level of self-regulation, so that personalized intervention programs may be applied. If average levels of self-regulation in university students involve non-regulated behaviors (mid-level in positive and negative emotions) or dysregulated behaviors (high level of negative and low level of positive emotions), university guidance and counseling services ought to detect and help these types of students, as they begin their university studies, to promote stress management and coping strategies, and so minimize the impact of negative effects from the university experience. Certain programs in current use might help toward this end (de la Fuente, 2015c), either in a face-to-face format or through online technology tools (de la Fuente et al., 2018).

Second, there is an essential need to evaluate and know the level of effective teaching, and to detect the different contexts of regulatory teaching, especially when these are non-regulating or dysregulating, because of their negative emotional on students' emotional experiences. The academic experiences of emotional disconnection (boredom) and of negative emotionality (anger, anxiety, shame, hopelessness) have been amply associated with academic failure and dropout (Putwain et al., 2018, 2019; Reindla et al., 2018). There is also a need to observe experiences of satisfaction (enjoyment, hope, engagement), that these might be maintained and promoted within the university community. Therefore, university teacher training programs should include the knowledge, skills and attitudes of the teacher to promote positive emotions in students.

Data Availability

The datasets generated for this study are available on request to the corresponding author.

Ethics Statement

This studies involving human participants were reviewed and approved by Comité de Ética de la Investigación. Universidad de Navarra. The patients/participants provided their written informed consent to participate in this study.

Author Contributions

JF has coordinated the R&D Project, has made the general design, data analysis, and first writing of the manuscript. JM-V has reviewed the design and analysis of data. FP-S has collected the data sample and has revised the manuscript. AG-U has collected the data sample and has revised the manuscript. MV has reviewed the previous evidence and the theoretical foundation. PP has provided the translation of the instruments and validated them in Spanish.

Funding

R&D Project PGC2018-094672-B-I00 (Ministry of Science and Education, Spain), and UAL18-SEJ-DO31-A-FEDER (University of Almería, Spain), and the European Social Fund.

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyg.2019.02070/full#supplementary-material

References

Ainley, M., and Hidi, S. (2014). “Interest and enjoyment,” in International Handbook of Emotions in Education, eds R. Pekrun and L. Linnenbrink-Garcia (New York, NY: Routledge, 205–227.

Google Scholar

Bigg (2001). Teaching for Quality Learning at University. 3rd Edn. Buckingham: Open University Press.

Google Scholar

Burr, J., and Dallaghan, J. L. B. (2019). The relationship of emotions and burnout to medical students' academic performance. Teach. Learn. Med. doi: 10.1080/10401334.2019.1613237. [Epub ahead of print].

PubMed Abstract | CrossRef Full Text | Google Scholar

Cheng, H., Deighton, J., Wolpert, M., Chapman, B. P., Kornilaki, E. N., Treglown, L., et al. (2017). Hay fever in childhood, traits Neuroticism and Conscientiousness as independent predictors of the occurrence of hay fever in adulthood. J. Health Psychol. 21, 2367–75. doi: 10.1177/1359105315576784

PubMed Abstract | CrossRef Full Text | Google Scholar

de la Fuente, J. (2015a). Learning-Related Emotions Questionarie. Spanish versión. University of Almería.

Google Scholar

de la Fuente, J. (2015b). Test-Related Emotions Questionarie. Spanish versión. University of Almería.

Google Scholar

de la Fuente, J. (2015c). Competence for Studying, Learning and Performance Under Stress: Self-Help Guide for University Students, Graduates and Professional Examination Candidades. Almería: Education & Psychology I+D+I, e-Publishing Series I+D+I.

Google Scholar

de la Fuente, J. (2017). Theory of self- vs. externally-regulated learning™: fundamentals, evidence, and applicability. Front. Psychol. 8:1675. doi: 10.3389/fpsyg.2017.01675

CrossRef Full Text | Google Scholar

de la Fuente, J. (2019). The Utility Model for the SRL vs ERL Theory. Trade Mark in Process. Pamplona: University of Navarra.

Google Scholar

de la Fuente, J., González-Torres, M. A., Aznarez, M., Martínez-Vicente, J. M, Peralta-Sánchez, F. J., and Vera, M. M. (2019). Implications of unconnected micro, molecular and molar level research in psychology: the case of executive functions, self-regulation and external regulation. Front. Psychol. 10:1919. doi: 10.3389/fpsyg.2019.01919

PubMed Abstract | CrossRef Full Text | Google Scholar

de la Fuente, J., López, M., Zapata, L., Sollinas, G., and Fadda, S. (2015a). “Improving mental health trough and online self-assessment and self-help e-utility in university students,” in Progress in Education, Vol. 33, ed R. V. Nata (New York, NY: Nova Publisher, 63–74.

Google Scholar

de la Fuente, J., Martínez-Vicente, J. M., Peralta-Sánchez, F. J., González-Torres, M. C., Artuch, R., and Garzón-Umerenkova, A. (2018). Satisfaction with the self-assessment of university students through e-coping with academic stress utility™. Front. Psychol. 9:1932. doi: 10.3389/fpsyg.2018.01932

CrossRef Full Text | Google Scholar

de la Fuente, J, Sander, P, Martínez-Vicente, J. M., Vera, M. M., Garzón, A., and Fadda, S. (2017). Combined effect of levels in personal self-regulation and regulatory teaching on meta-cognitive, on meta-motivational, and on academic achievement variables in undergraduate students. Front. Psychol. 8:232. doi: 10.3389/fpsyg.2017.00232

PubMed Abstract | CrossRef Full Text | Google Scholar

de la Fuente, J., Zapata, L., Martínez-Vicente, J. M., Cardelle-Elawar, M., Sander, P., Justicia, F., et al. (2012). Regulatory teaching and self-regulated learning in college students: confirmatory validation study of the IATLP scales. Electron. J. Res. Educ. Psychol. 10, 839–866. doi: 10.25115/ejrep.v10i27.1511

CrossRef Full Text | Google Scholar

de la Fuente, J., Zapata, L., Martínez-Vicente, J. M., Sander, P., and Cardelle-Elawar, M. (2015b). The role of personal self-regulation and regulatory teaching to predict motivational-affective variables, achievement, and satisfaction: a structural model. Front. Psychol. 6:399. doi: 10.3389/fpsyg.2015.00399

PubMed Abstract | CrossRef Full Text | Google Scholar

Dicke, T., Marsh, H. W., Parker, P. D., Pekrun, R., Guo, J., and Televantou, I. (2018). Effects of school-average achievement on individual self-concept and achievement: unmasking phantom effects masquerading as true compositional effects. J. Educ. Psychol. 110, 1112–1126. doi: 10.1037/edu0000259

CrossRef Full Text | Google Scholar

D'Mello, S. (2013). A selective meta-analysis on the relative incidence of discrete affective states during learning with technology. J. Educ. Psychol. 105, 1082–1099. doi: 10.1037/a0032674

CrossRef Full Text | Google Scholar

Dormann, C., Demerouti, E., and Bakker, A. B. (2017). “A model of positive and negative learning: learning demands and resources, learning engagement, critical thinking, and fake news detection,” in Positive Learning in the Age of Information (PLATO)–A Blessing or a Curse? eds O. Zlatkin-Troitschanskaia, G. Wittum, and A. Dengel (Wiesbaden: Springer, 305–335.

Google Scholar

Frenzel, A. C., Becker-Kurz, B., Pekrun, R., Goetz, T., and Lüdtke, O. (2018). Emotion transmission in the classroom revisited: a reciprocal effects model of teacher and student enjoyment. J. Educ. Psychol. 110, 628–639. doi: 10.1037/edu0000228

CrossRef Full Text | Google Scholar

Frenzel, A. C., Pekrun, R., and Goetz, T. (2007). Perceived learning environment and students' emotional experiences: a multilevel analysis of mathematics classrooms. Learn. Instruct. 17, 487–493. doi: 10.1016/j.learninstruc.2007.09.001

CrossRef Full Text | Google Scholar

Frenzel, A. C., Pekrun, R., Goetz, T., Daniels, L. M., Durksen, T. L., Becker-Kurz, B., et al. (2016). Measuring enjoyment, anger, and anxiety during teaching: the Teacher Emotions Scales (TES). Contemp. Educ. Psychol. 46, 148–163. doi: 10.1016/j.cedpsych.2016.05.003

CrossRef Full Text | Google Scholar

Garzón-Umerenkova, A., de la Fuente, J., Amate, J., Paoloni, P. V., Fadda, S., and Fiz, J. (2018). A linear empirical model of self-regulation on flourishing, health, procrastination, and achievement, among university students. Front. Psychol. 9:536. doi: 10.3389/fpsyg.2018.00536

PubMed Abstract | CrossRef Full Text | Google Scholar

Gentsch, K., Loderer, K., Soriano, C., Fontaine, J. R., Eid, M., Pekrun, R., et al. (2018). Effects of achievement contexts on the meaning structure of emotion words. Cognit. Emot. 32, 379–388. doi: 10.1080/02699931.2017.1287668

PubMed Abstract | CrossRef Full Text | Google Scholar

Goetz, T., Frenzel, A. C, Hall, N. C., Nett, U. E., Pekrun, R., and Lipnevich, A. A. (2014). Types of boredom: an experience sampling approach. Motiv. Emot. 38, 401–419. doi: 10.1007/s11031-013-9385-y

CrossRef Full Text | Google Scholar

Goetz, T., Frenzel, A. C., and Pekrun, R. (2007a). Regulation von Langeweile im Unterricht. Was Schülerinnen und Schüler bei der “Windstille der Seele” (nicht) tun [Regulation of boredom during classroom instruction]. Unterrichtswissenschaft 35, 312–333.

Google Scholar

Goetz, T., Frenzel, A. C., Pekrun, R., Hall, N. C., and Lüdtke, O. (2007b). Between- and within-domain relations of students' academic emotions. J. Educ. Psychol. 99, 715–733. doi: 10.1037/0022-0663.99.4.715

CrossRef Full Text | Google Scholar

Goetz, T., Kleine, M., Pekrun, R., vom Hofe, R., Blum, W., Zirngibl, A., et al. (2004). Leistung und emotionales Erleben im Fach Mathematik: Längsschnittliche Mehrebenenanalysen [Achievement and emotions in mathematics: Longitudinal multi-level analysis]. Z. Pädag. Psychol. 18, 174–183. doi: 10.1024/1010-0652.18.34.201

CrossRef Full Text | Google Scholar

Khosa, D. K., and Volet, S. E. (2014). Productive group engagement in cognitive activity and metacognitive regulation during collaborative learning: can it explain differences in students' conceptual understanding? Metacognit. Learn. 9, 287–307. doi: 10.1007/s11409-014-9117-z

CrossRef Full Text | Google Scholar

Leiter, M. P., and Marlach, C. (2017a). Burnout and engagement: contributions to a new visión. Burnout Res. 5 55–57. doi: 10.1016/j.burn.2017.04.003

CrossRef Full Text | Google Scholar

Leiter, M. P., and Marlach, C. (2017b). Latent burnout profiles: a new approach to understanding theburnout experience. Burnout Res. 3, 89–100. doi: 10.1016/j.burn.2016.09.001

CrossRef Full Text | Google Scholar

Linnenbrink-Garcia, L., and Pekrun, R. (Eds.). (2011). Students' emotions and academic engagement. Contemp. Educ. Psychol. 36, 1–3. doi: 10.1016/j.cedpsych.2010.11.004

CrossRef Full Text | Google Scholar

Lüftenegger, M, Klug, J, Harrer, K, Langer, M, Spiel, C, and Schober, B. (2016). Students' achievement goals, learning-related emotions and academic achievement. Front. Psychol. 7:603. doi: 10.3389/fpsyg.2016.00603

PubMed Abstract | CrossRef Full Text | Google Scholar

Mainhard, T., Oudman, S., Hornstra, L., Bosker, R. J., and Goetz, T. (2018). Student emotions in class: The relative importance of teachers and their interpersonal relations with students. Learn. Instruct. 53, 109–119. doi: 10.1016/j.learninstruc.2017.07.011

CrossRef Full Text | Google Scholar

Maslach, C., and Jackson, S. E. (1981). The measurement of experienced burnout. J. Occup. Behav. 2, 99–113. doi: 10.1002/job.4030020205

CrossRef Full Text | Google Scholar

Maslach, C., and Leiter, M. P. (1997). The Truth About Burnout: How Organizations Cause Personal Stress and What to Do About It. San Francisco, CA: Jossey-Bass.

Google Scholar

Miller, W. R., and Brown, J. M. (1991). “Self-regulation as a conceptual basis for the prevention and treatment of addictive behaviors,” in Self-Control and the Addictive Behaviours, eds N. Heather, W. R. Miller, and J. Greely (Sydney, NSW: Maxwell Macmillan, 3–79.

Google Scholar

Muis, K. R., Chevrier, M., and Singh, C. A. (2018). The role of epistemic emotions in personal epistemology and self-regulated learning. Educ. Psychol. 53, 165–184. doi: 10.1080/00461520.2017.1421465

CrossRef Full Text | Google Scholar

Murayama, K., Goetz, T., Malmberg, L.-E., Pekrun, R., Tanaka, A., and Martin, A. J. (2017). “Within-person analysis in educational psychology: Importance and illustrations,” in British Journal of Educational Psychology Monograph Series II: Psychological Aspects of Education—Current Trends: The Role of Competence Beliefs in Teaching and Learning, eds D. W. Putwain and K. Smart (Oxford: Wiley), 71–87.

Google Scholar

Paoloni, P. V. R. (2014). Emociones en contextos académicos. Perspectivas teóricas e implicaciones para la práctica educativa en la universidad [Emotions in academic contexts. Theoretical perspectives and implications for educational practice in the university. Electr Journ. Res. In Educ. Psyc. 12, 567–596. doi: 10.14204/ejrep.34.14082

CrossRef Full Text | Google Scholar

Paris, S., and Winograd, P. (2003). The Role of Self-Regulated Learning in Contextual Teaching: Principals and Practices for Teacher Preparation. Washington, DC: Office of Educational Research and Improvement (ED).

Google Scholar

Pekrun, R. (1992). The impact of emotions on learning and achievement: Towards a theory of cognitive/motivational mediators. Appl. Psychol. 41, 359–376. doi: 10.1111/j.1464-0597.1992.tb00712.x

CrossRef Full Text | Google Scholar

Pekrun, R. (2006). The control-value theory of achievement emotions: Assumptions, corollaries, and implications for educational research and practice. Educ. Psychol. Rev. 18, 315–341. doi: 10.1007/s10648-006-9029-9

CrossRef Full Text | Google Scholar

Pekrun, R. (2014). Emotions and Learning (Educational Practices Series, Vol. 24). Geneva: International Academy of Education (IAE) and International Bureau of Education (IBE) of the United Nations Educational, Scientific and Cultural Organization (UNESCO).

Google Scholar

Pekrun, R., Cusack, A., Murayama, K., Elliot, A. J., and Thomas, K. (2014a). The power of anticipated feedback: effects on students' achievement goals and achievement emotions. Learn. Instruct. 29, 115–124. doi: 10.1016/j.learninstruc.2013.09.002

CrossRef Full Text | Google Scholar

Pekrun, R., Elliot, A. J., and Maier, M. A. (2009). Achievement goals and achievement emotions: testing a model of their joint relations with academic performance. J. Educ. Psychol. 101, 115–135. doi: 10.1037/a0013383

CrossRef Full Text | Google Scholar

Pekrun, R., Goetz, T., Frenzel, A. C., Barchfeld, P., and Perry, R. P. (2011). Measuring emotions in students' learning and performance: the achievement emotions questionnaire (AEQ). Contemp. Educ. Psychol. 36, 36–48. doi: 10.1016/j.cedpsych.2010.10.002

CrossRef Full Text | Google Scholar

Pekrun, R., Goetz, T., and Perry, R. P. (2005). Academic Emotions Questionnaire (AEQ). User's manual. Department of Psychology, University of Munich.

Google Scholar

Pekrun, R., Hall, N. C., Goetz, T., and Perry, R. P. (2014b). Boredom and academic achievement: testing a model of reciprocal causation. J. Educ. Psychol. 106, 696–710. doi: 10.1037/a0036006

CrossRef Full Text | Google Scholar

Pekrun, R., and Linnenbrink-Garcia, L. (2014). International Handbook of Emotions in Education. New York, NY: Routledge.

Google Scholar

Pekrun, R., Muis, K. R., Frenzel, A. C., and Goetz, T. (2017a). Emotions at School. New York: Taylor & Francis; Routledge.

Google Scholar

Pekrun, R., Murayama, K., Marsh, H. W., Goetz, T., and Frenzel, A. C. (2019). Happy fish in little ponds: testing a compositional effects model of achievement and emotion. J. Pers. Soc. Psychol. doi: 10.1037/pspp0000230

CrossRef Full Text | Google Scholar

Pekrun, R., and Perry, R. P. (2014). “Control-value theory of achievement emotions,” in International Handbook of Emotions in Education, eds R. Pekrun and L. Linnenbrink-Garcia (New York, NY: Taylor & Francis, 120–141.

Google Scholar

Pekrun, R., and Stephens, E. J. (2012). “Academic emotions,” in APA Educational Psychology Handbook, Vol. 2: Individual Differences and Cultural and Contextual Factors, ed K. R. Harris (Washington, DC: American Psychological Association, 3–31.

Google Scholar

Pekrun, R., Vogl, E., Muis, K. R., and Sinatra, G. M. (2017b). Measuring emotions during epistemic activities: the epistemically-related emotion scales. Cognit. Emot. 31, 1268. doi: 10.1080/02699931.2016.1204989

PubMed Abstract | CrossRef Full Text | Google Scholar

Pichardo, M. C., Cano, F., Garzón-Umerenkova, A., de la Fuente, J., Peralta-Sánchez, F. J., and Amate-Romera, J. (2018). Self-Regulation Questionnaire (SRQ) in Spanish adolescents: factor structure and Rasch analysis. Front. Psychol. 9:1370. doi: 10.3389/fpsyg.2018.01370

PubMed Abstract | CrossRef Full Text | Google Scholar

Pichardo, M. C., Justicia, F., de la Fuente, J., Martínez-Vicente, J. M., and y García-Berbén, A. B. (2014). Factor Structure of the Self-Regulation Questionnaire (SRQ) at Spanish Universities. Span. J. Psychol. 17, e62, 1–8. doi: 10.1017/sjp.2014.63

CrossRef Full Text | Google Scholar

Pishghadam, R., Baghaei, P., and Seyednozadi, Z. (2017). Introducing emotioncy as a potential source of test bias: a mixed rasch modeling study. Int. J. Test. 17, 127–140. doi: 10.1080/15305058.2016.1183208

CrossRef Full Text | Google Scholar

Pishghadam, R., and Khajavy, G. H. (2014). Development and validation of the student stroke scale and examining its relation with academic motivation. Stud. Educ. Eval. 43, 109–114. doi: 10.1016/j.stueduc.2014.03.004

CrossRef Full Text | Google Scholar

Putwain, D. W., Becker, S., Symes, W., and Pekrun, R. (2018). Reciprocal relations between students' academic enjoyment, boredom, and achievement over time. Learn. Instruct. 54, 73–81. doi: 10.1016/j.learninstruc.2017.08.004

CrossRef Full Text | Google Scholar

Putwain, D. W., Pekrun, R., Nicholson, L. J., Symes, W., Becker, S., and Marsh, H. W. (2019). Control-value appraisals, enjoyment, and boredom in mathematics: a longitudinal latent interaction analysis. Am. Educ. Res. J. 55, 1339–1368. doi: 10.3102/0002831218786689

CrossRef Full Text | Google Scholar

Reeve, J., Jang, H., Carrell, D., Jeon, S., and Barch, J. (2004). Enhancing students's engagement by incresting teachers'authonomy support. Motiv. Emot. 28, 147–169. doi: 10.1023/B:MOEM.0000032312.95499.6f

CrossRef Full Text | Google Scholar

Reindla, M., Tulisb, M., and Dreselc, M. (2018). Associations between friends, academic emotions and achievement: Individual differences in enjoyment and boredom. Learn. Individ. Differ. 62, 164–173. doi: 10.1016/j.lindif.2018.01.017

CrossRef Full Text | Google Scholar

Roehrig, A. D., Turner, J. E., Arrastia, M. C., Christesen, E., McElhaney, S., and Jakiel, L. M. (2012). “Effective teachers and teaching: characteristics and practices related to positive student outcomes,” in APA Educational Psychology Handbook, Vol. 2, eds K. A. Harris, S. Graham, and T. Urdan (Washington, DC: American Psychological Association, 501–527.

Google Scholar

Salanovaa, M., Schaufeli, W., Martineza, I., and Breso, E. (2010). How obstacles and facilitators predict academic performance: the mediating role of study burnout and engagement. Anxiety Stress Coping 23, 53–70. doi: 10.1080/10615800802609965

CrossRef Full Text | Google Scholar

Schutz, P. A., and Pekrun, R. (eds.). (2010). Emotion in Education. Chinese Edn. Shanghai: East China Normal University Press.

Google Scholar

Shaufeli, W. R., Martínez, I. S., Marqués, A., Salanova, S., and Bakker, A. B. (2002). Burnout and engagement in university students. A cross-national study. J. Cross Cult. Psychol. 33, 464–481. doi: 10.1177/0022022102033005003

CrossRef Full Text | Google Scholar

Stark, L., Malkmus, E., Stark, R., Brünken, R, and Park, B. (2017). Learning-related emotions in multimedia learning: An application of control-value theory. Learn. Instruct. 58, 42–52. doi: 10.1016/j.learninstruc.2018.05.003

CrossRef Full Text | Google Scholar

Stoeber, J., Childs, J. H., Hayward, J. A., and Feast, A. R. (2011). Passion and motivation for studying: predicting academic engagement and burnout in university students. Educ. Psychol. 31, 513–528. doi: 10.1080/01443410.2011.570251

CrossRef Full Text | Google Scholar

Uludag, O., and Yaratan, H. (2010). The effects of burnout on engagement: an empirical study on tourism students. J. Hosp. Leis. Sport Tour. Educ. 9, 13–23. doi: 10.3794/johlste.91.243

CrossRef Full Text | Google Scholar

Vermunt, D. H. M. (1989). “The interplay between internal and external regulation of learning, and the design of process-oriented instruction,” in Paper Presented at the Conference of the European Association of Research on Learning and Instruction (Madrid).

Google Scholar

Vermunt, J. D. (2007). The power of teaching-learning environments to influence student learning. Br. J. Educ. Psychol. Monogr. Series 4, 73–90. doi: 10.1348/000709906X162406

CrossRef Full Text | Google Scholar

Yerdelen, S., and Sungur, S. (2019). Multilevel investigation of students' self-regulation processes in learning science: classroom learning environment and teacher effectiveness. Int. J. Sci. Math. Educ. 17, 89–110. doi: 10.1007/s10763-018-9921-z

CrossRef Full Text | Google Scholar