- 1Department of Education and Psychology, International University of La Rioja, Logroño, Spain
- 2Department of Theory and Methods in Education and Psychology, School of Education and Psychology, University of Navarra, Pamplona, Spain
- 3Department of Psychology, University of Almería, Almería, Spain
- 4Associated Researcher Universidad Autónoma de Chile, School of Psychology, Santiago de Chile, Chile
- 5María Inmaculada School, University of Granada, Granada, Spain
- 6Department of Developmental and Educational Psychology, University of Granada, Granada, Spain
- 7Department of Social Psychology Cardiff, Cardiff Metropolitan University, Cardiff, UK
The ability to self-regulate behavior is one of the most important protective factors in relation with resilience and should be fostered especially in at-risk youth. Previous research has characterized these students as having behaviors indicating lack of foresight. The aim of the present study was to test the hypothetical relationship between these personal variables. It was hypothesized that self-regulation would be associated with and would be a good predictor of resilience, and that low-medium-high levels of self-regulation would lead to similar levels of resilience. The participants were 365 students -aged 15 and 21- from Navarre (Spain) who were enrolled in Initial Vocational Qualification Programs (IVQP). For the assessment, the Connor Davidson Resilience Scale (CD-RISC) and the Short Self-Regulation Questionnaire (SSRQ) were applied. We carried out linear association analyses (correlational and structural) and non-linear interdependence analyses (MANOVA) between the two constructs. Relationships between them were significant and positive. Learning from mistakes (self-regulation) was a significant predictor of coping and confidence, tenacity and adaptation, and tolerance to negative situations (resilience). Likewise, low-medium-high levels of self-regulation correlated with scores on resilience factors. Implications of these results for educational practice and for future research are discussed.
Introduction
The European Parliament and European Council declared 2010 the European Year for Combating Poverty and Social Exclusion (Bassett and Walsh, 2011). Social exclusion is understood as the extent to which a person has or does not have a place in society (Pérez de Armiño and Eizagirre, 2005).
Risk of Social Exclusion
Social exclusion is a multi-causal, dynamic, structural and multi-dimensional phenomenon (Devicienti and Poggi, 2011; Wang, 2012; Jahnukainen, 2014). This situation is often created by academic failure, which happens when students fail to finish compulsory secondary education and therefore do not meet the minimum requirements for access to the job market. In Spain and other Western countries, students who fail in the school system are one of the main groups considered to be at risk of social exclusion (Rew and Horner, 2003). This is confirmed by the indicators proposed by the Europe 2020 Strategy, which suggest that young people aged 18–24 are to be at risk of social exclusion (Eurostat, 2015). Recent research shows that the situation of this group has not improved since 2010 in Europe (Eurostat, 2013).
In recent years, Spain has launched several programs through regional and local governments, including the Initial Vocational Qualification Programs (IVQPs), preventive programs aimed at the educational or profesional integration of young people, for students who have not completed compulsory secondary education. These programs offer students another opportunity to study (Repper and Perkins, 2003). They provide a workframe for vocational training and they are the last chance that students have to obtain the Secondary Education qualification. The IVQP were established in 2008 in order to provide an educational opportunity for students aged 16–21 who do not have the compulsory secondary school (ESO) certificate. But these programs are also suitable for 15-year-old students when there is the possibility of dropping out of school, truancy, or rejection of the school system. The School Administration of each autonomous community within Spain is in charge of admitting students to such programs, taking into account their wishes and those of their parents.
However, it is vital that the considerable investment and effort that goes into educating young people in IVQPs should be supported by research into promoting the development of competencies. In precisely such contexts, self-regulation and resilience have been identified as key factors that can determine success or failure (Artuch, 2014). It is essential for social inclusion to be envisioned within the wider context of mental health, well-being and recovery (Repper and Perkins, 2003). In Dweck (2009): “The twenty-first century will belong to the passionate and resilient learners” (p. 9), and this probably applies to at-risk students even more than it does to those in mainstream contexts.
Resilience and Positive Adaptation of Students at Risk
We might ask ourselves whether these students would survive better in the system if their needs, strengths or weakness were detected soon and they were prepared to overcome adversity. From the very beginnings of resilience research, emphasis has been placed on the relation between resilience and positive adaptation (Dishion and Connell, 2006). According to Nota et al. (2004), it is important to take into consideration these aspects and study their relationship with success in the education system. Analysis of resilience in high-risk groups is therefore especially important (Norris, 2014; Suria, 2016).
Over the past 50 years resilience has been studied extensively, but in the past two decades the research has broadened considerably, making incursions into social sciences, healthcare, engineering and other fields (Zolli and Healy, 2012). Since the pioneering work of Garmezy, Werner, Rutter, Luthar, Masten, Kumpfer, and others (Zolkoski and Bullock, 2012), many authors have pursued the idea of promoting resilience in children and young people who are otherwise seen as “vulnerable” (Pearce, 2011).
Empirical research establishes three critical conditions in the conceptualization of resilience: (a) growing up in, or finding oneself in an adverse situation (always subjective); (b) the availability of protective factors (internal and external), and (c) managing to adapt positively despite the experience of adversity (González-Torres and Artuch, 2014). This positive adaptation, as Fergus and Zimmerman (2005) indicate, is a resilient outcome, a way to overcome a risk. Henderson and Milstein (2003, p. 26) making clear reference to the educational sphere, define it as “…the capacity to spring back, rebound, successfully adapt in the face of adversity and develop social, academic and vocational competence despite exposure to severe stress or simply to the stress that is inherent in today's world.”
Development of the Construct
The construct resilience has been developed scientifically in four waves or generations of research (Zolkoski and Bullock, 2012; O'Dougherty et al., 2013; Prince-Embury and Saklosfke, 2013) and in two specific geographical settings (France and the USA). Other European authors outside France (Rutter, 2005, 2006, 2007) and Latin American authors (Kotliarenco et al., 1997) have also studied the concept, but the bulk of the literature comes from these two countries.
According to Masten's work (2004) “Resilience in developing systems: Progress and promise as the 4th wave rises,” we can point to the existence of four stages in the research about resilience. The first was interested in identifying a short list of protective/buffering factors (internal and external) when facing risk and trauma. Internal factors such as high intelligence, development of appropriate coping strategies, optimism, problem solving, self-regulation have been observed to act to protect individuals against adverse situations (Zolkoski and Bullock, 2012; García-Vesga and Domínguez-de la Ossa, 2013). On the other hand, parenting styles, family structure and cohesiveness and teacher and peer relations belong to the external protectors. Notwithstanding, it must be kept in mind that no single factor promotes resilience in isolation (Grotberg, 1995; Fergus and Zimmerman, 2005).
The second wave sought to understand how protective and risk factors interact in the process of building up resilience, and different models of resilience were developed (Fergus and Zimmerman, 2005; Becoña, 2006).
The third was interested in fostering well-being in children and young people who have grown up in adverse circumstances, placing greater effort on promoting resilience through prevention or intervention, and developing educational and healthcare policies along these lines (Catalano et al., 2004; Goldstein and Brooks, 2013; Prince-Embury and Saklosfke, 2013; Doll et al., 2014). Some of these programs, like The Resilience Builder Program for Children and Adolescents. Enhancing Social Competence and Self-Regulation (Karapetian et al., 2011), include self-regulation as one of the most important factors in building resilience in youth. And finally, the fourth wave is now paying increased attention to biological and genetical variables in the study of resilience, even though for decades the main focus has been on psychological or behavioral variables (Cicchetti and Curtis, 2006).
Studies about resilience have helped to change the paradigm in social and health sciences. Rather than identifying risk factors, greater attention is now devoted to identifying the individual's strengths. For this reason, resilience has been closely connected with the research objectives and goals of Positive Psychology (MacConville and Rae, 2012), the paradigm of Positive Youth Development (PYD) in the field of prevention (Lee et al., 2012), and the recommendations for promoting Character Education (Peterson and Seligman, 2004; Vargas and González-Torres, 2009; Goldstein and Brooks, 2013; Lerner et al., 2013; Paterson et al., 2014). These frameworks of study, which are triggering considerable scientific research and many practical applications in the clinical and educational fields, all share a belief in the plasticity of human development, and an interest in personal strengths and in seeing young people as “resources to be developed” (Lerner et al., 2011, p. 5). They seek to identify and understand the processes and mechanisms that underlie assets, strengths and virtues, and are interested in furthering programs and activities that not only prevent risk behaviors but also contribute to optimal development—falling within the scope of PYD (Karapetian et al., 2011).
Assessing Resilience
Despite all the advances, we still lack a clear delimitation of this construct; it continues to overlap with other related constructs such as competence or hardiness (Luthar et al., 2006; Prince-Embury, 2013). Furthermore, when dealing with a multidimensional construct, it is more difficult to reach a consensus on a clear and operational definition. The debate thus continues about what constitutes resilient behavior and how to measure it (Masten and Obradovic, 2006).
One important aspect that must be addressed in order to advance in this field is the development and trialing of measurement instruments that highlight the validity of certain psychological or external resources as resilience indicators (Fergus and Zimmerman, 2005; Windle et al., 2011; Naglieri et al., 2013). Many instruments are available today for ascertaining the extent to which a person has developed resilience at a given point in their life. Thus, we find resilience scales for children (Devereux Early Childhood Assessment: DECA), for young people (The Resiliency Scales for Children and Adolescents: RSCA; Child and Youth resilience Measure: CYRM; Resilience scale for Adolescents: READ; Resilience Scale: RS) and for adults (Ego Resiliency; Connor-Davidson Resilience Scale: CD-RISC) (Prince-Embury, 2013).
Relation between Resilience and Self-regulation as a Variable of Adaptation and Psychosocial Protection
As we have noted, low academic achievement is among the causes that can lead a person to be at risk of social exclusion: it is a problem, because low performing students lack the basic educational qualification necessary to enter the labor market. Moreover, specifically concerning performance, Zimmerman (1990) earliest research drew our attention to the importance of self-regulation as a major factor in academic achievement. More recent research on resilience proposes the self-regulation capacity as a protective factor in this respect (Benard, 2004).
Since the pioneering work by Bandura (1991), Kanfer (1970) and others, behavioral self-regulation has become a central topic of study in general psychology and specifically in educational psychology (Zimmerman, 2008; Zimmerman and Schunk, 2011; Duckworth and Carlson, 2013; de la Fuente, 2015). Like resilience, self-regulation is an umbrella construct that incorporates many competencies (Anderman, 2011; de la Fuente et al., 2015)—self-direction, adaptability, self-management, problem-solving, critical thinking, communication and social skills—since it is a process in which the individual adopts an active role in constructing his or her destiny (requiring will and skills). Through activation, monitoring, inhibiting, preserving and adapting one's behavior, emotions, motivations, cognitive and metacognitive strategies and external resources, the person seeks to reach his/her desired objectives (Limon, 2004; Pintrich, 2004).
Self-regulation is a process that implies behavior management in three important phases (Zimmerman and Labuhn, 2012): (a) forethought and planning phase, including aspects of task analysis and setting specific task-related goals; (b) performance monitoring phase, including use of strategies and resources on the task, as well continuous examination of their effectiveness and of one's progress toward the goals established; (c) reflection on performance phase, which is evaluation of what one has done or what can be improved, managing emotions that are triggered by the results, and then using self-reflection to begin the cycle anew. This process is modulated by many variables, outstanding among which are control and self-efficacy (Torrano and González-Torres, 2004; Gardner et al., 2008; Zimmerman, 2008).
Self-regulation is a central concern in studies that examine the skills needed for students to be well prepared and successful in Twenty-first century society (Wolters, 2010; Anderman, 2011; Zimmerman and Schunk, 2011; Schleicher, 2015). de la Fuente (2015) has defined it as a behavioral meta-skill, since it makes since it makes a cross-cutting contribution in the management of several behavioral skills, especially in stressful situations.
In specialized literature in the field of resilience, self-control is considered to be a key aspect, and knowledge of strategies to improve personal self-regulation is valued (Vanistendael and Lecomte, 2006; Moilanen, 2007; Swanson et al., 2011). A large number of researchers have published work that relates self-regulation to resilience and vice versa (Nota et al., 2004; Tugade and Fredrickson, 2004; Dishion and Connell, 2006; Lerner et al., 2013). Eisenberg and Spinrad (2004) studied this relationship, indicating that self-regulation acts as a predictive factor of resilience, belonging to the individual (internal) protective factors. Similarly, Hofmann et al. (2013), Duckworth and Seligman (2005) and Mischel (2014) state that self-control (control of thoughts, emotions, impulses and behavior) encourages positive adaptation, and makes it easier to attain a happy and healthy life.
It is common for resilience scales to include self-regulation and other variables associated with it (Oshio et al., 2003; Hjemdal et al., 2006; Prince-Embury, 2008; LeBuffe et al., 2009). Studies by Buckner et al. (2003, 2009) using a single resilience instrument show that the variance in resilience explained by self-regulation may be as high as 46%. Many factors contribute to student failure and dropping out of school, but many children manage to overcome these barriers and become well-adjusted individuals (Norris, 2014).
The Aims and Hypothesis
To understand any possible relation between resilience and self-regulation, we try to corroborate if self-regulation acts as a protective variable in the resilience of youths who join IVQPs. The objectives and hypotheses of this study are:
(1) To examine any relationships of association between scores in resilience and in self-regulation. A consistent correlation is assumed between the total score on both constructs and between their factors, as has been substantiated in earlier research. Additionally, we seek to identify which factor within self-regulation shows the greatest statistical significance in the association and prediction of resilience variable. As hypotheses, it is expected that Self-regulation factors (goals, perseverance, decisión-making and learning from mistakes) will have the greatest associative and predictive strength with factors from the resilience scale used in this study.
(2) To determine the interdependent relationship between levels of self-regulation and resilience. Our hypothesis is that a higher-medium-low level of self-regulation behavior will be accompanied by the same in the total resilience score and its components.
Methods
Participants
The sample consisted of 365 students from 27 schools that offer IVQPs in Navarre (Spain). Every school which imparted this type of academic training was contacted. In such programs the maximum number of students per class is 12, which means that the number of students studied in our research was reduced. Of this sample, 71.2% were male and 28.8% were female. Age distribution was as follows: 14–15 years old (19.7%), 16–17 (69.9%), 18–19 (8.5%), and 20–21 (1.9%). Regarding the schools, 61.1% of the students were enrolled in public schools, 20.5% in schools run by non-profit agencies and 18.4% in partly-subsidized private schools. The schools were spread geographically throughout Navarre (Spain). There were two IVQP modalities; 55.3% of students were enrolled in the Vocational Workshop and 44.7% were in the Basic Program. The sample is considered to be highly representative, since participation was obtained from nearly 85% of the total youth population enrolled in IVQPs during the 2011/2012 school year. The sample specific data are shown in Table 1.
Instruments
(1) The Connor-Davidson Resilience Scale (CD-RISC) in its Spanish validated version (Bobes et al., 2001-2008) was used to assess resilience. The CD-RISC scale includes a total of 25 items in its original version, grouped into 5 subscales or dimensions that measure the ability to cope with adversity. The items are scored on a scale from 0 (not true at all) to 4 (true nearly all the time). Yu and Zhang (2007) suggest that this 5-factor structure would have broad applications in psychiatric and psychological interventions and even in educational practices to nurture children with high resilience. There are few studies that have replicated the 5-factor structure (Campbell-Sills and Stein, 2007; Yu and Zhang, 2007; Yu et al., 2011; Serrano-Parra et al., 2012).
We analyzed the internal structure of the scale. For this reason, a confirmatory factor analysis (CFA) by AMOS was conducted on the whole set of data from our sample. The default model shows a good fit (Chi-Square = 100,856, df = 80, p < 0.05; CFI = 0.963, TLI = 0.957, IFI = 0.968, RFI = 0.921 y NFI = 0.964; RMSEA = 0.027). The model proposed for this version of the scale contains 15 items with a structure of 5 factors, but different from the original version. The reformulated names of the resulting factors were: Coping and Confidence (Factor 1), Tenacity and Adaptation to Change (Factor 2), Perception of Control, and Achievement (Factor 3; in the original scale named “Control,” implied one's control over achieving one's own goal and getting assistance from others), Perception of Support (Factor 4) and Tolerance of Negative Situations (Factor 5). See Figure 1.
The reliability coefficient of this version of the CD-RISC has Internal consistency alpha values acceptable for the total questionnaire items (α = 0.751), and an acceptable Guttman split half coefficient (α = 0.703).
(2) The Short Self-Regulation Questionnaire (SSRQ) (Carey et al., 2004). The authors also recommend studies that analyze its factorial structure on diverse samples (Neal and Carey, 2005). This original scale has 21 items and two dimensions with Likert response choices ranging from 1 (strongly disagree) to 5 (strongly agree). Pichardo et al. (2014) validated a short version of the scale from Brown et al. (1999) in university students, finding evidence for four factors of self-regulation: goal setting, perseverance, decision making, and learning from mistakes. We also studied the internal structure of the scale in this sample through a CFA. A scale with a solution of 19 items and four factors was similar to that found in the study of Pichardo et al. (2014): factor 1 (Goals), factor 2 (Perseverance), Factor 3 (Learning from mistakes), and Factor 4 (Decision making). This new model proposed presented a good fit (Chi-Square = 242,670, df = 150, p < 0.001, CFI = 0.929, TLI = 0.919, IFI = 0.930, RMSEA = 0.041; HOELTER = 0.290, p < 0.01). Internal consistency is acceptable for the total questionnaire items (α = 0.725) and Guttman split halves (α = 0.707). See Figure 2.
Figure 1. Confirmatory factorial analysis of CD-RISC scale (n = 365). For the items, see Annex in Supplementary Meterial.
Figure 2. Confirmatory structural analysis of SSRQ (n = 365). For the items, see Annex II in Supplementary Meterial.
Procedure
To initiate the research study, contact was made with all the schools and entities in Navarre that offered IVQPs in the academic year 2012-2013. Interviews were held with all the schools that agreed to participate in the research (27 of the 31 schools). A pilot study was carried out with 9 pupils to verify their understanding of each of the items on the tests and to examine the order in which they should be administered. Testing days were scheduled by telephone (first the SSRQ and then the CD-RISC, leaving a few weeks in between the two) and personal visits were made in order to apply the tests. All students were informed of the research objective and participation was voluntary. Data collection was then followed by tabulation and analysis. In all cases, there was compliance with the rules of the organizational Ethics Committees and the School Councils. The data processing was carried out according to Spanish legislation on protection of privacy.
Data Analysis
In accordance with our proposed objectives, we first carried out a structural analysis (association and prediction analysis). Finally, inferential analyses were carried out using univariate and multivariate analysis of variance (in order to determine the degree of interdependence between self-regulation, as the predicting variable and resilience, as the criterion variable). In order to classify the students into low-medium-high a prior cluster analysis was performed and the linear causal relationship between both constructs was studied, yielding mean scores for the groups at 2.81, 3.37, and 4.01, respectively. All statistical analyses were performed using statistical software from SPSS v.22 and AMOS v. 22.
Results
Association Structural Results
Statistically significant correlations were found between factors of resilience (CD-RISC) and self-regulation (SSRQ). The new model proposed presented a good fit. The default model is significant (Chi-square = 675,419, df = 505, p < 0.001; CFI = 0.918; TLI = 0.909, IFI = 0.920, RFI = 0.916 y NFI = 0.944; RMSEA = 0.030).
Self-regulation factors F1 (goals) and F3 (learning from mistakes) have the greatest associative strength with factors from resilience scale. By contrast, factors F2 (perseverance) and F4 (decisión-making) have no direct, significant relationship with any factor on this scale. See Figure 3.
Figure 3. Association relations between resilience and self-regulation factors. Self-regulation: F1, Goals; F2, Perseverance; F3, Learning from mistakes; F4, Decision making. Resilience: F5, Coping and confidence; F6, Tenacity and adaptation; F7, Perception of control and achievement; F8, Perception of support; F9, Tolerance of Negative Situations. For the items, see Annexes I and II in Supplementary Meterial.
Predictive Structural Results
The structural equation model used showed statistically significant relations between resilience factors (CD-RISC) and the self-regulation factors (SSRQ). The new default model is significant and presented a good fit (Chi-square = 634, 253, df = 454, p < 0.001; CFI = 0.910; TLI = 0.908, IFI = 0.910, RFI = 0.916 y NFI = 0.944; RMSEA = 0.030; HOELTER = 303, p < 0.01). As seen in the model, the self-regulation factor with the greatest predictive power over resilience is F3 (learning from mistakes), given that it significantly predicts factors F5 (coping and confidence), F6 (tenacity), and F9 (tolerance of negative situations). This factor in turn is significantly predicted by the other three self-regulation factors (F1, F2, F4). Finally, the prediction relationship between self-regulation factors F2 (Perseverance) and F4 (Decision making) and three of the resilience factors (F5, F6, and F9) is found to occur through factor F3 (Learning from mistakes). See Figure 4.
Figure 4. Structural model of relations between resilience and self-regulation. Self-regulation: F1, Goals; F2, Perseverance; F3, Learning from mistakes; F4, Decision making. Resilience: F5, Coping and confidence; F6, Tenacity and adaptation; F7, Perception of control and achievement; F8, Perception of support; F9, Tolerance of Negative Situations. For the items, see Annexes I and II in Supplementary Meterial.
Inferential Non-lineal Results
The ANOVA between mean total self-regulation (IV) and resilience (DV) revealed a statistically significant main effect of the first on the second variable [F(2, 362) = 24,633, p < 0.001, n2 = 0.120], producing significant differences in the level of resilience according to the low-mid-high levels established for self-regulation (1 < 2 < 3, p < 0.001), where three homogeneous, independent subsets were obtained (Sheffé index). The MANOVA that was performed between self-regulation and the factors that make up resilience again revealed the main effect of self-regulation on the set of resilience factors [F(2, 362) = 21.794, p < 0.001, n2 = 106.]. The factors where self-regulation produced the greatest effect were Coping and Confidence [F(2, 362) = 21,794, p < 0.001, n2 = 0.107] and Tenacity and Adaptation to Change [F(2, 362) = 12,803, p < 0.001, n2 = 0.066], with statistical significant differences among the levels 1 < 2 < 3, p < 0.01, in both cases. The least effect was seen on the tolerance of negative situations factor [F(2, 362) = 4,722, p < 0.05, n2 = 0.025], with differences only between the extreme groups (3 > 1, p < 0.05). There are no differences in the perception of support factor. See Table 2.
Discussion
In the studies that have been carried out over the years about social exclusion, one of the main risk factors is dropping out of education. Students who fail at school and do not get a basic qualification might suffer social exclusion due to their difficulties in gaining access to the labor market. This research is expected to contribute to our knowledge of certain aspects of social exclusion, and to help prevent dropouts. One of the variables chosen was self-regulation since, according to the research, it has been associated with a good (or high) performance (Nota et al., 2004). Over the past decades, several research studies have pointed out the importance of studying protective factors and attributes that define the resilient personality. Self-regulation occupies a central place among these (Eisenberg and Spinrad, 2004; Novoa, 2014).
Also, according to Nota et al. (2004) there is an important relationship between self-regulation, resilience and academic achievement. The present investigation is a relevant contribution to this line of current research—within the realm of preventive, educational psychology—focusing on analysis of psychological constructs that are important for bearing adversity in everyday life, and for mental health education (Henderson and Milstein, 2003).
Levels and Relationships between Resilience and Self-regulation
The first objective and hypothesis, referring to associations between the two constructs and predictive structural analysis, was partly achieved: there were positive, statistically significant correlations between some of the factors on the two scales. Most notably, the factors goals and learning from mistakes were significantly related to resilience factors.
Among the different factors that influence resilience, self-regulation was confirmed as important, but there are other personal variables that also play their part (Gardner et al., 2008; Buckner et al., 2009). Self-regulation models indicate the importance of the planning and goal-setting phase in the process of self-regulating one's behavior (Zimmerman, 2008). However, our research shows that, although the goals factor is essential for developing resilience, its predictive value is indirect and takes place through the learning from mistakes factor, as mentioned above. Thus, for this sample of young people, this is the factor that best predicts the three factors of resilience: coping and confidence, tenacity, and adaptation to change, and tolerance of negative situations. This result has interesting practical implications indicating that, in order to improve resilience through self-regulation in students in socially at-risk situations, it is very important to work on goal-setting and above all, learning from mistakes. Both aspects are essential to learning, as recently noted in the document “Top 20 principles from psychology for pre K–12 teaching and learning” published by American Psychological Association (2015). Directing and modifying behavior when mistakes are detected is the essential element of metacognition that is at the center of self-regulated behavior. Our data indicate persevering in the search for solutions predicts tenacity (resilience). Along these lines, Dweck et al. (2011) in their paper Academic tenacity, indicate that in order to enhance it, it is important to instill a growth mindset about intelligence where failures and mistakes are seen as natural part of the learning process.
The second objective and hypothesis, concerning interdependent non-linear relations between levels on the two scales, has been validated consistently. The results conclusively establish that low-mid-high levels of self-regulation are accompanied by comparable differences in three levels of resilience and independent groups are established with statistically significant differences between them. This evidence demonstrates a consistent relationship between the two constructs, as corroborated by other studies (Eisenberg and Spinrad, 2004; Dishion and Connell, 2006).
Limitations
Certain limitations must be kept in mind. For one, though our sample is broad and representative of the population of young people who are enrolled in IVQP, it is not uniform in age, gender and cultural background.
Conclusions, Implications, and Prospects for Research
Findings from this research show progress in our understanding of resilient and self-regulatory behavior in adolescent students at risk, and provides empirical support for the theoretical relations of association and interdependence between the two constructs. Moreover, we offer data on concurrent validation of two standardized assessment instruments that address these constructs.
Additionally, these results offer empirical support for the theory regarding relations between resilience and self-regulation (Lee et al., 2012). Moreover, although these results provide data on the convergent validity of the two instruments used, certain factors on the scales that did not present the expected relationships must be examined more closely. The present investigation makes contributions that will help us to advance in the development of valid and reliable measures that are necessary to progress in the theoretical and applied aspects of this field (Windle et al., 2011).
As to implications for education, the findings from this research can help us to better understand how to nurture a resilient mindset (Goldstein and Brooks, 2013) in young people enrolled in IVQPs, to achieve better adaptation and avoid social exclusion. These results may also serve as a guide about how to help these students both inside and outside the classroom, such as creating supportive “ecological niches” (Henderson and Milstein, 2003) that encourage their sense of self-efficacy and their problem-solving ability.
In this sense it would be beneficial to work on certain essential aspects of behavior self-regulation. Particularly, setting realistic goals and learning from mistake. It is the case in proven effectiveness prevention and intervention programs, such as the PENN Resilience Program (PRP) (Reivich et al., 2013), or the Resilience Builder Program for Children and Adolescents. Enhancing Social Competence and Self-Regulation (Karapetian et al., 2011), the PATHS Project (Promoting Alternative Thinking Strategies), I Can Problem Solve (ICPS) (Shure, 2001) or in Spain, the Scholastic and social well-being program: a promotion program for adolescents (López-Sánchez et al., 2007). On this point -and as we underlined in the second and third stage of the research-, self-regulation has been an important variable which is considered as a protective factor or element in a risk situation, and has been included in resilience programmes. We emphasize that by working on self-regulation skills with students at risk, we will encourage their resilient capacity. Then, they will not give up when they have to deal with difficulties (Masten and Obradovic, 2006) and they will be able to improve their academic achievement necessary to get access to the job market, and will not suffer social exclusion. Consequently, we consider the research presented here to be valuable in helping us to understand the characteristics of students at risk that enroll in the IVQPs. These results show the importance of working on student strengths that go beyond the academic or technical areas and which can help them cope positively with the adverse situations in which they live, so that they can build an optimistic life plan, based on competencies of resilience such as self-regulation.
Author Contributions
RA: substantially contributed to the conception and the design of the work. MG: manuscript preparation; ML and MF contributed to the acquisition of data JD: study design, statistical analysis; RA prepared the draft and MG and MV reviewed it critically and gave important intellectual content RA, MG and JD: worked for the final approval of the version to be published.
Funding
Motivational-affective strategies of personal self-regulation and coping with stress in the university teaching-learning process. Ref. EDU2011-24805 (2012-2015). Ministry of Economy and Competitiveness (Spain) and FEDER Found (EU).
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Supplementary Material
The Supplementary Material for this article can be found online at: http://journal.frontiersin.org/article/10.3389/fpsyg.2017.00612/full#supplementary-material
References
American Psychological Association (2015). Coalition for Psychology in Schools and Education, Top 20 Principles from Psychology for preK–12 Teaching and Learning. Available online at: http://www.apa.org/ed/schools/cpse/top-twenty-principles.pdf (Accessed May 5, 2015).
Anderman, E. M. (2011). “The teaching and learning of twenty-first century skills,” in Paper Presented for the National Research Council Board on Testing and Assessment's Workshop on Assessment of 21st Century Skills (Irvine, CA).
Artuch, R. (2014). Resiliencia y Autorregulación en Jóvenes Navarros, en Riesgo de Exclusion Social, que Acuden a Programas de Cualificación Inicial Formal [Resilience and Self-Regulation in Young Navarre, at Risk of Social Exclusion, Who Attend Formal Initial Qualification Programs]. Dissertation thesis. Available online at: http://dadun.unav.edu/bitstream/10171/36188/4/TesisRaquelArtuch.pdf (Accessed December 15, 2016).
Bandura, A. (1991). Social cognitive theory of self-regulation. Org. Behav. Hum. Dec. Process. 50, 248–281. doi: 10.1016/0749-5978(91)90022-L
Bassett, M., and Walsh, K. (2011). 2010 European Year for Combating Poverty and Social Exclusion. Dublín: Social Inclusion Division.
Becoña, E. (2006). Resiliencia: definición, características y utilidad del término. [Resilience: definition, characteristics and usefulness of the term.] Rev. Psicopatol. Psicol. Clín. 11, 125–146. doi: 10.5944/rppc.vol.11.num.3.2006.4024
Bobes, J., Bascarán, M. T., García-Portilla, M. P., Bousoño, M., Saiz, P. A., Wallace, D. H., et al. (2001-2008). Escala de Adaptación de Connor-Davidson, CD-RISC]. Adaptation of the Connor-Davidson Scale, CD-RISC. Available online at: http://www.cd-risc.com/
Brown, J. M., Miller, W. R., and Lawendowski, L. A. (1999). “The self-regulation questionnaire,” in Innovations in Clinical Practice: A Sourcebook, eds L. VandeCreek, and T. L. Jackson (Sarasota, FL: Professional Resource Press), 281–292.
Buckner, J. C., Mezzacappa, E., and Beardslee, W. R. (2003). Characteristics of resilient youths living in poverty: the role of self-regulatory processes. Dev. Psychopathol. 15, 139–162. doi: 10.1017/S0954579403000087
Buckner, J. C., Mezzacappa, E., and Beardslee, W. R. (2009). Self-regulation and its relations to adaptive functioning in low income youths. Am. J. Orthopsychiatry 79, 19–30. doi: 10.1037/a0014796
Campbell-Sills, L., and Stein, M. (2007). Psychometric analysis and refinement of the connor–davidson resilience scale (CD-RISC): validation of a 10-item measure of resilience. J. Trauma. Stress 20, 1019–1028. doi: 10.1002/jts.20271
Carey, K. B., Neal, D. J., and Collins, S. E. (2004). A psychometric analysis of the self-regulation questionnaire. Addict. Behav. 29, 253–260. doi: 10.1016/j.addbeh.2003.08.001
Catalano, R. F., Berglund, M. L., Ryan, J. A. M., Lonczak, H. S., and Hawkins, D. (2004). Positive youth development in the United States: research Findings on evaluations of positive youth development programs. Ann. Am. Acad. Polit. Soc. Sci. 591, 98–124. doi: 10.1177/0002716203260102
Cicchetti, D., and Curtis, W. J. (2006). “The developing brain and neural plasticity: implications for normality, psychopathology, and resilience,” in Developmental Psychopathology, eds D. Cicchetti and D. Cohen (Hoboken, NJ; New York, NY: Wiley), 1–64.
de la Fuente, J. (2015). Competence for Studying, Learning and Performance under Stress: Self-help Guide for University Students, Graduates and Professional Examination Candidades. Education and Psychology I+D+I, e-Publishing Series I+D+I©. Available online at: http://www.mitienda.investigacion-psicopedagogica.org/english/seccion.php?idsec=14&idcat=1
de la Fuente, J., Zapata, L., Martínez-Vicente, J. M., Sander, P., and Cardelle-Elawar, M. (2015). The role of personal self-regulation and regulatory teaching to predict motivational-affective variables, achievement, and satisfaction: a structural model. Front. Psychol. 6:399. doi: 10.3389/fpsyg.2015.00399
Devicienti, F., and Poggi, A. (2011). Poverty and social exclusion: two sides of the same coin or dynamically interrelated processes? Appl. Econ. 43, 3549–3571. doi: 10.1080/00036841003670721
Dishion, T. J., and Connell, A. (2006). “Adolescents' resilience as a self-regulatory process: promising themes for linking intervention with developmental science,” in Resilience in Children, eds B. M. Lester, A. Masten, and B. McEwen (Boston, MA: New York Academy of Sciences), 125–138.
Doll, B., Brehm, K., and Zucker, K. (2014). Resilient Classrooms. Creating Healthy Environments for Learning, 2nd Edn. New York, NY: Guilford Press.
Duckworth, A. L., and Carlson, S. M. (2013). “Self-regulation and school success,” in Self-Regulation and Autonomy: Social and Developmental Dimensions of Human Conduct, eds B. W. Sokol, F. M. E. Grouzet, and U. Müller (New York, NY: Cambridge University Press), 208–230.
Duckworth, A. L., and Seligman, M. E. P. (2005). Discipline outdoes IQ in predicting academic performance of adolescents. Psychol. Sci. 16, 939–944. doi: 10.1111/j.1467-9280.2005.01641.x
Dweck, C. S., Walton, G. M., and Cohen, G. L. (2011). Academic Tenacity. Mindsets and Skills that Promote Long-Term Learning. Seattle, WA: White paper prepared for the Gates Foundation.
Eisenberg, N., and Spinrad, T. L. (2004). Emotion-related regulation: sharpening the definition. Child Dev. 75, 334–339. doi: 10.1111/j.1467-8624.2004.00674.x
Eurostat (2013). Children Were the Age Group at the Highest Risk of Poverty or Social Exclusion in 2011. Population and Social Conditions. Luxemburgo: Publications Office of the European Union.
Eurostat (2015). Smarter, Greener, More Inclusive? Indicators to Support the Europe 2020 Strategy. Luxemburgo: Publications Office of the European Union.
Fergus, S., and Zimmerman, M. A. (2005). Adolescent resilience: a framework for understanding healthy development in the face of risk. Annu. Rev. Public Health 26, 399–419. doi: 10.1146/annurev.publhealth.26.021304.144357
García-Vesga, M. C., and Domínguez-de la Ossa, E. (2013). Desarrollo teórico de la Resiliencia y su aplicación en situaciones adversas: Una revisión analítica. [Technical development of resilience and its application in adverse situations: an analytical review.] Rev. Latinoam. Ciencias Soc. 11, 63–77. doi: 10.11600/1692715x.1113300812
Gardner, T. W., Dishion, T. J., and Connell, A. (2008). Adolescent self-regulation as resilience: resistance to antisocial behavior within the deviant peer context. Abnorm. Child Psychol. 36, 273–284. doi: 10.1007/s10802-007-9176-6
Goldstein, S., and Brooks, R. B. (2013). Handbook of Resilience in Children. New York, NY: Springer.
González-Torres, M. C., and Artuch, R. (2014). Resilience and coping strategy profiles at university: contextual and demographic Variables. Electron. J. Res. Educ. Psychol. 12, 621–648. doi: 10.14204/ejrep.34.14032
Grotberg, E. (1995). A Guide to Promoting Resilience in Children: Strengthening the Human Spirit. The Hague: Bernard Van Leer Foundation.
Henderson, N., and Milstein, M. (2003). Resiliencia en la Escuela. [Resilience at School] Buenos Aires: Paidós.
Hjemdal, O., Friborg, O., Stiles, T. C., Martinussen, M., and Rosenvinge, J. H. (2006). A new scale for adolescent resilience: grasping the central protective resources behind healthy development. Meas. Eval. Couns. Dev. 39, 84–96.
Hofmann, W., Luhmann, M., Fisher, R. R., Vohs, K. D., and Baumeister, R. F. (2013). Yes, but are they happy? Effects of trait self-control on affective well-being and life satisfaction. J. Pers. 81, 1–13. doi: 10.1111/jopy.12050
Jahnukainen, M. (2014). Education in the prevention of social exclusion. Rev. Disabil. Stud. Int. J. 1, 1–7.
Kanfer, F. H. (1970). “Self-regulation: research, issues, and speculation,” in Behavior Modification in Clinical Psychology, eds C. Neuringer and J. L. Michael (New York, NY: Appleton-Century-Crofts), 171–220.
Karapetian, M., Zucker, B., and Johnson, J. (2011). Resilience Builder Program for Children and Adolescents. Enhancing Social Competence and Self-Regulation. Illinois: Seaway Printing Co.
Kotliarenco, M. A., Cáceres, I., and Fontecilla, M. (1997). Estado de Arte en Resiliencia. [State of the Art in Resilience]. Santiago: CEANIM.
LeBuffe, P. A., Shapiro, V. B., and Naglieri, J. A. (2009). The Devereux Student Strengths Assessment (DESSA). Lewisville, North Carolina: Kaplan.
Lee, T. Y., Cheung, C. K., and Kwong, W. M. (2012). Resilience as a positive youth development construct: a conceptual review. Sci. World J. 2012:390450. doi: 10.1100/2012/390450
Lerner, R. M., Agans, J. P., Arbeit, M. R., Chase, P. A., Weiner, M. B., Schmid, C. L., et al. (2013). “Resilience and Positive Youth Development: a relational developmental systems model,” in Handbook of Resilience in Children, eds S. Goldstein and R. B. Brooks (New York, NY: Springer), 293–308.
Lerner, R. M., Lerner, J. V., and Benson, J. B. (2011). “Positive Youth Development: research and applications for promoting thriving in adolescence,” in Advances in Child Development and Behavior, eds R. M. Lerner, J. V. Lerner, and J. B. Benson (West Lafayette, IN: Elsevier Inc.), 1–17.
Limon, M. (2004). A tribute to P.R. Pintrich: contribution to psychology and education. Electr. J. Res. Educ. Psychol. 2, 159–210.
López-Sánchez, F., Carpintero, E., Campo, A., Lázaro, S., and Soriano, S. (2007). “Bienestar personal y social: un programa de promoción para adolescentes. [A program for promoting personal and social well-being in adolescents],” in Dificultades de Desarrollo. Evaluación e Intervención, ed J. N. García (Madrid: Pirámide), 15–224.
Luthar, S. S., Sawyer, J. A., and Brown, J. P. (2006). Conceptual issues in studies of resilience. Past, present, and future research. Ann. N.Y. Acad. Sci. 1094, 105–115. doi: 10.1196/annals.1376.009
MacConville, R., and Rae, T. (2012). Building Happiness, Resilience and Motivation in Adolescents: A Positive Psychology Curriculum for Well-being. London: Jessica Kingsley Publishers.
Masten, A. S. (2004). Regulatory processes, risk and resilience in adolescent development. Ann. N.Y. Acad. Sci. 1021, 310–319. doi: 10.1196/annals.1308.036
Masten, A. S., and Obradovic, J. (2006). Competence and resilience in development. Ann. N.Y. Acad. Sci. 1094, 13–27. doi: 10.1196/annals.1376.003
Moilanen, K. L. (2007). The adolescent self-regulatory inventory: the development and validation of a questionnaire of short term and long-term self regulation. J. Youth Adolesc. 36, 835–848. doi: 10.1007/s10964-006-9107-9
Naglieri, J. A., LeBuffe, P. A., and Ross, K. M. (2013). “Measuring resilience in children: from theory to practice,” in Handbook of Resilience in Children, eds S. Goldstein and R. B. Brooks (New York, NY: Springer), 241–260.
Neal, D. J., and Carey, K. B. (2005). A follow-up psychometric analysis of the self-regulation questionnaire. Psychol. Addic. Behav. 19, 414–422. doi: 10.1037/0893-164X.19.4.414
Norris, M. D (2014). At Risk Students and Resiliency. Electronic Theses Projects, and Dissertations. Paper 62. Available online at: http://scholarworks.lib.csusb.edu/cgi/viewcontent.cgi?article=1102&context=etd. Retrieved May 10, 2016
Nota, L., Soresi, S., and Zimmerman, B. J. (2004). Self-regulation and academic achievement and resilience: a longitudinal study. Int. J. Educ. Res. 41, 198–215. doi: 10.1016/j.ijer.2005.07.001
Novoa, C. M. (2014). Educational Resilience in Children from Immigrant Families: The Protective Role of Culture and Self-Regulation. Dissertation/master's thesis, Washington, DC: Georgetown University.
O'Dougherty, M., Masten, A., and Narayan, A. (2013). “Resilience processes in development: four waves of research on positive adaptation in the context of adversity,” in Handbook of Resilience in Children, eds S. Goldstein and R. B. Brooks (New York, NY: Springer), 15–37.
Oshio, A., Kaneko, H., Nagamine, S., and Nakaya, M. (2003). Construct validity of the adolescent resilience scale. Psychol. Rep. 93, 1217–1222. doi: 10.2466/pr0.2003.93.3f.1217
Paterson, C., Tyler, C., and Lexmond, J. (2014). Character and Resilience Manifesto. The All-Party Parliamentary Group (APPG) on Social Mobility. Available online at: http://www.centreforum.org/assets/pubs/character-and-resilience.pdf
Pearce, C. (2011). A Short Introduction to Promoting Resilience in Children. London: Jessica Kingsley Publishers.
Pérez de Armiño, K., and Eizagirre, M. (2005). Exclusión Social. Diccionario de Acción Humanitaria y Cooperación al Desarrollo [Social Exclusion. Dictionary of Humanitarian Action and Development Cooperation]. Barcelona: ICARIA HEGOA.
Peterson, C., and Seligman, M. E. P. (2004). Character Strengths and Virtues: A Handbook and Classification. Washington, DC: American Psychological Association; Oxford University Press.
Pichardo, M. C., Justicia, F., de la Fuente, J., Martínez-Vicente, J. M., and Berbén, A. B. G. (2014). Factorial Analysis of the Self-Regulation Questionaire (SRQ) at Spanish Universities. Span. J. Psychol. 17, E62. doi: 10.1017/sjp.2014.63
Pintrich, P. R. (2004). A conceptual framework for assessing motivation and self-regulated learning in college students. Educ. Psychol. Rev. 16, 385–407. doi: 10.1007/s10648-004-0006-x
Prince-Embury, S. (2008). Resiliency Scales for Children and Adolescents (RSCA). San Antonio, TX: Pearson.
Prince-Embury, S. (2013). “Translating Resilience theory for assessment and application with children, adolescents and adults: conceptual issues,” in Resilience in Children, Adolescents and Adults: Translating Research into Practice, eds S. Prince-Embury and D. H. Saklosfke (New York, NY: Springer), 9–16.
Prince-Embury, S., and Saklosfke, D. H. (2013). Resilience in Children, Adolescents and Adults: Translating Research into Practice. New York, NY: Springer.
Reivich, K., Gillham, J. E., Chaplin, T. M., and Seligman, M. E. P. (2013). “From helplessness to optimism: the role of resilience in treating and preventing depression in youth,” in Handbook of Resilience in Children, 2nd Edn., eds S. Goldstein and R. B. Brooks (New York, NY: Springer), 201–214.
Repper, J., and Perkins, R. (2003). Social Inclusion and Recovery: A Model for Mental Health Practice. London: Bailliere Tindall.
Rew, L., and Horner, S. (2003). Youth resilience framework for reducing health-risk behaviors in adolescents. J. Pediatr. Nurs. 18, 379–388. doi: 10.1016/S0882-5963(03)00162-3
Rutter, M. (2005). Environmentally mediated risks for psychopathology: research strategies and findings. J. Am. Acad. Child Adolesc. Psychiatry 44, 3–18. doi: 10.1097/01.chi.0000145374.45992.c9
Rutter, M. (2006). “Implication of resilience concepts for scientific understanding,” in Resilience in Children, eds B. M. Lester, A. S. Masten and B. McEwen (Boston, MA: Blackwell), 1–12.
Rutter, M. (2007). Resilience, competence, and coping. Child Abuse Neglect 31, 205–209. doi: 10.1016/j.chiabu.2007.02.001
Schleicher, A. (2015). Schools for 21st Century Learners: Strong Leaders, Confident Teachers, Innovative Approaches. Paris: OEDC Publishing. doi: 10.1787/9789264231191-en
Serrano-Parra, M. D., Garrido-Abejar, M., Notario-Pacheco, B., Bartolomé-Gutierrez, R., Solera-Martínez, M., and Martínez-Vizcaino, V. (2012). Validez de la escala de Resiliencia de Connor-Davidson (CD-RISC) en una población de mayores entre 60 y 75 años. Int. J. Psychol. Res. 5, 49–57. doi: 10.21500/20112084.736
Shure, M. B. (2001). ICPS-I Can Problem Solve: An Interpersonal Cognitive Problem-Solving Program (Kindergarten and Primary), 2nd Edn. Champaign, IL: Research Press.
Suria, R. (2016). Relationships between self-concept and resilience profiles in young people with disabilities. Electr. J. Res. Educ. Psychol. 14, 450–473. doi: 10.14204/ejrep.40.15150
Swanson, J., Valiente, C., Lemery-Chalfant, K., and O'Brien, T. C. (2011). Predicting early adolescents' academic achievement, social competence, and physical health from parenting, ego resilience, and engagement coping. J. Early Adolesc. 31, 548–576. doi: 10.1177/0272431610366249
Torrano, F., and González-Torres, M. C. (2004). Self-regulated learning: current and future directions. Electr. J. Res. Educ. Psychol. 2, 1–34.
Tugade, M. M., and Fredrickson, B. L. (2004). Resilient individuals use positive emotions to bounce back from negative emotional experiences. J. Pers. Soc. Psychol. 86, 320–333. doi: 10.1037/0022-3514.86.2.320
Vanistendael, S., and Lecomte, J. (2006). La felicidad es posible. Despertar en niños Maltratados la Confianza en sí Mismos: Construir la Resiliencia [Happiness is Possible. Birthing Self-Confidence in Abused Children: Building Resilience]. Barcelona: Gedisa.
Vargas, L., and González-Torres, M. C. (2009). The revitalization of character education in today's educational psychology arena: contributions from the sciences of prevention and positive psychology. Electr. J. Res. Educ. Psychol. 7, 1379–1418.
Wang, L. (2012). Social exclusion and education inequality: towards an integrated analytical framework for the urban–rural divide in China. Br. J. Sociol. Educ. 33, 409–430. doi: 10.1080/01425692.2012.659455
Windle, G., Bennet, G., and Noyes, K. M. (2011). A methodological review of resilience measurement scales. Health Qual. Life Outcomes 9, 1–18. doi: 10.1186/1477-7525-9-8
Wolters, C. A (2010). Self-Regulated Learning and the 21st Century Competencies. Availabe online at: http://www.hewlett.org/uploads/Self_Regulated_Learning__21st_Century_Competencies.pdf.
Yu, X., and Zhang, J. X. (2007). Factor analysis and Psychometric evaluation of the connor-davidson resilience scale (cd-risc) with chinese people. Soc. Behav. Pers. 35, 19–30. doi: 10.2224/sbp.2007.35.1.19
Yu, X. N., Lau, J. T., Mak, W. W., Zhang, J., and Lui, W. W. (2011). Factor structure and psychometric properties of the Connor-Davidson Resilience Scale among Chinese adolescents. Compr. Psychiatry 52, 218–224. doi: 10.1016/j.comppsych.2010.05.010
Zimmerman, B. J. (1990). Self regulated learning and academin achievement. Educ. Psychol. 25, 3–17. doi: 10.1207/s15326985ep2501_2
Zimmerman, B. J. (2008). Investigating self-regulation and motivation: historical background, methodological developments, and future prospects. Am. Educ. Res. J. 45, 166–183. doi: 10.3102/0002831207312909
Zimmerman, B. J., and Labuhn, A. S. (2012). “Self-regulation of learning: process approaches to personal development,” in APA Educational Psychology Handbook, Vol. 1: Theories, Constructs, and Critical Issues, eds B. J. Zimmerman and B. J. Labuhn (Washington, DC: American Psychological Association), 399–425.
Zimmerman, B. J., and Schunk, D. H. (2011). Handbook of Self-Regulation of Learning and Performance. New York, NY: Taylos and Francis.
Zolkoski, S. M., and Bullock, L. M. (2012). Resilience in children and youth: a review. Child. Youth Serv. Rev. 34, 2295–2303. doi: 10.1016/j.childyouth.2012.08.009
Keywords: resilience, self-regulation, positive youth development, at-risk youth, structural methodology
Citation: Artuch-Garde R, González-Torres MdC, de la Fuente J, Vera MM, Fernández-Cabezas M and López-García M (2017) Relationship between Resilience and Self-regulation: A Study of Spanish Youth at Risk of Social Exclusion. Front. Psychol. 8:612. doi: 10.3389/fpsyg.2017.00612
Received: 08 February 2017; Accepted: 03 April 2017;
Published: 20 April 2017.
Edited by:
Purificación Checa, University of Cádiz, SpainReviewed by:
Edgar Galindo, University of Évora, PortugalBarbara McCombs, University of Denver, USA
Copyright © 2017 Artuch-Garde, González-Torres, de la Fuente, Vera, Fernández-Cabezas and López-García. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Raquel Artuch-Garde, rartuchgarde@gmail.com