- 1Department of Philosophy, Sociology, Education and Applied Psychology, University of Padua, Padua, Italy
- 2Giustino Fortunato University, Benevento, Italy
- 3Department of Human Science (Communication, Training, Psychology), LUMSA University, Rome, Italy
Performance management is a key factor to enhance professional development and improve teaching quality. This process is successful only if teachers perceive it as fair, clear, and effective: namely, if it is satisfying. Carefully considering teachers’ attributions in the performance appraisal process is fundamental to better clarify the relations between performance management and positive individual outcomes. Therefore, this study aims to investigate the effects of perceived performance appraisal justice on teachers’ well-being, in terms of job performance, job satisfaction, and life satisfaction, hypothesizing the mediation role of performance appraisal satisfaction. Data from a sample of Italian teachers were analyzed through structural equation modeling. Results confirm the mediation role of performance appraisal satisfaction. In particular, perceived performance appraisal justice was positively associated to performance appraisal satisfaction, which, in turn, was positively associated with job performance, job satisfaction, life satisfaction. Consequently, performance appraisal satisfaction totally mediated the relations between performance appraisal justice and the outcomes considered. Findings are relevant for two reasons. First, they contribute to better understanding the performance management process in educational settings – an issue requiring further attention. Second, they contribute to highlighting the importance of performance management efficacy, which is essential not only to improve individual well-being but also to enhance teaching quality.
Introduction
Performance appraisal is one of the most important HR management tools and its efficient implementation is one of the greatest HR professionals’ challenges, particularly in terms of validity and reliability (Gupta and Kumar, 2013; Ivaldi et al., 2015). Performance appraisal identifies the individual’s contribution to the organizational goals and establishes individual performance standards (Ikramullah et al., 2012). It can become a real job resource (Farndale, 2017). Performance appraisal is a formal assessment of what employees have performed (Snape et al., 1998). Its ultimate purpose is to allow employees to continue to improve their job performance (Selvarajan et al., 2018) and teaching innovation (Benadusi and Giancola, 2016). Performance appraisal also has specific aims, such as accountability, professional development (Delvaux et al., 2013), and organizational growth (Rubel and Kee, 2015).
Many changes have influenced European educational systems since the ‘70s, in terms of greater school autonomy and human resources management responsibility (Benadusi and Giancola, 2016). An efficient performance appraisal system has important positive effects on teachers’ professional development. Moreover, teachers are essential for better education and future workers’ growth (Ripamonti et al., 2018; Tripathi et al., 2018). Teaching is a profession with a strong sense of meaning and charged with civic responsibility: the importance of its quality is evident. For example, it allows students to emancipate from their families, internalize norms and values, and be recognized for the goals achieved (Freddano, 2016). Therefore, performance appraisal is a fundamental tool to improve not only teaching quality but also school quality. It identifies teacher’s development and training needs, while boosting various outcomes (Obasi and Ohia, 2014). For example, Robinson et al. (2008) stated that teachers’ professional development indirectly affects students’ outcomes. Teachers’ performance appraisal is a delicate process. On the one hand, it greatly influences the well-being of teachers (Borrelli et al., 2014; Benevene et al., 2018b) who can experience anxiety and pressure due to the evaluation (Benevene and Fiorilli, 2015; Girardi et al., 2015, 2018; Falco et al., 2017; Cuevas et al., 2018). On the other, many difficulties may arise, such as lack of time, lack of confidence, or lack of training (Donaldson and Mavrogordato, 2018). Since well-being is conceptualized as a self-realization, as a social integration and as positive orientation toward the task, job satisfaction, life satisfaction and job performance are often used as its indicators (Alonso et al., 2019). Teachers’ performance appraisal aims to be an objective system evaluating teachers and teaching through a supervisors’ analysis. Principals can make use of other assessments – for example by considering colleagues and students’ opinions or the teachers’ self-evaluation (Bradford and Braaten, 2018). Thus, the process will not be top-down, but accomodating and participatory, and will be free to make use of scientific methodologies (such as action-research), to establish an example of good practice for the whole school community (Freddano, 2016).
This study focuses on individual perceptions of performance appraisal: although the entire process conveys contextual factors, considering its subjective elements is of utmost importance (Kim, 2016). Reactions, perceptions, and attributions teachers make about the judgments received – in terms of fairness and satisfaction – influence their outcomes. The paper aims to bring the following contributions, based on the little evidence on performance appraisal justice (Rubel and Kee, 2015). First, its mechanism of action – e.g., mediation effects (Gupta and Kumar, 2013) – is not clear. Therefore, we aim to investigate potential mediations in the relations between performance appraisal justice and its outcomes. Second, performance management literature highlights a gap in both organizational and individual performance appraisal positive outcomes (Van De Voorde et al., 2012). Finally, we aim to clarify the relations between performance appraisal perceptions – in terms of justice and satisfaction – and some well-being dimensions, namely job satisfaction, life satisfaction, and job performance.
This study considers positive dimensions and analyzes how to enhance well-being. We draw on positive psychology framework (Seligman and Csikszentmihalyi, 2000). This movement aims to clarify and promote optimal functioning, by amplifying strengths and encouraging global well-being (Shankland and Rosset, 2017). Traditionally, psychology has focused on disease. Positive psychology is not only a research topic; it looks to goodness, both in people and in contexts (Ciarrochi et al., 2016). Emotions and positive feelings lead people to broaden and build themselves (Fredrickson, 2001), whereas their lack – or the presence of negative states – leads to failures and unhappiness. Positive organizational interventions aim to take advantage of strengths and focus on the brighter side of situations (Ghosh and Deb, 2017). Performance appraisal, if perceived as fair, allows teachers to be more flexible and efficient, and to experience the vitality promoted by positive psychology. This process is possible if the organizational interventions follow some values. Among them, Ciarrochi et al. (2016) identified self-challenge and continuous learning. We can connect the enhancement promoted by positive psychology with an important theoretical framework, the conservations of resources (COR) theory (Hobfoll, 1989, 1998). COR theory states that people are motivated to gain, maintain and nurture resources. This resource enrichment positively influences people’s well-being, whereas resource loss leads them to distress. Resources are all organizational aspects that can stimulate personal growth, learning and development (Demerouti et al., 2001), so performance appraisal justice and performance appraisal satisfaction are part of them. Therefore, based on COR theory, we wonder whether fair and satisfying performance appraisal processes can originate and enhance positive outcomes.
Among performance appraisal attributions made by workers, fairness is very important, because it substantially directs several outcomes, such as psychological contract (Barbieri et al., 2018) and efficiency (Selvarajan et al., 2018). Clear, rational, and univocal criteria allow conclusion of an efficient performance appraisal (Longenecker, 1997). Moreover, a performance appraisal perceived like a criticism – rather than an instrument for professional development – can determine teachers’ attitudes of closure (Lucisano and Corsini, 2015). Fairness regarding performance appraisal is part of organizational justice, an overarching variable formed by various sub-dimensions: distributional justice, procedural justice, and interactional justice; with the latter having been split into interpersonal and informational justice (Greenberg, 1993). According to Colquitt et al. (2001), distributional justice depends on the comparison of efforts made, rewards received, and colleagues’ rewards. Procedural justice derives from the evaluation of the processes and policies used in performance appraisal. Interpersonal justice looks to perceived dignity and respect during the feedback. Informational justice regards the information obtained on process management. Performance management quality is positively associated with positive outcomes, such as commitment and intention to remain, and is negatively associated with negative outcomes, like job stress (Su and Baird, 2017; Falco et al., 2018). In particular, a performance appraisal perceived as partial – e.g., made by biased appraisers – can originate negative consequences for the teacher. Thus, performance appraisal justice is fundamental, because it leads to various positive outcomes, such as engagement (Gupta and Kumar, 2013; Farndale, 2017), motivation to improve job performance (Selvarajan et al., 2018), pay-for-performance effectiveness (Kim, 2016), organizational commitment (Guchait and Cho, 2010), perceived organizational support (Farndale, 2017), and decreased turnover intentions (Rubel and Kee, 2015).
Satisfaction with performance appraisal is another key dimension to analyze subjective responses to performance appraisal. It is a global evaluation of the performance appraisal received, and it involves perceptions regarding one’s participation to the evaluation process, the feedback received, and its consequences on rewards distribution. Satisfaction with performance appraisal concerns various facets, such as appraiser’s trust and feedback utility (Delvaux et al., 2013). It can influence attitudes and behaviors toward the organization (Hong, 2018). When performance appraisal is congruous with individual efforts, the process is satisfying (Gözükara et al., 2017). Performance appraisal satisfaction stimulates the acknowledgment and the use of the process itself; on the contrary, a lack of performance appraisal satisfaction causes negative consequences, such as intention to quit (Guchait and Cho, 2010), work-family conflict (Ismail and Gali, 2017), and strain (Van Thielen et al., 2018). Fairness perceived on performance appraisal is fundamental to its satisfaction (Naji et al., 2015): some evidence state that performance appraisal justice is an antecedent of performance appraisal satisfaction (Lira et al., 2016; Hong, 2018). Therefore, we hypothesize that:
H1: performance appraisal justice is positively associated with performance appraisal satisfaction.
The relation between performance appraisal justice and its possible outcomes deserves an in-depth analysis. For example, the recognition of the individual contribution – also achievable through a fair performance appraisal – contributes to organizational productivity, while inadequate performance management practices lead to great productivity losses (Bloom et al., 2014). The more the performance appraisal is unfair, the less the feedback will be useful to improve job performance (Naji et al., 2015). On the contrary, fair performance appraisal improves job performance (DeNisi and Pritchard, 2006; Gruman and Sacks, 2011). Job performance is considered as a behavior completely under the control of the individual, an act of doing a job and a means to reach a set of goals within a job (Campbell, 1990). The lack of openness, legitimation and integrity, and the perception of favoritisms and biased evaluations lead to a gap between ideal job performance and real job performance (Cunha et al., 2018): employees’ resources are depleted by these negative perceptions and are not allocated to job performance anymore (Falco et al., 2013b). It is important to shed light on the mechanism by which performance appraisal justice influences outcomes, with particular reference to mediated relations (Gruman and Sacks, 2011; Gupta and Kumar, 2013; Van Thielen et al., 2018). Considering job performance, Malik and Aslam (2013) pointed out that great performance appraisal satisfaction activates a mechanism that increases job performance. Selvarajan et al. (2018) connected performance appraisal justice to job performance through the motivation to perform better. Drawing on this evidence and considering the positive relation between performance appraisal justice and job performance (Kuvaas, 2006; Aly and El-Shanawany, 2016), we would like to clarify the role of performance appraisal satisfaction in the relation between performance appraisal justice and job performance. Therefore, we assume that:
H2a: performance appraisal justice is positively associated with job performance.
H2b: performance appraisal justice is positively associated with job performance through performance appraisal satisfaction.
Job satisfaction is a key-factor for organizational success (Mufti et al., 2019). It is positively associated with goals achievement (Malik et al., 2010). This pleasant emotional state derives from individual evaluations about the job. It corresponds to the pleasantness perceived on the job and motivates people to be committed to their job activities (Karimi et al., 2011; Bélanger et al., 2015; Benevene et al., 2018a). Evidence showed the association between performance appraisal justice and job satisfaction (Salleh et al., 2013; Agyare et al., 2016; Van Thielen et al., 2018). Since job satisfaction is a global evaluation of various job features, it can be affected by the performance appraisal system. For example, in the literature abundant evidence have demonstrated the positive relation between performance appraisal satisfaction and job satisfaction (Karimi et al., 2011; Decramer et al., 2015; Van Thielen et al., 2018). Therefore, we assume that:
H3a: performance appraisal justice is positively associated with job satisfaction.
H3b: performance appraisal justice is positively associated with job satisfaction through performance appraisal satisfaction.
Looking to vocational outcomes without considering personal well-being could be a low-value choice (Van De Voorde et al., 2012). Work context and life domain are not distinct spheres: they are interdependent and could influence each other in many ways (Chummar et al., 2019). Then, we would like to take a further step: to explore the relation between performance appraisal justice and life satisfaction, which is often used as an indicator of well-being (Alonso et al., 2019). Life satisfaction is a cognitive evaluation regarding how satisfying our entire life is (Hart, 1999). Essentially, how much our life quality pleases us. Many studies stated the association between life satisfaction and job satisfaction (Aydintan and Koç, 2016; Goetz et al., 2019; Masdonati et al., 2019), that is associated with performance appraisal justice, as mentioned above. Moreover, organizational justice – the overarching dimension in which performance appraisal justice belongs – is associated with life satisfaction (Tepper, 2000; Lambert et al., 2010). Performance management can influence personal domain, as well. Dissatisfaction with performance appraisal has negative effects on personal life: for example, it increases work-life conflict (Falco et al., 2013a; Ismail and Gali, 2017; De Carlo et al., 2019). However, to the best of our knowledge, the literature has not examined the relation between performance appraisal system and life satisfaction. We suppose it can follow the performance appraisal satisfaction – job satisfaction relation. Therefore, we would like to explore the role of performance appraisal satisfaction in the relation between performance appraisal justice and life satisfaction, assuming that:
H4a: performance appraisal justice is positively associated with life satisfaction.
H4b: performance appraisal justice is positively associated with life satisfaction through performance appraisal satisfaction.
Materials and Methods
Participants and Procedure
Participants were directly contacted and decided to take part in the research on voluntary basis. Consequently, we gathered a convenience sample. One hundred sixty-one Italian teachers filled out the paper-and-pencil self-administered questionnaire (Table 1). The sample average age was 46.3 years (SD = 10.11) and gender distribution was 63.4% women and 36.6% men. With regards to educational levels, 89.4% of participants held a degree, 5.6% held a high school diploma, 0.6% completed only middle school, and 4.3% held a further kind. Most of the participants had been working for the same school for more than 4 years (74.5%), 22.4% had been working for a period ranging between 2 and 4 years, and 3.1% had been working for less than 1 year. The majority of the sample is full-time employed (88.2%), whereas 10.6% is part-time employed (1.2% missing). 90.7% had an open-ended contract (or apprenticeship) and 9.3% had a fixed-term contract (or replacement). All participants gave their written informed consent before the administration of the questionnaire, in accordance with the Declaration of Helsinki. The study was carried out in accordance the rules of AIP (Associazione Italiana di Psicologia – Italian Association of Psychology), according to which there was no need for previous ethics approval, since it would not deal with animals or vulnerable groups, or would involve risk for the well-being of participants, or use biomedical devices, or invasive investigation tools. Our study was conducted in accordance with the recommendations of the Ethic Committee of Psychology Research of the University of Padua, with the above-mentioned written informed consent from all participants.
Measures
Performance appraisal justice was assessed with 17 items (Gupta and Kumar, 2013) adapted from Colquitt et al. (2001). The scale measured four dimensions: distributive justice (e.g., “The outcome of performance appraisal is appropriate for the work I completed”), procedural justice (e.g., “The procedures followed during performance appraisal process are free of bias”), interpersonal justice (e.g., “My supervisor treated me with dignity during the performance appraisal meeting”), and informational justice (e.g., “My supervisor explained the procedures of the performance appraisal process thoroughly”). The 5-point response scale ranged from 1 (strongly disagree) to 5 (strongly agree). The Cronbach’s alpha for the scale is 0.95.
Performance appraisal satisfaction was assessed with six items (Kuvaas, 2006): global satisfaction with performance appraisal, satisfaction with the feedback received, and perceived organizational commitment to performance appraisal (e.g., “I am satisfied with the way my organization provides me with feedback,” “The feedback I receive on how I do my job is highly relevant,” “I think that my organization attempts to conduct performance appraisal the best possible way,” respectively). The items were on a 5 point-Likert scale (1 = strongly disagree; 5 = strongly agree). The Cronbach’s alpha for the scale is 0.92.
Job performance was assessed with two items rated on a 10-point Likert scale (from 10% to 100%): “We would kindly ask you to specify, using a percentage, how successful you were in reaching your work goals last year” and “How do you rate your job performance during the last year?” The Cronbach’s alpha for the scale is 0.85.
Job satisfaction was assessed by asking “How satisfied are you with your working life?” The item was taken from the Qu-Bo test (De Carlo et al., 2008–2011) and was on a 6 point-Likert scale (1 = very dissatisfied; 6 = very satisfied).
Life satisfaction was assessed by asking “How satisfied are you with your overall life?” The item was taken from the Qu-Bo test (De Carlo et al., 2008–2011) and was on a 6 point-Likert scale (1 = very dissatisfied; 6 = very satisfied).
Statistical Analyses
We tested the hypotheses by means of structural equation models (SEM) with latent variables, using the Lisrel 8.80 software (Jöreksog and Sörbom, 2006). Consequently, we estimated another model, fixing all the non-significant paths to zero, to obtain a more parsimonious solution.
We assessed the model fit, starting with the chi-square test (χ2). A model shows a good fit to the data if χ2 is non-significant. Given that χ2 is sensitive to sample size, we considered additional fit indices. In particular, we considered the non-normed fit index (NNFI), the standardized root mean residual (SRMR), and the root mean square error of approximation (RMSEA). Values close to or greater than 0.95 for NNFI, values close to or smaller than 0.10 for SRMR, and values close to or smaller than 0.08 for RMSEA indicate an acceptable fit (Schermelleh-Engel et al., 2003).
We considered 95% asymmetric confidence intervals based on the distribution of the multiplication term, to verify the significance of the indirect effects. The purpose was to manage the non-normality derived from the path a × path b multiplication, as recommended by MacKinnon’s procedure (PRODCLIN; MacKinnon et al., 2007). If the confidence interval does not contain zero, the indirect effect is significant (MacKinnon et al., 2012).
Before testing the model, we carried out two procedures. First, we excluded participants with missing values; therefore, the final sample consisted of 154 participants. Second, we tested if common method variance (CMV) was a threat to the study. In fact, as we collected data through self-report measures, the risk of CMV may exist. Therefore, we controlled for the effects of a latent method factor, by using a single-common-method-factor approach in a confirmatory factor analysis (CFA) (Podsakoff et al., 2003). We added a new latent variable called “method” on which we loaded all indicators of the five theoretical factors. Consequently, we obtained a six-factor model. Then, we compared χ2 of the six-factor model to the five-factor model’s one. If the p-value associated with Δχ2 is significant, the effect of the latent method factor exists. To evaluate the impact of this effect, we partitioned the observed variance of the indicators into three component: variance attributable to the theoretical factors, to the method and to the causal error. In particular, Williams et al. (1989) identified the following average partitioning: 50% variance attributable to the theoretical factors, 27% variance attributable to the method, and 23% variance attributable to the causal error. If the variance attributable to the method is up to 27%, the CMV does not lead to inaccurate results.
Results
Descriptive Results
Table 2 presents means, standard deviations, and correlations. The latter provide initial evidence that all variables could be positively associated to each other.
Common Method Variance
The comparison between the χ2 of the two alternative models suggests the possible existence of a method effect (Δχ2 = 88.45; Δdf = 14; p = 0.00). Even though the variance partitioning indicated that the variance attributable to the method exists, this is limited and accounts for 17% of the total observed variance. Therefore, these results suggest that CMV is not a concern in this study.
Model Testing
We estimated the hypothesized structural model that satisfied the acceptability criteria [χ2(69) = 150.83, p = 0.00; NNFI = 0.96; SRMR = 0.05; RMSEA = 0.08]. However, the direct relations between performance appraisal justice and the outcomes – namely job performance, job satisfaction, and life satisfaction – were non-significant (H2a, H3a, H4a rejected). To obtain a more parsimonious solution, we then set all these paths to zero.
This second model tests the total mediation of performance appraisal satisfaction. The model (Figure 1) shows an acceptable fit to the data, considering χ2(72) = 152.97 (p = 0.00); RMSEA = 0.08; NNFI = 0.97; and SRMR = 0.05. In the model, performance appraisal justice is positively associated with performance appraisal satisfaction (γ = 0.82, p < 0.001). Therefore, H1 is confirmed. Furthermore, performance appraisal satisfaction is positively associated with job performance (β = 0.54, p < 0.001), job satisfaction (β = 0.30, p = 0.001), and life satisfaction (β = 0.32, p < 0.001).
At this point, we verified the significance of the indirect effects. The asymmetric confidence intervals for the relationships between performance appraisal justice and the outcomes, through performance appraisal satisfaction, do not contain zero. We can conclude that performance appraisal satisfaction totally mediates the relationship between performance appraisal justice and the outcomes (H2b, H3b, H4b confirmed). In particular, the unconventional estimate is 0.65, 95% CI [0.41028,0.91924] for the relationship between performance appraisal justice and job performance. The unconventional estimate is 0.34, 95% CI [0.15612,0.55012] for the relationship between performance appraisal justice and job satisfaction. The unconventional estimate is 0.38, 95% CI [0.18804,0.58972] for the relationship between performance appraisal justice and life satisfaction. Consequently, we can conclude that performance appraisal satisfaction totally mediates the relationship between performance appraisal justice and the outcomes.
Discussion
The study had the following aims. First, we intended to investigate the role of performance appraisal perceptions in a teachers’ sample – in terms of justice and satisfaction – in enhancing well-being outcomes. Second, we aimed to clarify its influence mechanisms on the outcomes, particularly mediation.
High-quality teaching allows schools to focus on students’ skills and knowledge, to educate future citizens, and promote social inclusion (Barone, 2016). Performance appraisal systems permit not only to regulate educational system, but also to create continuous innovation and improvement (Freddano, 2016). Performance appraisal is a process critical to teaching quality: if perceived as inadequate, it has negative consequences. The performance appraisal should not be a mere red-tape fulfilment: it should be carried out in depth, to actually influence school functioning (Barone, 2016). According to Cunha et al. (2018) some believe that it would be better to eliminate this appraisal system, because of its weaknesses, such as the excessive focus on the dyadic and unbalanced relation between appraiser and appraisee, and the thorny reference to meritocracy. Furthermore, performance management system is inefficient if openness is lacking and integrity is not perceived. For this reason, perceiving justice in performance appraisal is a key factor to enhance positive outcomes.
Our findings confirm the importance of positive perceptions in performance appraisal. Indeed, performance appraisal justice enhances well-being outcomes, namely job performance, job satisfaction, and life satisfaction. However, this improvement is possible only through satisfaction with performance appraisal, because our findings show that the direct relationships between performance appraisal justice and the outcomes are non-significant. Satisfaction with performance appraisal is needed, because it totally mediates the relations between performance appraisal justice and the outcomes. Finally, our study confirms that performance appraisal justice and performance appraisal satisfaction affect job performance (Gruman and Sacks, 2011; Malik and Aslam, 2013) and job satisfaction (Decramer et al., 2015; Agyare et al., 2016). Moreover, we argue that performance appraisal justice and performance appraisal satisfaction have non-vocational outcomes, namely life satisfaction.
Therefore, performance appraisal appropriateness, unbiased procedures, dignity during performance appraisal meetings, and adequate explanation of the procedures used – namely, performance appraisal justice (Gupta and Kumar, 2013) – is not sufficient to increase the positive outcomes. Performance appraisal satisfaction is fundamental to reach this goal. For this reason, performance appraisal has to be perceived as a global, positive process: its perceived justice is important together with its other facets, such as the relevance of the feedback received, the right recognition of the individual performance, and the organizational engagement in providing a constructive feedback – aspects constituting performance appraisal satisfaction (Kuvaas, 2006). Thus, according to our results, all the aspects of performance appraisal satisfaction convey performance appraisal justice.
The study has some limitations. First, its cross-sectional nature does not allow us to determine the direction and the causality of the relations. Even if strong reasons support our results, future research may choose to conduct longitudinal studies. Since we used only one data gathering method, future research could take into account different kinds of evaluations (Falco et al., 2013c; Girardi et al., 2019); for example, they can consider students’ and colleagues’ perspectives. Drawing on the importance of subjectivity, future research could consider the moderation of some individual characteristics, such as optimism or self-efficacy, or some personality traits (e.g., perfectionism, need for cognitive closure; Falco et al., 2014; Bélanger et al., 2016). Moreover, since contextual variables could explain the results trend, future research could take into account the school level as an independent variable. Finally, in the future it is worth examining how to promote performance appraisal justice, to make it an integral part of the educational system. It is also essential to reflect on the real purposes of the appraisal system (Maccarini, 2016), that is to adjust to match those of the educational system, and the overall quality-equity binomial (Benadusi and Giancola, 2016).
Conclusion
The study underlines the relationships between performance appraisal justice and some positive individual outcomes (e.g., performance, job satisfaction, life satisfaction). These relationships are totally mediated by performance appraisal satisfaction. The study gives the following contributions. First, in examining the performance appraisal system, it considers its perceptions and its subjective facets, rather than the organizational ones. In doing so, it sheds light on the relationships between these perceptions and the positive outcomes considered. Second, it clarifies the mechanisms of action of performance appraisal justice, which was not clear (Rubel and Kee, 2015). Third, it identifies a possible antecedent of performance appraisal satisfaction (Ismail and Gali, 2017). Fourth, it represents – to the best of our knowledge – a first step in the study of the effects of the performance appraisal system perception on life satisfaction.
Practical Implications
Based on our results, justice and satisfaction are basic facets of the performance appraisal system. Therefore, planning training activities would be advisable to strengthen the skills that principals use during these performance appraisal meetings. The interventions could concern communication, soft, and positive, managerial skills, and psychological counseling (Dal Corso et al., 2013; Scaratti and Ivaldi, 2015; De Carlo et al., 2016; Farnese et al., 2017). These competences could help teachers to perceive performance appraisal as a constructive, encouraging process.
Data Availability Statement
The datasets generated for this study are available on request to the corresponding author.
Ethics Statement
Ethical review and approval was not required for the study on human participants in accordance with the local legislation and institutional requirements. The patients/participants provided their written informed consent to participate in this study.
Author Contributions
LD developed the research project, with the contribution of AD, AF, and DG. LD reviewed the literature, with the contribution of AD and AF. FC prepared the data set. DG and FC carried out the data analysis.
Funding
This study was supported by the University of Padua Research Funds.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
The handling Editor declared a shared affiliation, though no other collaboration, with one of the authors FC at the time of review.
References
Agyare, R., Yuhui, G., Mensah, L., Aidoo, Z., and Ansah, I. O. (2016). The impacts of performance appraisal on employees’ job satisfaction and organizational commitment: a case of microfinance institutions in Ghana. Int. J. Bus. Manage. 11, 281–297. doi: 10.5539/ijbm.v11n9p281
Alonso, C., Fernández-Salinero, S., and Topa, G. (2019). The impact of both individual and collaborative job crafting on Spanish teachers’ well-being. Educ. Sci. 9:74. doi: 10.3390/educsci9020074
Aly, N. A. E. M., and El-Shanawany, S. M. (2016). The influence of performance appraisal satisfaction on nurses’ motivation and their work outcomes in critical care and toxicology units. Eur. Sci. J. 12, 119–135. doi: 10.19044/esj.2016.v12n20p119
Aydintan, B., and Koç, H. (2016). The relationship between job satisfaction and life satisfaction: an empirical study on teachers. Int. J. Bus. Soc. Sci. 7, 72–80. doi: 10.1002/pchj.88
Barbieri, B., Farnese, M. L., Sulis, I., Dal Corso, L., and De Carlo, A. (2018). One perception, two perspectives: measuring psychological contract dimensionality through the psychological contract content questionnaire. Test. Psychometr. Methodol. Appl. 25, 21–47. doi: 10.4473/TPM25.1.2
Barone, C. (2016). “La valutazione delle scuole italiane migliorerà la loro efficacia formativa? Tre dubbi e una occasione persa,” in Uno specchio per la valutazione della scuola. Paradossi, controversie, vie d’uscita, eds P. Landri, and A. M. Maccarini, (Milano, TX: FrancoAngeli), 92–114.
Bélanger, J. J., Pierro, A., Barbieri, B., De Carlo, N. A., Falco, A., and Kruglanski, A. W. (2016). One size doesn’t fit all: the influence of supervisors’ power tactics and subordinates’ need for cognitive closure on burnout and stress. Eur. J. Work Organ. Psychol. 25, 287–300. doi: 10.1080/1359432X.2015.1061999
Bélanger, J. J., Pierro, A., Kruglanski, A. W., Vallerand, R. J., De Carlo, N. A., and Falco, A. (2015). On feeling good at work: the role of regulatory mode and passion in psychological adjustment. J. Appl. Soc. Psychol. 45, 319–329. doi: 10.1111/jasp.12298
Benadusi, L., and Giancola, O. (2016). “Per una valutazione bilanciata nel sistema educativo italiano,” in Uno specchio per la valutazione della scuola. Paradossi, controversie, vie d’uscita, eds P. Landri, and A. M. Maccarini, (Milano, TX: FrancoAngeli), 49–64.
Benevene, P., Dal Corso, L., De Carlo, A., Falco, A., Carluccio, F., and Vecina, M. L. (2018a). Ethical leadership as antecedent of job satisfaction, affective organizational commitment and intention to stay among volunteers of non-profit Organizations. Front. Psychol. 9:2069. doi: 10.3389/fpsyg.2018.02069
Benevene, P., Ittan, M. M., and Cortini, M. (2018b). Self-esteem and happiness as predictors of school teachers’ health: the mediating role of job satisfaction. Front. Psychol. 9:933. doi: 10.3389/fpsyh.2018.00933
Benevene, P., and Fiorilli, C. (2015). Burnout syndrome at school: a comparison study with lay and consecrated Italian teacher, Mediterr. J. Soc. Sci. 6, 501–506. doi: 10.5901/mjss.2015.v6n1p501
Bloom, N., Lemos, R., Sadun, R., Scur, D., and Van Reenen, J. (2014). JEEA-FBBVA lecture 2013: the new empirical economics of management. J. Eur. Econ. Assoc. 12, 835–876. doi: 10.1016/j.ajic.2017.03.024
Borrelli, I., Benevene, P., Fiorilli, C., D’Amelio, F., and Pozzi, G. (2014). Working conditions and mental health in teachers: a preliminary study. Occup. Med. 64, 530–532. doi: 10.1093/occmed/kqu108
Bradford, C., and Braaten, M. (2018). Teacher evaluation and the demoralization of teachers. Teach. Teach. Educ. 75, 49–59. doi: 10.1016/j.tate.2018.05.017
Campbell, J. (1990). “Modeling the performance prediction problem in industrial and organizational psychology,” in Handbook of Industrial and Organizational Psychology, eds M. Dunnette, and L. Hough, (Palo Alto, CA: Consulting Psychologists Press), 686–707.
Chummar, S., Singh, P., and Ezzedeen, S. R. (2019). Exploring the differential impact of work passion on life satisfaction and job performance via the work–family interface. Pers. Rev. 48, 1100–1119. doi: 10.1108/PR-02-2017-0033
Ciarrochi, J., Atkins, P. W. B., Hayes, L. L., Sahdra, B. K., and Parker, P. (2016). Contextual positive psychology: policy recommendations for implementing positive psychology into schools. Front. Psychol. 7:1561. doi: 10.3389/fpsyg.2016.01561
Colquitt, J. A., Conlon, D. E., Wesson, M. J., Porter, C., and Ng, K. Y. (2001). Justice at the millennium: a meta-analytic review of 25 years of organizational justice research. J. Appl. Psychol. 86, 386–400. doi: 10.1037/0021-9010.86.3.425
Cuevas, R., Ntoumanis, N., Fernandez-Bustos, J. G., and Bartholomew, H. (2018). Does teacher evaluation based on student performance predict motivation, well-being, and ill-being? J. Sch. Psychol. 68, 154–162. doi: 10.1016/j.jsp.2018.03.005
Cunha, M. P., Vieira, D. V., Rego, A., and Clegg, S. (2018). Why does performance management not perform? Int. J. Prod. Perform. Manag. 67, 673–692. doi: 10.1108/IJPPM-11-2016-0243
Dal Corso, L., Floretta, P., Falco, A., Benevene, P., and De Carlo, A. (2013). The repertory grid technique in research-intervention on work-related stress. Test. Psychometr. Methodol. Appl. Psychol. 20, 155–168. doi: 10.4473/TPM20.2.4
De Carlo, A., Dal Corso, L., Di Sipio, A., Scarcella, M., and Sorvillo, D. (2016). Coping with the economic and labor crisis: models and tools for the evaluation of suicide risk. Test. Psychometr. Methodol. Appl. Psychol. 23, 299–317. doi: 10.4473/TPM23.3.3
De Carlo, A., Girardi, D., Falco, A., Dal Corso, L., and Di Sipio, A. (2019). When does work interfere with teachers’ private life? An application of the job demands-resources model. Front. Psychol. 10:1121. doi: 10.3389/fpsyg.2019.01121
De Carlo, N. A., Falco, A., and Capozza, D. (2008–2011). Test di valutazione dello stress lavoro-correlato nella prospettiva del benessere organizzativo, Qu-BO. Milano, TX: FrancoAngeli.
Decramer, A., Audenaert, M., Van Waeyenberg, T., Claeys, T., Claes, C., Vandevelde, S., et al. (2015). Does performance management affect nurses’ well-being? Eval. Program. Plann. 49, 98–105. doi: 10.1016/j.evalprogplan.2014.12.018
Delvaux, E., Vanhoof, J., Tuytens, M., Vekeman, E., Devos, G., and Van Petegem, P. (2013). How may teacher evaluation have an impact on professional development? A multilevel analysis. Teach. Teach. Educ. 36, 1–11. doi: 10.1016/j.tate.2013.06.011
Demerouti, E., Bakker, A. B., Nachreiner, F., and Schaufeli, W. B. (2001). The job demands-resources model of burnout. J. Appl. Psychol. 86, 499–512. doi: 10.1037/0021-9010.86.3.499
DeNisi, A. S., and Pritchard, R. D. (2006). Performance appraisal, performance management and improving individual performance: a motivational framework. Manage. Organ. Rev. 2, 253–277. doi: 10.1111/j.1740-8784.2006.00042.x
Donaldson, M., and Mavrogordato, M. (2018). Principals and teacher evaluation. The cognitive, relational, and organization dimensions of working with low-performing teachers. J. Educ. Admin. 56, 586–601. doi: 10.1108/JEA-08-2017-0100
Falco, A., Dal Corso, L., Girardi, D., De Carlo, A., Barbieri, B., Boatto, T., et al. (2017). Why is perfectionism a risk factor for workaholism? The mediating role of irrational beliefs at work. Test. Psychometr. Methodol. Appl. Psychol. 24, 583–600. doi: 10.4473/TPM24.4.8
Falco, A., Dal Corso, L., Girardi, D., De Carlo, A., and Comar, M. (2018). The moderating role of job resources in the relationship between job demands and interleukin-6 in an Italian healthcare organization. Res. Nurs. Health 41, 39–48. doi: 10.1002/nur.21844
Falco, A., Girardi, D., Dal Corso, L., Di Sipio, A., and De Carlo, N. A. (2013a). Fear of workload, job autonomy, and work-related stress: the mediating role of work-home interference. Test. Psychometr. Methodol. Appl. Psychol. 20, 217–234. doi: 10.4473/TPM20.3.2
Falco, A., Girardi, D., Kravina, L., Trifiletti, E., Bartolucci, G. B., Capozza, D., et al. (2013b). The mediating role of psychophysic strain in the relationship between workaholism, job performance, and sickness absence: a longitudinal study. J. Occup. Environ. Med. 55, 1255–1261. doi: 10.1097/JOM.0000000000000007
Falco, A., Girardi, D., Parmiani, G., Bortolato, S., Piccirelli, A., Bartolucci, G. B., et al. (2013c). Presenteismo e salute dei lavoratori: effetti di mediazione sullo strain psico-fisico in un’indagine longitudinale [Presenteeism and workers’ health: effects of mediation on psycho-physical stress in a longitudinal study]. G. Ital. Med. Lav. Ergon. 35, 138–150.
Falco, A., Piccirelli, A., Girardi, D., Di Sipio, A., and De Carlo, N. A. (2014). “The best or nothing”: the mediating role of workaholism in the relationship between perfectionism and burnout. Test. Psychometr. Methodol. Appl. Psychol. 21, 213–232. doi: 10.4473/TPM21.2.7
Farndale, E. (2017). Two-country study of engagement, supervisors and performance appraisal. J. Asia Bus. Stud. 11, 342–362. doi: 10.1108/JABS-07-2015-0105
Farnese, M. L., Barbieri, B., Bellò, B., and Bartone, P. T. (2017). Don’t abandon hope all ye who enter here: the protective role of formal mentoring and learning processes on burnout in correctional officers. Work 58, 319–331. doi: 10.3233/WOR-172628
Freddano, M. (2016). “La valutazione di sistema sugli apprendimenti come misura del curriculum appreso,” in Uno specchio per la valutazione della scuola. Paradossi, controversie, vie d’uscita, eds P. Landri, and A. M. Maccarini, (Milano, TX: FrancoAngeli), 135–156.
Fredrickson, B. L. (2001). The role of positive emotions in positive psychology: the broaden-and-build theory of positive emotions. Am. Psychol. 56, 218–226. doi: 10.1037/0003-066X.56.3.218
Ghosh, A., and Deb, A. (2017). Positive psychology interventions for chronic physical illnesses: a systematic review. Psychol. Stud. 62, 213–232. doi: 10.1007/s12646-017-0421-y
Girardi, D., De Carlo, A., Dal Corso, L., Andreassen, C. S., and Falco, A. (2019). Is workaholism associated with inflammatory response? The moderating role of work engagement. Test. Psychometr. Methodol. Appl. Psychol. 26, 305–322. doi: 10.4473/TPM26.2.9
Girardi, D., Falco, A., De Carlo, A., Dal Corso, L., and Benevene, P. (2018). Perfectionism and workaholism in managers: the moderating role of workload. Test. Psychometr. Methodol. Appl. 25, 571–588. doi: 10.4473/TPM25.4.7
Girardi, D., Falco, A., Piccirelli, A., Dal Corso, L., Bortolato, S., and De Carlo, A. (2015). Perfectionism and presenteeism among managers of a service organization: the mediating role of workaholism. Test. Psychometr. Methodol. Appl. 22, 507–521. doi: 10.4473/TPM22.4.5
Goetz, K., Schuldei, R., and Steinhäuser, J. (2019). Working conditions, job satisfaction and challenging encounters in dentistry: a cross-sectional study. Int. Dent. J. 69, 44–49. doi: 10.1111/idj.12414
Gözükara, I., Hatipoĝlu, Z., and Günes̨, O. O. (2017). The impact of perceived leadership style on performance appraisal satisfaction and organizational diagnosis in terms of turnover intention. Int. J. Bus. Manage 12, 104–116. doi: 10.5539/ijbm.v12n9p104
Greenberg, J. (1993). Justice and organizational citizenship: a commentary on the state of the science. Hum. Resour. Manage. R. 6, 249–256. doi: 10.1007/BF01419448
Gruman, J. A., and Sacks, A. M. (2011). Performance management and employee engagement. Hum. Resour. Manage. R. 21, 123–136. doi: 10.1016/j.hrmr.2010.09.004
Guchait, P., and Cho, S. (2010). The impact of human resource management practices on intention to leave of employees in the service industry in India: the mediating role of organizational commitment. Int. J. Hum. Resour. Manage. 21, 1228–1247. doi: 10.1080/09585192.2010.483845
Gupta, V., and Kumar, S. (2013). Impact of performance appraisal justice on employee engagement: a study of Indian professionals. Empl. Relat. 35, 61–78. doi: 10.1108/01425451311279410
Hart, P. (1999). Predicting employee life satisfaction: a coherent model of personality, work and nonwork experiences, and domain satisfactions. J. Appl. Psychol. 84, 564–584. doi: 10.1037/0021-9010.84.4.564
Hobfoll, S. E. (1989). Conservation of resources: a new attempt at conceptualizing stress. Am. Psychol. 44, 513–524. doi: 10.1037/0003-066X.44.3.513
Hobfoll, S. E. (1998). Stress, Culture, and Community: The Psychology and Philosophy of Stress. New York: Plenum.
Hong, Y. L. (2018). “A review of the influencing factors of rate performance appraisal satisfaction,” in Proceedings of 3rd International Conference On Society Science And Economics Development (ICSSED 2018), Nanjing, 323–326.
Ikramullah, M., Shah, B., Khan, S., Hassan, F. S. U., and Zaman, T. (2012). Purpose of performance appraisal system: a perceptual study of civil servants in district Dera Ismail Khan Pakistan. Int. J. Bus. Manage. 7, 142–151. doi: 10.5539/ijbm.v7n3p142
Ismail, H., and Gali, N. (2017). Relationships among performance appraisal satisfaction, work-family conflict and job stress. J. Manage. Org. 23, 356–372. doi: 10.1017/jmo.2016.15
Ivaldi, S., Scaratti, G., and Nuti, G. (2015). The practice of evaluation as an evaluation of practices. Evaluation 21, 497–512. doi: 10.1177/1356389015606538
Jöreksog, K. G., and Sörbom, D. (2006). LISREL 8.80 for Windows. Lincolnwood, IL: Scientific Software International.
Karimi, R., Malik, M. I., and Hussain, S. (2011). Examining the relationship of performance appraisal system and employee satisfaction. Int. J. Bus. Soc. Sci. 2, 243–247.
Kim, J. (2016). Impact of performance appraisal justice on the effectiveness of pay-for-performance systems after civil service reform. Public. Pers. Manage. 45, 148–170. doi: 10.1177/0091026016644625
Kuvaas, B. (2006). Performance appraisal satisfaction and employee outcomes: mediating and moderating roles of work motivation. Int. J. Hum. Resour. Manage. 17, 504–522. doi: 10.1080/09585190500521581
Lambert, E. G., Hogan, N. L., Jiang, S., Elechi, O. O., Benjamin, B., Morris, A., et al. (2010). The relationship among distributive and procedural justice and correctional life satisfaction, burnout, and turnover intent: an exploratory study. J. Crim. Just 38, 7–16. doi: 10.1016/j.jcrimjus.2009.11.002
Lira, M., Gomes da Silva, V. P., and Viseu, C. (2016). Performance appraisal as a motivational tool in the portuguese public administration. Port. J. Financ. Manage. Acc. 2, 91–118.
Longenecker, C. O. (1997). Why managerial performance appraisals are ineffective: causes and lessons. Career. Dev. Int. 2, 212–218. doi: 10.1108/13620439710174606
Lucisano, P., and Corsini, C. (2015). Teachers’ point of view on school and teacher evaluation. Ital. J. Educ. R. 8, 97–109. doi: 10.1177/1365480215627894
Maccarini, A. M. (2016). “La valutazione dei sistemi scolastici oltre la regolazione a-normativa,” in luogo di una postfazione”, in Uno specchio per la valutazione della scuola. Paradossi, controversie, vie d’uscita, eds P. Landri, and A. M. Maccarini, (Milano, TX: FrancoAngeli), 183–199.
MacKinnon, D. P., Cheong, J., and Pirlott, A. G. (2012). “Statistical mediation analysis,” in APA Handbook of Research Methods in Psychology, Vol. 2. Research Designs: Quantitative, Qualitative, Neuropsychological, and Biological, eds H. Cooper, P. M. Camic, D. L. Long, A. T. Panter, D. Rindskopf, and K. J. Sher, (Washington, DC: American Psychological Association), 313–331. doi: 10.1037/13620-018
MacKinnon, D. P., Fritz, M. S., Williams, J., and Lockwood, C. M. (2007). Distribution of the product confidence limits for the indirect effect: program PRODCLIN. Behav. Res. Methods 39, 384–395. doi: 10.3758/BF03193007
Malik, M. I., Ahmad, M., Saif, M. I., and Safwan, M. N. (2010). Relationship of organizational commitment, job satisfaction and layoff survivor’s productivity. Interd. J. Contemp. Res. Bus. 2, 200–210.
Malik, M. S., and Aslam, S. (2013). Performance appraisal and employee’s motivation: a comparative analysis of Telecom industry of Pakistan. Pak. J. Soc. Sci. 33, 179–189.
Masdonati, J., Schreiber, M., Marcionetti, J., and Rossier, J. (2019). Decent work in Switzerland: context, conceptualization, and assessment. J. Vocat. Behav. 110, 12–27. doi: 10.1016/j.jvb.2018.11.004
Mufti, M., Xiaobao, P., Shah, S. J., Sarwar, A., and Zhenqing, Y. (2019). Influence of leadership style on job satisfaction of NGO employee: the mediating role of psychological empowerment. J. Public Aff. 2019:e1983. doi: 10.1002/pa.1983
Naji, A., Ben Mansour, J., and Leclerc, A. (2015). Performance appraisal system and employee satisfaction: the role of trust towards supervisors. J. Hum. Res. Manage. Labor Stud. 3, 40–53. doi: 10.15640/jhrmls.v3n1a3
Obasi, K. K., and Ohia, A. N. (2014). Teacher performance evaluation techniques in public and private secondary schools in South East Nigeria. Glob. J. Educ. Res. 12, 117–123. doi: 10.4314/gjedr.v13i2.8
Podsakoff, P. M., MacKenzie, S. B., Lee, J. Y., and Podsakoff, N. P. (2003). Common method biases in behavioral research: a critical review of the literature and recommended remedies. J. Appl. Psychol. 88, 879–903. doi: 10.1037/0021-9010.88.5.879
Ripamonti, S., Galuppo, L., Bruno, A., Ivaldi, S., and Scaratti, G. (2018). Reconstructing the internship program as a critical reflexive practice: the role of tutorship. Teach. High. Educ. 23, 751–768. doi: 10.1080/13562517.2017.1421627
Robinson, V. M., Lloyd, C. A., and Rowe, K. J. (2008). The impact of leadership on students outcomes: an analysis of the differential effects of leadership types. Educ. Admin. Quart. 44, 635–674. doi: 10.1177/0013161X08321509
Rubel, M. R. B., and Kee, D. M. H. (2015). Perceived fairness of performance appraisal, promotion opportunity and nurses turnover intention: the role of organizational commitment. Asian Soc. Sci. 11, 183–197. doi: 10.5539/ass.v11n9p183
Salleh, M., Amin, A., Muda, S., and Halim, M. A. S. A. (2013). Fairness of performance appraisal and organizational commitment. Asian Soc. Sci. 9, 121–128. doi: 10.5539/ass.v9n2p121
Scaratti, S., and Ivaldi, S. (2015). Manager on the ground: a practice based approach for developing management education: lessons from complex and innovative organizations. Appl. Psychol. Bull. 272, 42–57.
Schermelleh-Engel, K., Moosbrugger, H., and Müller, H. (2003). Evaluating the fit of structural equation models: tests of significance and descriptive goodness-of-fit measures. Methods Psychol. Res. 8, 23–74.
Seligman, M. E., and Csikszentmihalyi, M. (2000). Positive psychology: and introduction. Am. Psychol. 55, 5–14. doi: 10.1037/0003-066X.55.1.5
Selvarajan, T. T., Singh, B., and Solansky, S. (2018). Performance appraisal fairness, leader member exchange and motivation to improve performance: a study of US and Mexican employees. J. Bus. Res. 85, 142–154. doi: 10.1016/j.jbusres.2017.11.043
Shankland, R., and Rosset, E. (2017). Review of brief school-based positive psychological interventions: a taster for teachers and educators. Educ. Psychol. Rev. 29, 363–392. doi: 10.1007/s10648-016-9357-3
Snape, E., Thompson, D., Yan, F. K., and Redman, T. (1998). Performance appraisal and culture: practice and attitudes in Hong Kong and Great Britain. Int. J. Hum. Res. Manage. 9, 841–861. doi: 10.1080/095851998340838
Su, S., and Baird, K. (2017). The association between performance appraisal systems, work-related attitudes and academic performance. Financ. Acc. Man. 33, 356–372. doi: 10.1111/faam.12128
Tripathi, A., Chaturvedi, K. R., and Tripathi, A. P. (2018). Assessing the influence of intrinsic motivation on academic performance: a study of management teachers. Soc. Sci. Hum. 26, 1455–1470.
Van De Voorde, K., Paauwe, J., and Van Veldhoven, M. (2012). Employee well-being and the HRM–organizational performance relationship: a review of quantitative studies. Int. J. Manag. Rev. 14, 391–407. doi: 10.1111/j.1468-2370.2011.00322.x
Van Thielen, T., Bauwens, R., Audenaert, M., Van Waeyenberg, T., and Decramer, A. (2018). How to foster the well-being of police officers: the role of the employee performance management system. Eval. Program Plann. 70, 90–98. doi: 10.1016/j.evalprogplan.2018.07.003
Keywords: performance appraisal satisfaction, performance appraisal justice, teacher performance, teacher job satisfaction, teacher life satisfaction
Citation: Dal Corso L, De Carlo A, Carluccio F, Girardi D and Falco A (2019) An Opportunity to Grow or a Label? Performance Appraisal Justice and Performance Appraisal Satisfaction to Increase Teachers’ Well-Being. Front. Psychol. 10:2361. doi: 10.3389/fpsyg.2019.02361
Received: 07 June 2019; Accepted: 03 October 2019;
Published: 26 November 2019.
Edited by:
Caterina Fiorilli, LUMSA University, ItalyReviewed by:
Peizhen Sun, Jiangsu Normal University, ChinaFederica de Cordova, University of Verona, Italy
Copyright © 2019 Dal Corso, De Carlo, Carluccio, Girardi and Falco. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Laura Dal Corso, ZGFsY29yc29AdW5pcGQuaXQ=