Anna Panzeri
Silvia Rossi Ferrario
Paola Cerutti- 1Department of General Psychology, University of Padua, Padua, Italy
- 2Unit of Psychology-Neuropsychology, Institute of Veruno, Maugeri Scientific Institutes for Research, Hospitalization and Health Care, Veruno, Italy
Introduction: Healthcare workers facing the threatening COVID-19 can experience severe difficulties. Despite the need to evaluate both the psychological distress and positive protective resources, brief and reliable assessment tools are lacking.
Aim: Study 1 aimed at developing a new assessment tool to measure psychological distress and esteem in healthcare workers during the COVID-19 pandemic. Study 2 aimed to explore and compare the psychological reactions of healthcare workers of the COVID-19 and the non-COVID-19 wards.
Methods: In Study 1, psychologists created 25 items based on their clinical experience. A preliminary qualitative evaluation selected the best 15 items for the new tool (CPI-HP) assessing the COVID-19 psychological impact with 2 scales: psychological distress and esteem. The CPI-HP was administered to 110 healthcare professionals to study its psychometric properties and the internal structure with exploratory graph analysis and confirmatory factor analysis. Study 2 compared two groups of healthcare professionals of the COVID-19 and non-COVID-19 departments.
Results: In Study 1, the CPI-HP showed satisfying psychometric properties, and the two-factor structure was confirmed with good fit indices. In Study 2, the two groups of healthcare workers showed comparable levels of psychological distress and resilient coping, but the COVID-19 group displayed significantly higher esteem and appreciation of the experience.
Discussion: All operators showed high psychological distress during the emergency, but the COVID-19 group reported higher resources, probably due to stronger group cohesion and greater esteem, perceived meaning, and own work value.
Conclusion: Assessing the psychological distress and resources of healthcare professionals with specific tools is important. Psychological interventions should promote their psychological health.
Introduction
Since December 2019, the COVID-19 disease has rapidly spread, and Italy was one of the first countries in Europe with a vast number of cases. Hospitals and rehabilitation institutes were required to manage and provide care for many acute and post-acute COVID-19 patients while still treating non-COVID-19 patients (e.g., those with cardiovascular and neurological diseases and the elderly).
Health professionals were engaged in the first line to fight the unforeseen, severe, life-threatening, and highly infectious disease and faced several issues. They had to comply with stressful emotional conditions related to both their professional and personal lives. They had to learn new protocols and procedures at work, dealing with an exceeding number of patients and sustaining long shifts with protective clothes with the fear of being infected (Vagni et al., 2020). Also, health professionals' private life was affected as they suffered from psychosocial issues such as isolation and stigmatization; a consistent number of them isolated themselves, moving away from home to not infect their families (Dioscoridi and Carrisi, 2020).
As a whole, these challenging circumstances required prolonged efforts, leading healthcare workers to develop psychological distress symptoms on the cognitive (e.g., worries), emotional (e.g., mood swings), and behavioral (e.g., sleep difficulties and disordered eating) domains (Benfante et al., 2020; Spoorthy, 2020). Despite the COVID-19-related difficulties and the adverse consequences of distress, healthcare professionals were required to cope with the situation, maintaining their individual and professional functioning (Di Tella et al., 2020).
Some key protective factors may have helped healthcare professionals to cope with the situation in a resilient way.
According to the anxiety buffer hypothesis (ABH) (Greenberg et al., 1992; Rossi et al., 2020a), (self-)esteem can represent a resource and a protective factor buffering the effects of stress. Indeed, as stated by the terror management theory (Pyszczynski et al., 2004), esteem also relies on one's social role and is reinforced by other society components. In the COVID-19 pandemic, health operators felt they had a crucial role in the emergency. By doing a meaningful and important job at a societal level, they felt more valuable and important, and their esteem was strengthened by the support and recognition provided by family, colleagues, and society (Greenberg et al., 1986; Hennekam et al., 2020). Moreover, according to the social identity theory (SIT; Tajfel and Turner, 1986), people can derive a sense of self-worth and social belongingness from their memberships in groups. In other words, in the COVID-19 emergency, the perception of being part of an (in-)group of peers and colleagues (i.e., the work team) sharing common features, aims, and feelings and supporting each other could have represented another factor sustaining esteem against distress.
Besides, a resilient coping strategy may have helped healthcare professionals to preserve good functioning despite the distress. Coping is the process of facing, tolerating, and reducing stress related to the demands of an adverse circumstance—as the pandemic—triggering negative emotions (Kocalevent et al., 2017). Individuals using resilient coping strategies can control their responses to stress and react to difficulties positively (Sinclair and Wallston, 2004). While some individuals are more prone to perceive the negative aspects of a situation (Giuntoli et al., 2019), others can still appreciate positive aspects even in the worst circumstances and show the so-called post-traumatic growth (Chen et al., 2020).
Given this background, in the critical and challenging circumstances represented by the outbreak of infectious disease, it is important to assess and monitor the psychological health of healthcare professionals to support them in coping with stress.
However, to date, there are no specific tools specifically developed to measure the psychological impact of COVID-19 on healthcare workers. Most of the existing studies used preexistent tools, mostly related to the negative impact of events, anxiety, and depression (Benfante et al., 2020; Pappa et al., 2020). Thus, a brief tool specifically developed to measure the healthcare professionals' psychological distress and esteem when facing the COVID-19 emergency was lacking.
Moreover, given the frequently asymptomatic and undetected COVID-19 infections, the healthcare workers of both COVID-19 and non-COVID-19 wards were exposed to stressful conditions, potentially triggering similar distress levels. Nonetheless, the similarities and differences in the psychological characteristics of health professionals working in COVID-19 and non-COVID-19 wards were not yet explored. Although similar distress levels are expected, the contribution of protective factors may differ among these groups, namely, the group cohesion and the perceived esteem.
The Present Research
The present two-step research aimed to measure and explore the psychological experience of healthcare professionals in a rehabilitation institute in the north of Italy, where a dedicated ward for patients with COVID-19 was opened in the middle of March 2020.
In Study 1, a new assessment tool was developed to evaluate the psychological impact of COVID-19 for healthcare workers, and its psychometric properties were analyzed.
In Study 2, the questionnaire created in Study 1 was used to assess, explore, and compare the psychological distress and adaptation of health workers and employees working in COVID-19 and non-COVID-19 wards of the institute.
Study 1
Study 1 aimed to develop an ad hoc self-report questionnaire assessing the most relevant psychological areas across healthcare workers' experience during the COVID-19 pandemic—(A) psychological distress and (B) esteem—and to evaluate its psychometrical properties.
Methods
Participants and Procedure
Participants of the study were recruited in a rehabilitation center in northern Italy. All the healthcare workers received an institutional e-mail presenting the study and inviting them to participate in it. Then, the coordinators of each section renewed the invitation to the study. Interested workers were invited to contact the psychologists.
Inclusion criteria were (I) being a native Italian speaker and (II) working in the rehabilitation center during the COVID-19 emergency; and the exclusion criterium was (III) not being able to complete the questionnaire. The final sample of this study was composed of 110 healthcare workers [31 (28.2%) males and 79 (71.8%) females] aged from 23 to 66; mean age = 44.13 (SD 11.17)]. The sample characteristics are reported in Table 1.
Table 1. Study 1 and Study 2: descriptive statistics of the samples.
Healthcare workers completed informed consent, a demographic measures form, and the items of the new questionnaire. This research was conducted according to the Helsinki guidelines and was approved by the Scientific Direction of the Institute. All participants were informed about the study aims and voluntarily agreed to participate.
Sample Size Calculation
Considering statistical analyses used in this study (see the designated section), scientific literature guidelines suggest that exploratory analysis could correctly estimate model parameters with a minimum sample of 100 observations (Golino and Epskamp, 2017). Moreover, also for simple confirmatory models, 100 individuals were considered adequate (Marsh et al., 1988; Kelloway, 2015).
Measures
Development of the COVID-19 Psychological Impact-Healthcare Professionals
The item pool for the CPI-HP was developed using a three-step double-blind study procedure—already employed in other studies (Simpson et al., 2018; Milavic et al., 2019; Pietrabissa et al., 2020a,b).
First, two psychologists–psychotherapists (SRF and PC) who supported healthcare workers during the first phases of the pandemic independently created a pool of items to assess the 3 scales: (A) psychological distress and (B) esteem of healthcare workers—focusing attention on constructs coverage. The psychological distress dimension concerned the fear and anxiety of being infected, mood swings, irritability, and helplessness. Psychological distress included not only emotional facets but also beliefs and behaviors. The esteem of healthcare workers dimension referred to other- and self-perceived personal values, motivation to work, and belongingness to one's workgroup.
Second, the two lists of items were compared and screened: item phrasing was adjusted for the target population, and redundant items were removed. Thus, a preliminary item list (25 items) was approved by SRF and PC.
Third, a third psychologist (AP) administered the list of items to a sample of 10 healthcare workers (judges)—who sorted (in order of relevance) the most representative items for each dimension—giving attention to relevance and comprehensibility. Conclusions from the judges were matched and discussed. An agreement higher than 90% between judges was considered adequate to retain the item. If an agreement was reached for more than one item per dimension, judges were asked to select the most significant one. Finally, a list of 15 items (eight for psychological distress and seven for esteem) was provided.
Items were scaled on a 5-point Likert-type scale ranging from 0 (never) to 4 (always). The total score of each dimension (psychological distress or esteem) was computed by summing the items of each factor. The higher the score, the higher the value in that scale—thus the higher the psychological distress and/or esteem. No overall total score (psychological distress plus esteem) should be calculated. In the Appendix, Table A1 shows the 15 items of the questionnaire.
Statistical Analysis
The R software (R Core Team, 2017) was used with the following packages: bootnet (Epskamp et al., 2018), EGAnet (Golino and Christensen, 2020), mgm (Haslbeck and Waldorp, 2020), lavaan (Rosseel, 2012), and psych (Revelle, 2018).
First of all, the level of item informativeness was checked (Mullarkey et al., 2018, 2019; Marchetti, 2019). Each item was compared to the mean level of informativeness of the CPI-HP (0.078) plus/minus 2.5SDs (0.194). Poorly informative items were excluded from subsequent analyses.
Second, an exploratory graph analysis (EGA) (Golino and Epskamp, 2017; Giuntoli and Vidotto, 2020; Golino and Christensen, 2020) was performed to assess item clustering by using the walktrap algorithm for weighted networks (Pons and Latapy, 2006)—in which nodes may cluster together forming tidy connected sub-networks. Consequently, the thicker an edge, the strongest the relationship between the items of a specific cluster (dimension/factor) (Mair, 2018; Christensen and Golino, 2020). Moreover, it has been demonstrated that EGA has an almost perfect accuracy to correctly extract the correct number of dimensions of a questionnaire—also with a sample size of 100 individuals (Golino and Epskamp, 2017).
Third, to confirm the results of the EGA (Chandrasekaran et al., 2012; Costantini et al., 2015; Epskamp et al., 2017), a confirmatory factor analysis (CFA) was performed (Christensen and Golino, 2020). Considering the CPI-HP response scale, the diagonally weighted least square (DWLS) estimator was used to perform each CFA (Brown, 2015; Lionetti et al., 2016; Manzoni et al., 2021). The model fit of the factorial structure of the CPI-HP was assessed through the (A) Satorra-Bentler χ2 (S-Bχ2); (B) root-mean-square error of approximation (RMSEA); (C) comparative fit index (CFI); and (D) the standard root mean square residual (SRMR) (Muthén, Muthén, 1998–2017; van de Schoot et al., 2012; Brown, 2015; Kline, 2016). The following cutoffs for “acceptable” model fit were applied: the S-Bχ2 should be non-statistically significant (p > 0.05); the RMSEA should be lower than 0.080; the CFI should be higher than 0.90; and the SRMR should be lower than 0.080 (Hu and Bentler, 1999; Hoyle, 2012; van de Schoot et al., 2012; Brown, 2015). The internal consistency of each scale was assessed with Cronbach's α.
The adjusted item–total correlation was also calculated. Also, given that the CPI-HP is a new instrument, the items' ability to discriminate subjects with low or high scores was tested (Milavic et al., 2019; Consoli et al., 2020; Pietrabissa et al., 2020a); thus, the item discriminant power (IDP) was computed (Ebel, 1965; Chiorri, 2011). According to the literature about typical performance test items such as Likert scales, the maximum total score and the quartile rank were calculated for each participant. Then, the item discriminating power was calculated by using independent-sample t-tests and Cohen's Cohen (1988) d, the dependent variable was the total score of each scale, and the grouping variables were the lowest and the highest quartiles (Ebel, 1965; Chiorri, 2011; Milavic et al., 2019; Consoli et al., 2020; Pietrabissa et al., 2020a).
Results
Preliminary Analysis
As reported in Table 2, all the items were almost normally distributed, and none of them was poorly informative. Thus, all 15 items used to compose the CPI-HP could be retained into the principal statistical analyses for assessing the dimensionality of the questionnaire.
Table 2. Study 1: psychometric properties of items.
EGA
As reported in Figure 1, the EGA strongly confirmed the hypothesized two-factor solutions. Indeed, two well-separated sub-networks were identified in the CPI-HP network structure. In particular, on the one hand, the psychological distress was in red, and it was composed of all of the supposed 8 items. On the other hand, the (B) esteem of healthcare workers was in blue, and it was composed of all of the supposed seven items. These results suggest the two-factor-related first-order factor dimensionality of the CPI-HP scale.
Figure 1. Study 1. Exploratory graph analysis of the CPI-HP.
Structural Validity
As showed in Table 2, the CFA clearly confirms the EGA results. Indeed, a good solution for the CPI-HP was found: S-Bχ2(89) = 72.772; p = 0.894 ns; RMSEA = 0.000 [90% CI: 0.000–0.025; p(RMSEA ≤ 0.05) = 1 ns]; CFI = 1.000; SRMR = 0.065. In addition, model modification indices showed that the model could not be improved. The two factors showed a small negative correlation: r = −0.321.
For the psychological distress scale, item factor loading ranged from 0.444 (item #2) to 0.926 (item #5): (mean = 0.681, SD = 0.177), with the items' R2 ranging from 0.197 to 0.858 (mean = 0.492, SD = 0.239). For the esteem of healthcare workers scale, item factor loading ranged from 0.576 (item #1) to 0.842 (item #5) (mean = 0.756, SD = 0.086), with the items' R2 ranging from 0.332 to 0.709 (mean = 0.577, SD = 0.120).
Psychometric Properties
Regarding internal consistency, Cronbach's α coefficients for the questionnaire scales were good: for the psychological distress scale, α = 0.842, and for the esteem of healthcare workers scale, α = 0.880.
The IDP analysis showed that 15 items of the CPI-HP discriminated well between subjects with low and high forgiveness of self, other, and situation in both first- and second-order dimensions (Table 1). Considering the psychological distress scale: the lower discriminative item was item #6 (ti = −5.859, p < 0.001, d = 1.668), and in the opposite, the higher discriminative item was item #3 (ti = −12.546, p < 0.001, d = 3.590). Considering the esteem of healthcare workers scale, the lower discriminative item was item #1 (ti = −6.679, p < 0.001, d = 1.889), and in the opposite, the higher discriminative item was item #6 (ti = −18.203, p < 0.001, d = 5180).
Finally, the adjusted item–total correlation showed statistically significant negative associations between each item and their respective factors (Table 1).
Study 2
Method
Study 2 aimed to assess and compare the psychological experience of the health professionals who worked in COVID-19 and non-COVID-19 wards of the institute.
Inclusion criteria were (I) being a native Italian speaker and (II) working in the rehabilitation center during the COVID-19 pandemic; the exclusion criteria was (III) not being able to complete the questionnaire.
Thus, a sample of 68 employees and health workers of the institute was considered. Half of them worked in the COVID-19 ward, while the other half did not. The two groups were strictly matched for age, sex, and professional role. It is worth noting that the COVID-19 group differed in terms of support of the professional activity (e.g., more strict hygiene protocols and more protections) and enhanced by a Whatsapp support group among colleagues of the work-team—these aspects may have a positive effect on the psychological experience.
The final sample of this study was composed of 68 healthcare workers [28 (41.18%) males and 40 (58.82%) females] aged from 23 to 62; mean age equal to 40.41 (SD = 11.25)]. The sample characteristics are reported in Table 1.
Participants gave informed consent and completed a questionnaire including demographics and psychological measures. Also, this research was conducted in agreement with the Helsinki guidelines, it was approved by the Scientific Direction of the Institute, and all participants voluntarily agreed to participate and provided written informed consent.
Measures
CPI-HP
The CPI-HP questionnaire—created in Study 1—was administered to evaluate the psychological distress with 8 items and esteem with seven items (total 15 items). The response format was a 5-point Likert-type scale from 0 (never) to 4 (always). Higher scores on each scale indicated higher levels of the measured variable. The α in this study was 0.830 for distress and 0.874 for esteem.
Brief Resilient Coping Scale
The BRCS (Sinclair and Wallston, 2004) is a four-item self-report tool to measure resilient coping, defined as the tendency to cope with stress in a highly adaptive and positive way despite the difficulties. The response format is a 5-point Likert-type response form (1 = “the statement does not describe me at all” and 5 = “it describes you very well”). Scores range from 0 to 16, with higher values indicating more resilient coping. The BCRS showed good internal consistency in this study, where the α was 0.72.
A visual analog scale (VAS) called positivity of experience asked participants to rate the degree of appreciation of their work experience during the COVID-19 pandemic from extremely negative (0) to extremely positive (100).
Statistical Analyses
The R software was used (R Core Team, 2017) with the following packages: esvis (Anderson, 2020), ggplot2 (Wickham, 2016), overlapping (Pastore and Calcagnı̀, 2019), and psych (Revelle, 2018).
Similarities and differences among these groups were studied using independent-sample t-tests. Besides, Hedge's (1981) g was used as the effect size according to the guidelines' thresholds. Hedges' g is interpreted similarly as Cohen's d; the following rule of thumb can be used to interpret the results: 0–0.2 = small effect (not visible to the naked eye); 0.5 = medium effect; and 0.8–1 = large effect (visible to the naked eye). Moreover, Hedge's g was supported by the overlapping index (η); that is, it was used to quantify the magnitude of differences between the Kernel density distributions of the groups (Huberty and Lowman, 2000; Wen and Fan, 2015; Pastore and Calcagnı̀, 2019; Rossi et al., 2020b). The η ranges from 0 (perfect separation) to 1 (perfect overlap); thus, it should be interpreted as other normalized effect sizes (i.e., explained variance and percentage) (Pastore and Calcagnı̀, 2019).
Results
The psychological measures of the two groups are reported in Table 2; Figure 2 shows the overlapping graphs.
Figure 2. Study 2. Distributions overlapping between HC from the COVID-19 ward and HC from the non-COVID-19 ward.
Psychological Distress
According to the Welch two-sample t-test, both groups reported comparable levels of psychological distress (COVID-19 group: mean = 14.68, SD = 7.03; non-COVID-19 group: mean = 15.911, SD = 15.91) with a non-statistically significant difference [t(63.96) = 0.787, g = 0.189, p = 0.434] and a small effect size. The overlapping indices show a moderate overlap (0.677) and a small separation index (0.323).
Esteem
The COVID-19 group showed higher esteem values (mean = 17.912, SD = 5.485) than the non-COVID-19 group (mean = 13.71, SD = 6.441), and the difference was statistically significant [t(64.366) = −2.899, g = 0.695, p = 0.005] with a moderate–big effect size. The overlapping and separation indexes were moderate at 0.546 and 0.454, respectively.
Coping
Considering resilient coping, there was no statistically significant difference [t(64.732) = 0.085, g = 0.020, p = 0.932] between the COVID-19 (mean = 10.147, SD = 3.036) and non-COVID-19 groups (mean = 10.204, SD = 2.637). The effect size was negligible, the overlapping index was big (0.825), and the separation index was small (0.175).
Experience
The group of health professionals who worked in the COVID-19 ward reported a more positive experience (mean = 73.750, SD = 21.137) than the other group (mean = 52.647, SD = 22.537). The difference was statistically significant [t(64) = −3.925, g = 0.954, p < 0.001), and the effect size was big. The overlapping and the separation indexes were moderate at 0.494 and 0.506, respectively.
Overall, in Study 2, higher psychological distress was associated with lower esteem (r = −0.33, p < 0.008) as well as with lower resilient coping (r = −0.34, p < 0.006). Moreover, higher esteem was associated with a more positive appreciation of work experience (r = 0.65, p < 0.001) and with resilient coping strategies (r = 0.50, p < 0.001).
Discussions
This two-step research aimed to develop a new questionnaire to evaluate the psychological impact of COVID-19 on health professionals and compare the psychological experience of those who worked in the dedicated ward to those who continued working in ordinary departments.
According to Study 1, the EGA showed how the CPI-HP items constitute two well-distinct but correlated dimensions: psychological distress and esteem. Then, the EGA results were confirmed by the CFA reporting good fit indexes for the CPI-HP structural validity. The questionnaire showed good psychometric properties, representing a reliable and useful measure of psychological distress and esteem among health professionals. In particular, higher psychological distress was negatively associated with esteem, suggesting the protective role of esteem toward distress as in line with the TMT (Greenberg et al., 1986). Such a tool may be useful in clinical contexts to assess and monitor the health professionals' psychological health, encompassing both the negative and the protective factors.
Consequently, in Study 2, the CPI-HP was administered to assess and explore the psychological impact of COVID-19 on health professionals of a rehabilitation center during the pandemic of 2020. In particular, Study 2 results provided a reliable description and comparison of the psychological experience of health professionals who cared for post-acute patients with COVID-19 since the early phases of the pandemic, also comparing them with a group who did not directly work with patients with a COVID-19 diagnosis. Although all healthcare professionals reported a considerable level of psychological distress during the emergency, those who were not involved in the COVID-19 ward showed perceived lower esteem and lower appreciation of experience than those who worked in the COVID-19 ward.
Moreover, according to the overlap graphs and indexes, the two groups showed different distributions of scores in psychological measures, even if these differences were not evident by observing the means and Hedge's g values only (Pastore and Calcagnı̀, 2019). The measures with the greater differences between groups were found in esteem and positivity of experience—with the COVID-19 group reporting higher values. The distributions of psychological distress were not so different, but a larger part of the COVID-19 group reported lower distress when compared to the non-COVID-19 group whose distress values were more tending to higher scores—suggesting that all healthcare workers faced high distress during the pandemic regardless of the COVID-19 or non-COVID-19 ward. Finally, the two groups showed similar distributions in the resilient coping levels, suggesting its value as a resource for both groups.
Such psychological differences and similarities among the COVID-19 and non-COVID-19 groups should be considered to inform clinical support interventions.
Moreover, the psychological differences among groups may be explained in the light of the following considerations. First, those who worked in the COVID-19 ward perceived safer work conditions consisting of special suits and accessories and more severe hygienic practices, as reported by operators during routine équipe meetings with psychologists. Second, in the COVID-19 ward, a large structured team was constituted and met regularly to share decisions and practices. The members of the team also had a WhatsApp group to support each other. Third, the social acclamation made them feel a sense of heroism that probably contributed to coping better with the stressful aspects of their professional and personal lives. Briefly, being involved in a new, threatening, and challenging experience—so important at an (inter)national level—strengthened the organizational and individual resources.
On the other hand, those who did not work in the COVID-19 ward, although reporting coping resources not different from the other group, also suffered from strong psychological distress and reported a more negative work experience, together with less perceived esteem. These results may be due to the different organization of the non-COVID-19 ward where the individual protection devices (IPDs) were simpler and where people could not constitute a new group of work, regularly sharing decisions about practices and feelings. Moreover, they were not part of a highly socially celebrated work context, despite being recognized as heroes triggered both positive and ambivalent reactions (Hennekam et al., 2020).
Regarding the clinical meaning of these findings, it is likely that the work team with the higher group identification and esteem could also appreciate more a problematic experience despite the distress. Maybe distress would have been higher without these positive resources. According to the TMT (Pyszczynski et al., 2004), dangerous situations (i.e., COVID-19 emergency) generate distress that can be buffered through (self-)esteem that is rooted in one's role in society, work, and purpose in life. It is worth noting that all these aspects were salient for healthcare workers during the emergency. Moreover, recent literature showed that meaning in life can be found in work-related aspects, especially in traumatic and emergency situations as the COVID-19 pandemic (Nowicki et al., 2020). In a nutshell, feeling important and perceiving to have a meaningful role in society may have strengthened the esteem and the appreciation of the experience.
Some limitations can be acknowledged in the present work. Although sufficient to correctly estimate statistical parameters, future studies could increase the sample size to obtain even more robust results. Moreover, these studies were conducted in a single COVID-19 rehabilitation center; future studies could test the generalizability of these results to other circumstances (e.g., other infective diseases).
Although most of the literature highlighted the negative impact of COVID-19 for health professionals (Benfante et al., 2020; Pappa et al., 2020), this study is one of the few trying to also consider the positive and protective factors as esteem, resilient coping, and the positivity of the experience (Rieckert et al., 2021). Recent studies also showed that the COVID-19 pandemic implied a severe psychological burden for health workers, but also COVID-19 patients and caregivers and the general population as well (Bruno et al., 2020; Nese et al., 2020; Panzeri and Rossi Ferrario, 2020; Parola et al., 2020; Que et al., 2020; Rossi Ferrario et al., 2021). Despite this fact, a significant number of people avoided seeking social support and/or professional psychological help (Ratti et al., 2017; Rossi and Mannarini, 2019), probably due to the associated social and personal stigma (Mannarini et al., 2018, 2020; Mannarini and Rossi, 2019). Thus, large-scale psychological and social interventions should support individuals in these challenging circumstances.
Future research will deepen psychological reactions to stressful situations and evaluate the effectiveness of psychological interventions to promote functional psychological adaptation and resilience.
Conclusions
Based on these findings, it is important to assess and monitor the psychological health of healthcare professionals in stressful circumstances as the COVID-19 pandemic, and the CPI-HP is proposed as a good tool to do so. Psychological screening programs should identify those operators who show a higher risk of (acute) stress reactions. Healthcare workers operating in either COVID-19 or non-COVID-19 wards similarly suffered from psychological distress, suggesting that timely psychological interventions should support them to reduce discomfort and symptoms. At the same time, resources to strengthen may include resilient coping processes and esteem.
Data Availability Statement
The datasets presented in this article are not readily available because restrictions apply to the availability of this data to guarantee the respondents privacy. Requests to access the datasets should be directed to the corresponding author.
Ethics Statement
The studies involving human participants were reviewed and approved by Scientific Reasearch Direction of the Scientific and Clinical Research Institute of Veruno, Maugeri Institutes. The participants provided their written informed consent to participate in this study.
Author Contributions
AP did the analysis and interpretation of data. AP and SR participate in drafting the article. All authors made substantial contributions to conception and design, acquisition of data, revised the article critically for important intellectual content, and give final approval of the version to be submitted and any revised version.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
Anderson, D. (2020). esvis: Visualization and Estimation of Effect Sizes. R package version 0.3.1. Available online at: https://CRAN.R-project.org/package=esvis
Benfante, A., Di Tella, M., Romeo, A., and Castelli, L. (2020). Traumatic stress in healthcare workers during COVID-19 pandemic: a review of the immediate impact. Front. Psychol. 11:569935. doi: 10.3389/fpsyg.2020.569935
Brown, T. A. (2015). Confirmatory Factor Analysis for Applied Research. New York, NY: The Guilford Press.
Bruno, G., Panzeri, A., Granziol, U., Alivernini, F., Chirico, A., Galli, F., et al. (2020). The Italian COVID-19 psychological research consortium (IT C19PRC): general overview and replication of the UK study. J. Clin. Med. 10:52. doi: 10.3390/jcm10010052
Chandrasekaran, V., Parrilo, P. A., and Willsky, A. S. (2012). Latent variable graphical model selection via convex optimization. Ann. Statist. 40, 1935–1967. doi: 10.1214/11-AOS949
Chen, R., Sun, C., Chen, J.-J., Jen, H.-J., Linda Kang, X., Kao, C.-C., et al. (2020). A large-scale survey on trauma, burnout, and posttraumatic growth among nurses during the COVID-19 pandemic. Int. J. Ment. Health Nurs. 30, 102–116. doi: 10.1111/inm.12796
Chiorri, C. (2011). Teoria e Tecnica Psicometrica. Costruire un Test Psicologico—Carlo Chiorri—Libro—McGraw-Hill Education–College IBS. New York, NY: McGraw-Hill Companies.
Christensen, A. P., and Golino, H. F. (2020). On the Equivalency of Factor and Network Loadings. PsyArXiv. doi: 10.31234/osf.io/xakez
Cohen, J. (1988). Statistical Power Analysis for the Behavioral Sciences. Hilsdale: Lawrence Earlbaum Associates.
Consoli, S., Rossi, A., Thompson, L. Y., Volpi, C., Mannarini, S., Castelnuovo, G., et al. (2020). Assessing psychometric properties of the italian version of the heartland forgiveness scale. Front. Psychol. 11:596501. doi: 10.3389/fpsyg.2020.596501
Costantini, G., Epskamp, S., Borsboom, D., Perugini, M., Mõttus, R., Waldorp, L. J., et al. (2015). State of the aRt personality research: a tutorial on network analysis of personality data in R. J. Res. Person. 54, 13–29. doi: 10.1016/j.jrp.2014.07.003
Di Tella, M., Romeo, A., Benfante, A., and Castelli, L. (2020). Mental health of healthcare workers during the COVID-19 pandemic in Italy. J. Evaluat. Clin. Pract. 26, 1583–1587. doi: 10.1111/jep.13444
Dioscoridi, L., and Carrisi, C. (2020). COVID-19 exposure risk for family members of healthcare workers: an observational study. Int. J. Infect. Dis. 98, 287–289. doi: 10.1016/j.ijid.2020.06.106
Epskamp, S., Borsboom, D., and Fried, E. I. (2018). Estimating psychological networks and their accuracy: a tutorial paper. Behav. Res. Methods 50, 195–212. doi: 10.3758/s13428-017-0862-1
Epskamp, S., Rhemtulla, M., and Borsboom, D. (2017). Generalized network psychometrics: combining network and latent variable models. Psychometrika 82, 904–927. doi: 10.1007/s11336-017-9557-x
Giuntoli, L., Marchetti, I., Panzeri, A., Spoto, A., Vidotto, G., and Caudek, C. (2019). Measuring cognitive vulnerability to depression: further evidence on the factorial and predictive validity of negative cognitive style. J. Behav. Ther. Exp. Psychiatry 65:101479. doi: 10.1016/j.jbtep.2019.04.005
Giuntoli, L., and Vidotto, G. (2020). Exploring diener's multidimensional conceptualization of well-being through network psychometrics. Psychol. Rep. 124, 896–919. doi: 10.1177/0033294120916864
Golino, H. F., and Christensen, A. P. (2020). EGAnet: Exploratory Graph Analysis - A Framework for Estimating the Number of Dimensions in Multivariate Data Using Network Psychometrics. R package version 0.9.7. Available online at: https://cran.r-project.org/package=EGAnet
Golino, H. F., and Epskamp, S. (2017). Exploratory graph analysis: a new approach for estimating the number of dimensions in psychological research. PLoS ONE 12:e0174035. doi: 10.1371/journal.pone.0174035
Greenberg, J., Pyszczynski, T., and Solomon, S. (1986). “The causes and consequences of a need for self-esteem: a terror management theory,” in Public Self and Private Self (New York, NY: Springer New York), 189–212. doi: 10.1007/978-1-4613-9564-5_10
Greenberg, J., Solomon, S., Pyszczynski, T., Rosenblatt, A., Burling, J., Lyon, D., et al. (1992). Why do people need self-esteem? Converging evidence that self-esteem serves an anxiety-buffering function. J. Person. Soc. Psychol. 63, 913–922. doi: 10.1037/0022-3514.63.6.913
Haslbeck, J. M. B., and Waldorp, L. J. (2020). mgm: estimating time-varying mixed graphical models in high-dimensional data. J. Stat. Softw. 93, 1–46. doi: 10.18637/jss.v093.i08
Hedge's, L. V. (1981). Distribution theory for glass's estimator of effect size and related estimators. J. Educ. Stat. 6, 107–128. doi: 10.3102/10769986006002107
Hennekam, S., Ladge, J., and Shymko, Y. (2020). From zero to hero: an exploratory study examining sudden hero status among nonphysician health care workers during the covid-19 pandemic. J. Appl. Psychol. 105, 1088–1100. doi: 10.1037/apl0000832
Hu, L. T., and Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct. Equat. Model. 6, 1–55. doi: 10.1080/10705519909540118
Huberty, C. J., and Lowman, L. L. (2000). Group overlap as a basis for effect size. Educ. Psychol. Measure. 60, 543–563. doi: 10.1177/0013164400604004
Kelloway, E. K. (2015). Using Mplus for Structural Equation Modeling: A Researcher's Guide. New York, NY: Sage Publications.
Kline, R. B. (2016). Principles and Practice of Structural Equation Modeling. New York, NY: The Guilford Press.
Kocalevent, R. D., Zenger, M., Hinz, A., Klapp, B., and Brähler, E. (2017). Resilient coping in the general population: standardization of the brief resilient coping scale (BRCS). Health Qual. Life Outcomes 15, 1–8. doi: 10.1186/s12955-017-0822-6
Lionetti, F., Keijsers, L., Dellagiulia, A., and Pastore, M. (2016). Evidence of factorial validity of parental knowledge, control and solicitation, and adolescent disclosure scales: when the ordered nature of Likert scales matters. Front. Psychol. 7:941. doi: 10.3389/fpsyg.2016.00941
Mair, P. (2018). Modern Psychometrics With R. New York, NY: Springer International Publishing. doi: 10.1007/978-3-319-93177-7
Mannarini, S., Boffo, M., Rossi, A., and Balottin, L. (2018). Etiological beliefs, treatments, stigmatizing attitudes towards schizophrenia. What do Italians and Israeli think? Front. Psychol. 8:2289. doi: 10.3389/fpsyg.2017.02289
Mannarini, S., and Rossi, A. (2019). Assessing mental illness stigma: a complex issue. Front. Psychol. 9:2722. doi: 10.3389/fpsyg.2018.02722
Mannarini, S., Rossi, A., and Munari, C. (2020). How do education and experience with mental illness interact with causal beliefs, eligible treatments and stigmatising attitudes towards schizophrenia? A comparison between mental health professionals, psychology students, relatives and patients. BMC Psychiatry 20:11. doi: 10.1186/s12888-020-02580-6
Manzoni, G. M., Rossi, A., Pietrabissa, G., Mannarini, S., Fabbricatore, M., Imperatori, C., et al. (2021). Structural validity, measurement invariance, reliability and diagnostic accuracy of the Italian version of the yale food addiction scale 2.0 in patients with severe obesity and the general population. Eat. Weight Disord. 26, 345–366. doi: 10.1007/s40519-020-00858-y
Marchetti, I. (2019). Hopelessness: a network analysis. Cogn. Ther. Res. 43, 611–619. doi: 10.1007/s10608-018-9981-y
Marsh, H. W., Balla, J. R., and McDonald, R. P. (1988). Goodness-of-fit indexes in confirmatory factor analysis: the effect of sample size. Psychol. Bull. 103, 391–410. doi: 10.1037/0033-2909.103.3.391
Milavic, B., Padulo, J., Grgantov, Z., Milic, M., Mannarini, S., Manzoni, G. M., et al. (2019). Development and factorial validity of the psychological skills inventory for sports, youth version - short form: assessment of the psychometric properties. PLoS ONE 14:e0220930. doi: 10.1371/journal.pone.0220930
Mullarkey, M. C., Marchetti, I., and Beevers, C. G. (2019). Using network analysis to identify central symptoms of adolescent depression. J. Clin. Child Adolesc. Psychol. 48, 656–668. doi: 10.1080/15374416.2018.1437735
Mullarkey, M. C., Marchetti, I., Bluth, K., Carlson, C. L., Shumake, J., and Beevers, C. G. (2018). Symptom centrality and infrequency of endorsement identify adolescent depression symptoms more strongly associated with life satisfaction. PsyArXiv. doi: 10.31234/osf.io/79hcj
Nese, M., Riboli, G., Brighetti, G., Sassi, V., Camela, E., Caselli, G., et al. (2020). Delay discounting of compliance with containment measures during the COVID-19 outbreak: a survey of the Italian population. J. Public Health. 1–9. doi: 10.1007/s10389-020-01317-9
Nowicki, G. J., Slusarska, B., Tucholska, K., Naylor, K., Chrzan-Rodak, A., and Niedorys, B. (2020). The severity of traumatic stress associated with covid-19 pandemic, perception of support, sense of security, and sense of meaning in life among nurses: research protocol and preliminary results from Poland. Int. J. Environ. Res. Public Health 17:6491. doi: 10.3390/ijerph17186491
Panzeri, A., and Rossi Ferrario, S. (2020). “Supporting rehabilitation patients with COVID-19 during the pandemic: Experiences from a technology-based psychological approach,” in CEUR Workshop Proceedings: Second Symposium on Psychology-Based Technologies - Psychobit. Naples.
Pappa, S., Ntella, V., Giannakas, T., Giannakoulis, V. G., Papoutsi, E., and Katsaounou, P. (2020). Prevalence of depression, anxiety, and insomnia among healthcare workers during the COVID-19 pandemic: a systematic review and meta-analysis. Brain Behav. Immun. 88, 901–907. doi: 10.1016/j.bbi.2020.05.026
Parola, A., Rossi, A., Tessitore, F., Troisi, G., and Mannarini, S. (2020). Mental health through the COVID-19 quarantine: a growth curve analysis on italian young adults. Front. Psychol. 11:567484. doi: 10.3389/fpsyg.2020.567484
Pastore, M., and Calcagnì, A. (2019). Measuring distribution similarities between samples: a distribution-free overlapping index. Front. Psychol. 10:1089. doi: 10.3389/fpsyg.2019.01089
Pietrabissa, G., Rossi, A., Borrello, M., Manzoni, G. M., Mannarini, S., Castelnuovo, G., et al. (2020a). Development and validation of a self-determination theory-based measure of motivation to exercise and diet in children. Front. Psychol. 11:1299. doi: 10.3389/fpsyg.2020.01299
Pietrabissa, G., Rossi, A., Simpson, S., Tagliagambe, A., Bertuzzi, V., Volpi, C., et al. (2020b). Evaluation of the reliability and validity of the Italian version of the schema mode inventory for eating disorders: short form for adults with dysfunctional eating behaviors. Eat. Weight Disord. 25, 553–565. doi: 10.1007/s40519-019-00644-5
Pons, P., and Latapy, M. (2006). Computing communities in large networks using random walks. J. Graph Algorith. Applicat. 10, 191–218. doi: 10.7155/jgaa.00124
Pyszczynski, T., Solomon, S., Greenberg, J., Arndt, J., and Schimel, J. (2004). Why do people need self-esteem? A theoretical and empirical review. Psychol. Bull. 130, 435–468. doi: 10.1037/0033-2909.130.3.435
Que, J., Shi, L., Deng, J., Liu, J., Zhang, L., Wu, S., et al. (2020). Psychological impact of the covid-19 pandemic on healthcare workers: a cross-sectional study in China. Gen. Psychiatry. 33:100259. doi: 10.1136/gpsych-2020-100259
R Core Team (2017). R: A Language and Environment for Statistical Computing. Vienna: R Foundation for Statistical Computing. Available online at: http://www.R-project.org/
Ratti, M. M., Rossi, A., Delli Zotti, G. B., Sarno, L., and Spotti, D. (2017). Social support, psychological distress and depression in hemodialysis patients. Psicol. Della Salute 1, 112–122. doi: 10.3280/PDS2017-001006
Revelle, W. (2018). “psych: Procedures for Personality and Psychological Research”. Northwestern University, Evanston, Illinois, USA.
Rieckert, A., Schuit, E., Bleijenberg, N., Ten Cate, D., de Lange, W., de Man-van Ginkel, J. M., et al. (2021). How can we build and maintain the resilience of our health care professionals during COVID-19? Recommendations based on a scoping review. BMJ Open 11:e043718. doi: 10.1136/bmjopen-2020-043718
Rosseel, Y. (2012). lavaan: an R package for structural equation modeling. J. Stat. Softw. 48, 1–36. doi: 10.18637/jss.v048.i02
Rossi Ferrario, S., Panzeri, A., Cerutti, P., and Sacco, D. (2021). The psychological experience and intervention in post-acute COVID-19 inpatients. Neuropsychiatric Dis. Treat. 17, 413–422. doi: 10.2147/NDT.S283558
Rossi, A., Gearhardt, A. N., Castelnuovo, G., and Mannarini, S. (2020b). “Different methods of assessment, food addiction, emotional eating, and binge eating behaviors: comparing the total model effects of sequential mediation analysis,” in CEUR Workshop Proceedings Psychobit. Naples.
Rossi, A., and Mannarini, S. (2019). The Italian version of the attitudes toward seeking professional psychological help scale – short form: the first contribution to measurement invariance. TPM Test. Psychometr. Methodol. Appl. Psychol. 26, 93–100. doi: 10.1037/t71943-000
Rossi, A., Panzeri, A., Pietrabissa, G., Manzoni, G. M., Castelnuovo, G., and Mannarini, S. (2020a). The anxiety-buffer hypothesis in the time of Covid-19: when self-esteem protects from loneliness and fear to anxiety and depression. Front. Psychol. 11:2177. doi: 10.3389/fpsyg.2020.02177
Simpson, S. G., Pietrabissa, G., Rossi, A., Seychell, T., Manzoni, G. M., Munro, C., et al. (2018). Factorial structure and preliminary validation of the schema mode inventory for eating disorders (SMI-ED). Front. Psychol. 9:600. doi: 10.3389/fpsyg.2018.00600
Sinclair, V. G., and Wallston, K. A. (2004). The development and psychometric evaluation of the brief resilient coping scale. Assessment 11, 94–101. doi: 10.1177/1073191103258144
Spoorthy, M. S. (2020). Mental health problems faced by healthcare workers due to the COVID-19 pandemic–a review. Asian J. Psychiatry 51, 102–119. doi: 10.1016/j.ajp.2020.102119
Tajfel, H., and Turner, J. C. (1986). “The social identity theory of intergroup behavior,” in Psychology of Intergroup Relation, eds S. Worchel, and W. G. Austin (Chicago: Hall Publishers), 7–24.
Vagni, M., Maiorano, T., Giostra, V., and Pajardi, D. (2020). Coping with COVID-19: emergency stress, secondary trauma and self-efficacy in healthcare and emergency workers in Italy. Front. Psychol. 11:566912. doi: 10.3389/fpsyg.2020.566912
van de Schoot, R., Lugtig, P., and Hox, J. (2012). A checklist for testing measurement invariance. Euro. J. Dev. Psychol. 9, 486–492. doi: 10.1080/17405629.2012.686740
Wen, Z., and Fan, X. (2015). Monotonicity of effect sizes: questioning kappa-squared as mediation effect size measure. Psychol. Methods 20, 193–203. doi: 10.1037/met0000029
Wickham, H. (2016). ggplot2: Elegant Graphics for Data Analysis. New York, NY: Springer-Verlag. doi: 10.1007/978-3-319-24277-4
Appendix
Table A1. Items of the questionnaire.
Keywords: assessment, clinical psychology, distress, esteem, healthcare-workers, rehabilitation, COVID-19
Citation: Panzeri A, Rossi Ferrario S and Cerutti P (2021) Psychological Differences Among Healthcare Workers of a Rehabilitation Institute During the COVID-19 Pandemic: A Two-Step Study. Front. Psychol. 12:636129. doi: 10.3389/fpsyg.2021.636129
Received: 30 November 2020; Accepted: 09 February 2021;
Published: 31 March 2021.
Edited by:
Elena Vegni, University of Milan, ItalyReviewed by:
Roberto Truzoli, University of Milan, ItalyJulia Menichetti, University of Oslo, Norway
Copyright © 2021 Panzeri, Rossi Ferrario and Cerutti. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Anna Panzeri, anna.panzeri@phd.unipd.it