- 1Department of Psychology and Cognitive Science, University of Trento, Rovereto, Italy
- 2Institute of Psychology, Work & Organizational Psychology, University of Duisburg-Essen, Essen, Germany
The COVID-19 pandemic has presented significant challenges to the workforce, particularly concerning emotional and mental well-being. Given the prolonged periods of work-related stress, unexpected organizational changes, and uncertainties about work faced during the pandemic, it becomes imperative to study occupational health constructs under a dynamic methodological perspective, to understand their stable and unstable characteristics better. In this study, drawing on the Dynamic Structural Equation Modeling (DSEM) framework, we used a combination of multilevel AR(1) models, Residual-DSEM (RDSEM), multilevel bivariate VAR(1) models, and multilevel location-scale models to investigate the autoregression, trend, and (residual) cross-lagged relationships between emotional exhaustion (EmEx) and mental well-being (MWB) over the COVID-19 pandemic. Data were collected weekly on 533 workers from Germany (91.18%) and Italy (8.82%) who completed a self-reported battery (total number of observations = 3,946). Consistent with our hypotheses, results were as follows: (a) regarding autoregression, the autoregressive component for both EmEx and MWB was positive and significant, as well as it was their associated between-level variability; (b) regarding trend, over time EmEx significantly increased, while MWB significantly declined, furthermore both changes had a significant between-level variability; (c) regarding the longitudinal bivariate (cross-lagged) relationships, EmEx and MWB negatively and significantly affected each other from week to week, furthermore both cross-lagged relationships showed to have significant between-level variance. Overall, our study pointed attention to the vicious cycle between EmEx and MWB, even after controlling for their autoregressive component and trend, and supported the utility of DSEM in occupational health psychology studies.
Introduction
During the CoronaVirus Disease 19 (COVID-19) pandemic, workers globally experienced significant changes, challenges, and threats to their work sphere. Indeed, research attested that the COVID-19 crisis has intensified issues in several work-related areas, such as work-family interface (Vaziri et al., 2020), job search behavior (McFarland et al., 2020), job engagement (Hu et al., 2020), vocational behavior (Newman et al., 2022), and technostress (in particular in aged population; Nimrod, 2022).
All in all, these findings suggest that, on average, workers’ occupational health and well-being underwent significant changes during the COVID-19 pandemic. However, to our knowledge, no study has empirically tested this assumption using an appropriate methodological framework. Specifically, questions about the direction and variability of this change and the stability of occupational health constructs over a set period (e.g., during the COVID-19 pandemic), necessitate intensive longitudinal data collection and specific multivariate data analysis. Such an approach surpasses the scope of more prevalent cross-sectional or longitudinal designs frequently seen in COVID-19 occupational health studies (e.g., Aymerich et al., 2022).
Indeed, scholars concur that research and practice in industrial and organizational psychology substantially changed after the COVID-19 crisis, as both workers and organizations reframed their approach to phenomena such as (among others) working from home, virtual teamwork, social distancing, stress, job insecurity, unemployment, and career choices (Kniffin et al., 2021; Rudolph et al., 2021). Furthermore, as Shoss (2021) put it, “the COVID-19 pandemic is arguably the most widespread and profound occupational health crisis in modern times” (p. 259) and thus research on occupational health psychology has now the unique opportunity (and responsibility) to “generate ideas that may prove useful for addressing future crises” (p. 259).
Aligned with these observations, in this contribution we underscored the potential of a relatively new methodological framework, namely Dynamic Structural Equation Modeling (DSEM; Asparouhov et al., 2018). We aimed to demonstrate its application in occupational health psychology, emphasizing its utility in unraveling the dynamics of workers’ occupational health variables and their relationship. This approach becomes particularly salient when data is sourced from a period rife with profound changes and challenges, such as the COVID-19 pandemic. In more detail, DSEM integrates Structural Equation Modeling (SEM), time-series analysis, and multilevel modeling into a single comprehensive model (Hamaker et al., 2023). There are various possible specifications of DSEM; nevertheless, its general purpose is the analysis of intensive longitudinal data with the incorporation of autoregressive processes (i.e., how a variable at one time point predicts the same variable at a subsequent time point) and multivariate models (i.e., predicting more variables simultaneously), as well as greater flexibility in the estimation of between- and within-level parameters (e.g., simultaneously estimating and predicting between-level variances of trend in the series, autoregressive effects, and reciprocal effects). Overall, DSEMs are particularly useful when understanding the dynamic interplay between variables over time is relevant. In particular, here we investigated the characteristics of emotional exhaustion, mental well-being, and their relationships in a sample of workers followed across the COVID-19 crisis. In what follows, we describe the application of the DSEM framework to the study of emotional exhaustion and mental well-being, we explained why it is important to study occupational health variables over the COVID-19 pandemic, and we presented in more detail our hypotheses. Finally, more technical details on the DSEM specification we used were presented directly in the Method section.
The DSEM framework applied to the study of emotional exhaustion and mental well-being over the COVID-19 pandemic
Emotional exhaustion is a core component of burnout. It is characterized by symptoms such as difficulties in recovering energy, mental fatigue, and lack of energy, mainly due to work-related causes (e.g., workload; Maslach et al., 2001). On the other side, mental (or psychological) well-being (or health) is a broad construct that – according to the World Health Organization – is characterized by a state “in which the individual realizes his or her abilities, can cope with the normal stresses of life, can work productively and fruitfully, and can make a contribution to his or her community” (Fusar-Poli et al., 2020, p. 41).
In this contribution, the application of the DSEM framework to the study of emotional exhaustion, mental well-being, and their relationship has a three-fold aim. This three-fold aim is mostly rooted in the importance of properly disentangling variance at both within- and between-level (Hamaker, 2012; Hamaker et al., 2015), as it is of particular interest in recent organizational literature (Podsakoff et al., 2019; McCormick et al., 2020; Zyphur et al., 2020a,b; Hofmans et al., 2021).
First, we aimed to investigate the degree of autoregression over the COVID-19 pandemic of emotional exhaustion and mental well-being. According to research on state–trait models (Steyer et al., 2015), psychological constructs (even those considered essentially stable) have a significant degree of both stability and changeability. This means that taking into account the stability of a construct is the first step for probing its development over time (Prenoveau, 2016; Castro-Alvarez et al., 2022; Stadtbaeumer et al., in press). Thus, we hypothesize that both emotional exhaustion and mental well-being should show a significant size of autoregression (H1). Also, we hypothesized that these autoregressive components can have a substantial between-level variability, which means that people may differ in the stability (or inertia or carry-over effect) of emotional exhaustion and mental well-being (H1a). In the framework of DSEM, these hypotheses may be investigated using a multilevel AR(1) model. This model is a combination of time-series analysis, multilevel modeling, and SEM (Hamaker et al., 2023), which allows us to investigate the degree to which a variable at time t – 1 affects itself over time (i.e., at time t), and also allows to investigate the degree of between-level variance of this parameter (McNeish and Hamaker, 2020).
Second, according to the Conservation of Resources (COR) theory, the challenges posed by the COVID-19 pandemic may have significantly depleted workers’ resources, thus creating feelings of discomfort and exacerbating stress over time (Hobfoll et al., 2018). Hence, we hypothesized a significant mean-level increase in emotional exhaustion and a significant mean-level decrease in mental well-being over the course of the COVID-19 pandemic (H2). Also, we hypothesized that this mean-level change may significantly vary at the between-level, which means that people may differ in the way they change over time in the two constructs (H2a). In the framework of DSEM, these hypotheses may be investigated using a Residual DSEM (RDSEM) with a linear trend (McNeish and Hamaker, 2020).
Third, after taking into consideration the above unconditional characteristics (i.e., autoregression and trend) and sources of within- vs. between-level variance, we aimed to deepen our understanding of the relationship between emotional exhaustion and mental well-being. Indeed, the relationship between emotional exhaustion and mental well-being is attested to be negative by different researchers (Wang and Li, 2015; Jeon et al., 2018), however, there are no studies investigating the direction of the effect over time, or, simply put, the cross-lagged effect exerted on each other (i.e., the effect exerted by a construct x at time t – 1 on the construct y at time t, and vice versa, after controlling for the stability of both). In this sense, there are three scenarios: The first provides that one exerts a significant (and negative) cross-lagged effect on the other, but not vice versa; the second provides that no one exerts a significant cross-lagged effect on the other, thus leaving significant only the autoregressive effects; the third provides that both significantly (and negatively) exert a cross-lagged effect on the other. We hypothesized the third scenario (H3) in which there is a mutually significant and negative relationship between emotional exhaustion and mental well-being, given the recent findings on the strict relationship between burnout and clinical/health phenomena (Bianchi et al., 2015, 2019, 2021). Also, we hypothesize that the cross-lagged effect exerted by emotional exhaustion on mental well-being has a significant between-level variance (H3a) and that the cross-lagged effect exerted by mental well-being on emotional exhaustion has a significant between-level variance (H3b). In the framework of DSEM, these hypotheses may be investigated using a revised and combined version of the RDSEM, multilevel AR(1) model, multilevel bivariate VAR(1) model, and multilevel location-scale model (Asparouhov et al., 2018; Hamaker et al., 2018, 2023; McNeish and Hamaker, 2020; McNeish, 2021).
The present study
To summarize, to advance literature on occupational health psychology and respond to the previously cited call by Shoss (2021), we adopted a substantive-methodological synergy (Hofmans et al., 2021) to investigate (a) the degree of stability (autoregression), (b) the development over time (trend), (c) the mutual relationship (cross-lagged), and (d) their degree of between-level variability of two widely-studied constructs in occupational health psychology (namely, emotional exhaustion and mental well-being) using one of the most advanced latent variable framework available in psychological methods literature, that is DSEM (Asparouhov et al., 2018). Also, differently from the previous application of (R)DSEM (e.g., Hamaker et al., 2018), we provided a parametrization in which autoregression, trends, and cross-lagged relationships are estimated in a unique multivariate model.
Method
Participants and procedure
Participants were recruited through various methods, including social media outreach, survey dissemination, and snowball sampling technique. The aim of the project (titled “Working in Time of Crisis”) was to assess and study several work-related variables during the COVID-19 pandemic. The study received a positive evaluation from the Ethics Committee of the Institute of Psychology of the University of Duisburg-Essen. All the self-reports used in the survey were gathered from scales widely validated in the international literature (such as the Burnout Assessment Tool and the 5-item World Health Organization Well-Being Index for measuring emotional exhaustion and mental well-being, respectively). The survey took place approximately from the end of March 2020 to May 2021. The research design adopted was that of intensive studies: Each week the subjects who voluntarily took part in the study received an email containing a link that directed to the compilation of the battery. After reading the information about the study and consenting via a confirmation form, participants could register using their email address. A link to the survey was then sent to their email. The survey began by collecting demographic and job-related details. Subsequent sections delved into their working conditions, their experiences amid the COVID-19 situation, and their overall well-being. Updates were conducted weekly. At the start of each survey, participants were queried about their work in the preceding week and if any work-related changes had occurred. If there were no job-related alterations, the section surveying working conditions was skipped. If participants missed surveys, reminders were sporadically sent (a maximum of five times). In all invitations and reminders, the option to withdraw from the study was consistently presented.
At the end of the survey, data was collected on 753 workers. However, in subsequent data analysis, we filtered the dataset excluding those who filled less than three waves (i.e., we removed 125 subjects who filled one wave and 94 subjects who filled two waves) and two participants who declared not to work in Germany or Italy. Thus, the final sample consisted of 533 subjects. The count of participants by waves completed is reported in Table 1. The total number of observations is 3,946. The first collection is dated March 24, 2020, while the last is dated March 23, 2021. Regarding nationality, 486 (91.18%) were German while 47 (8.82%) were Italian. Regarding gender, 382 (71.67%) were females and 151 (28.33%) were males. Age ranged from 18 to 70 (M = 41.09, SD = 12.63), and tenure in the current work role ranged from 0 to 44 years (M = 8.69, SD = 9.61).
Measures
Emotional exhaustion
Emotional exhaustion was assessed using three items gathered from the Burnout Assessment Tool (BAT; Schaufeli et al., 2020). The introduction to the scale reads “The following statements are related to your work condition and how you experience this condition. Please state how often each statement applies to you.” The three items used were “At work, I feel mentally exhausted,” “After a day at work, I find it hard to recover my energy,” and “When I get up in the morning, I lack the energy to start a new day at work.” Items were rated by participants using a 5-point Likert scale ranging from 1 (“Never”) to 5 (“Always”).
Mental well-being
Mental well-being was assessed using the 5-item World Health Organization Well-Being Index (WHO-5) (World Health Organization, 1998). The WHO-5 is among the most widely used tools assessing subjective psychological well-being and it is translated in more than 30 countries (see Topp et al., 2015). The introduction to the scale reads “Please indicate for each of the five statements which is the closest one to how you have been feeling over the last week. Notice that higher numbers mean better well-being. Over the last week….” The five items were “I have felt cheerful and in good spirits,” “I have felt calm and relaxed,” “I have felt active and vigorous,” “I woke up feeling fresh and rested,” and “My daily life has been filled with things that interest me.” Items were rated by participants using a 6-point Likert scale ranging from 0 (“At no time”) to 5 (“All of the time”).
Data analytic strategy
Data wrangling and reliability analysis were conducted using the statistical open-source software R (Version 4.2.1; R Core Team, 2022). First, the time variable was mutated to have the first occasion equal to zero. Second, we built composite scores for emotional exhaustion and mental well-being by averaging their items, to have a single composite score for each construct. Third, we used the multilevel.reliability function from the psych package (Revelle, 2022) for computing two commonly used reliability indices for multi-item instruments assessed in intensive longitudinal data (Shrout and Lane, 2012; Bolger and Laurenceau, 2013; Revelle and Wilt, 2019): The RkF, which assesses reliability at the between-level, and the reliability of change (Rc), which assesses reliability at the within-level.
Data analyses were conducted with Mplus Version 8.4 (Muthén and Muthén, 1998–2017).
To test our hypotheses, we used a series of competing Dynamic Structural Equation Models (DSEM). In accordance with methodological literature on DSEM (Asparouhov et al., 2018; Hamaker et al., 2018, 2023; Asparouhov and Muthén, 2020; McNeish and Hamaker, 2020; Wang and Wang, 2020; Geiser, 2021; Zhou et al., 2021), in all models (a) we used a Bayesian estimation method, given that DSEM cannot be estimated with Maximum Likelihood (which is the standard estimation method for SEM),1 (b) each variable was latent group-mean centered (see also Lüdtke et al., 2008), (c) the Deviance Information Criterion (DIC) was used to compare competing models, preferring the model with lowest DIC. In particular, the DIC is used to compare the significance of the between-level variance, given that Bayesian credible intervals cannot return the value of 0 for a variance (see McNeish and Hamaker, 2020). We performed three types of models, that were described in more detail below.
Autoregression and associated between-level variability (M1 and M1a)
In the first step, we estimated a Multilevel AR(1) Model (see McNeish and Hamaker, 2020). It was performed to estimate the autoregression of emotional exhaustion and mental well-being, as well as its person-level variability. In this model (M1), at the within-level we estimated the effect exerted by the variable at t – 1 on the variable at the subsequent time-point. This parameter () as well as the intercept () were allowed to vary at the between-level part of the model, so that it was possible to estimate the mean () and the variance () of the intercept, and the mean () and the variance () of the slope. More formally, if we label emotional exhaustion or mental well-being with y, time with t, the individual with i, and the latent group-mean centering with the superscript c, then this model is represented by the following equations:
Where , , and .
In a subsequent version of these models (M1a), we fixed the variance of the autoregression (i.e., ) to a close-to-be zero value (0.001), and compared the two models using the DIC. For both emotional exhaustion and mental well-being, we expect the autoregression to be positive and significant (H1) and the DIC of M1 to be lower than the DIC of M1a (H1a), thus attesting that the variance should be not close to zero.
Trend in the series (M2 and M2a)
In the second step, we estimated a Residual DSEM (RDSEM), in which we added the effect of time on emotional exhaustion and mental well-being (M2).
The main aim of this model is to attest whether over time there is a significant increase in emotional exhaustion and a significant decrease in mental well-being, and that this change has a significant between-level variance (H2 and H2a). Furthermore, in this model, the RDSEM specification “allows for modeling the autoregression on the within-level residuals rather than on the variable itself” (McNeish and Hamaker, 2020, p. 628). In this way, even in the presence of a significant mean-level change, the stationarity assumption – namely the constant expected value over time, or – is satisfied. The equations of this model are:
Where , , , and . Note that the autoregressive effect is no longer included in the equation concerning , but it is instead included in the equation for (i.e., the residual, thus the name RDSEM). Our hypothesis H2 for emotional exhaustion is satisfied if we found to be positive and significant; our hypothesis H2 for mental well-being is satisfied if we found to be negative and significant; finally our hypothesis H2a (for both emotional exhaustion and mental well-being) is satisfied if the model M2 has a lower DIC if compared to the model M2a, in which the variance of the random slope associated to time, , is fixed to be zero.
Cross-lagged effects and between-level variability (M3, M3a, and M3b)
In the third step, we estimated a multivariate model (M3) which included the specification of (a) a Multilevel VAR(1) Model, (b) a RDSEM with trend in the series, and (c) a multilevel location-scale model (see McNeish and Hamaker, 2020). In more detail, here we specified a model in which emotional exhaustion and mental well-being still have their residual autoregression (that here we label and , respectively) and the trend in their series, furthermore we (a) modeled the cross-lagged effect exerted by the residual of emotional exhaustion on the residual of mental well-being (), and computed its between-level mean () and variance (); (b) modeled the cross-lagged effect exerted by the residual of mental well-being on the residual of emotional exhaustion (), and computed its between-level mean () and variance (); (c) estimated the location-scale model by including the between-person variance of within-person residual variance for both emotional exhaustion () and mental well-being (); in this specification, the is replaced with allowing to obtain a between-person variable represented by the natural logarithm of , i.e., , with a mean ω and a variance τ, thus is a function of the exponential of namely, , or , where e represents Euler’s number (approximatively 2.7182). A graphical representation of the model is provided in Figure 1.
FIGURE 1. M3: Multilevl Bivariate VAR(1) Model, Superscript c = Latent group-mean centered variable; superscript n = raw, non-centered version of the variable; subscript i = individual; subscript t = time. The mean and variance of Timet at within-level ( and , respectively) are estimated because required by Mplus. Black dots at the center of the arrows represent random parameters.
The equations are reported below; note that we used EmEx and MWB to abbreviate emotional exhaustion and mental well-being, respectively.
To support our hypothesis H3, we expect that (a) the cross-lagged effect of (residual) emotional exhaustion on (residual) mental well-being () is negative and significant as well as (b) the cross-lagged effect of (residual) mental well-being on (residual) emotional exhaustion () is negative and significant. To support our hypotheses H3a and H3b we expect that model M3 has a lower DIC (i.e., it is preferred) if compared to models in which we constrained to a close-to-zero value the variance of the cross-lagged paths, hence we expect that constraining (M3a) and (M3b) to 0.001 would worsen the model.
In the Supplementary material, we provide all Mplus syntaxes, accompanied by annotated comments on the parameters reported above.
Results
Reliability analysis
The analysis of multilevel reliability returned satisfactory results. Indeed, at the between-level, the RkF was 0.98 and 0.99 for emotional exhaustion and mental well-being, respectively; at the within-level, the Rc was 0.68 and 0.82 for emotional exhaustion and mental well-being, respectively.
Autoregression and associated between-level variability (M1 and M1a)
Emotional exhaustion
The autoregression effect of emotional exhaustion was positive and significant (= 0.32, 95%CI = 0.261, 0.377) and also showed a significant between-level variance (= 0.106, 95%CI = 0.08, 0.137). Furthermore, constraining the variance to be close to zero (M1a) increased the DIC of the model (see Table 2). Thus, our hypotheses H1 and H1a were both supported for emotional exhaustion.
Mental well-being
The autoregression effect of mental well-being was positive and significant (= 0.376, 95%CI = 0.31, 0.435) and also showed a significant between-level variance (= 0.099, 95%CI = 0.069, 0.135). Furthermore, constraining the variance to be close to zero (M1a) increased the DIC of the model (see Table 2). Thus, our hypotheses H1 and H1a were both supported for mental well-being.
Trend in the series (M2 and M2a)
Emotional exhaustion
Results showed that emotional exhaustion, on average, significantly increased across time (= 0.014, 95%CI = 0.006, 0.027), and also showed a significant between-level variance of this trend (= 0.003, 95%CI = 0.002, 0.004). Furthermore, constraining the variance to be close to zero (M2a) increased the DIC of the model (see Table 2). Thus, our hypotheses H2 and H2a were both supported for emotional exhaustion.
Mental well-being
Results showed that mental well-being, on average, significantly decreased across time (= −0.014, 95%CI = −0.026, −0.002), and also showed a significant between-level variance of this trend (= 0.006, 95%CI = 0.004, 0.008). Furthermore, constraining the variance to be close to zero (M2a) increased the DIC of the model (see Table 2). Thus, our hypotheses H2 and H2a were both supported for mental well-being.
Cross-lagged effects and between-level variability (M3, M3a, and M3b)
Results from M3 showed that (a) the cross-lagged effect of (residual) emotional exhaustion on (residual) mental well-being was negative and significant (= −0.206, 95%CI = −0.265, −0.136); (b) the cross-lagged effect of (residual) mental well-being on (residual) emotional exhaustion is negative and significant (= −0.198, 95%CI = −0.236, −0.164); (c) that the model M3 had a lower DIC (i.e., it is preferred) if compared to models in which we constrained to a close-to-zero value the variance of the cross-lagged paths: This means that constraining (M3a) and (M3b) to 0.001 worsened the model (see Table 2). Thus, H3, H3a, and H3b were all supported. All the parameters estimated in M3 are reported in Table 3.
In Table 4, we reported the explained variance (expressed as the within-level R2 averaged across clusters) for emotional exhaustion and mental well-being for each model (i.e., M1, M2, and M3).
Discussion
The present contribution applied the DSEM framework to the study of some dynamic characteristics regarding emotional exhaustion, mental well-being, and their relationship over the COVID-19 pandemic. In particular, this contribution investigated (1) autoregression, (2) trend in the series, and (3) cross-lagged relationships for emotional exhaustion and mental well-being, along with their associated between-level variability. In what follows we explained in more detail our findings.
Firstly, according to our first group of hypotheses (H1 and H1a), we found that the autoregression component was significant for both constructs, thus highlighting a certain degree of stability of the constructs. While this finding is not new when we consider all the body of research about Latent State–Trait models and theories (Steyer et al., 2015; Geiser, 2021), it further renews the importance of taking into account autoregression coefficients when studying the relationship of a variable with other ones. This is particularly true in occupational health fields, in which the researcher attempts to find relevant predictors of a phenomenon (e.g., burnout), to enhance the quality of interventions. Yet, when autoregression is not included, estimates may be severely overestimated, given that part of the variance of the outcome could be explained by the stability of the construct (and thus by the construct itself) rather than by other variables. Also, we found that the autoregression path of both variables has a significant between-level variance. This means that the stability (or inertia, or carry-over effect) of emotional exhaustion and mental well-being may change according to some individual’s characteristics; this finding may open interesting issues for future research, such as testing the between-level variability in the stability of other constructs relevant to occupation health, and (most importantly) to find the antecedents and consequences of the degree of stability. From a practical standpoint, people who have a lower degree of stability in emotional exhaustion may have a greater possibility to “break” their burnout symptomatology after organizational or group interventions, while people with a higher level of stability in emotional exhaustion may receive more benefits if the intervention is focused on those personality dispositions that maintain the symptomatology (in this regard, see literature on personality trait change; Roberts et al., 2017; Bleidorn et al., 2019; Wagner et al., 2020). Hence, recognizing the between-level variance in autoregression paths for both emotional exhaustion and mental well-being underscores the need for personalized interventions.
Secondly, according to our second group of hypotheses (H2 and H2a), we supported that over the COVID-19 crisis (a) emotional exhaustion, on average, significantly increased; (b) mental well-being, on average, significantly decreased, and (c) that both those mean-level changes significantly varied across individuals. Thus, the DSEM framework allowed us to properly disentangle the autoregressive effect from the trend, hence obtaining a clearer picture of the development of emotional exhaustion and mental well-being over the COVID-19 pandemic. Again, discovering that individuals vary in their patterns of change in emotional exhaustion and mental well-being could uncover intriguing avenues for future applied research. Indeed, from a practical standpoint, looking for predictors and outcomes of between-level change in occupational health variables (such as the two we explored) may help in better clarifying which constructs may contrast (or enhance) the development of negative (or positive) phenomena. Also, this finding emphasized the need to monitor and assess trends for regular health assessments in workplaces. This can help in early identification and timely interventions, potentially reducing the adverse impacts on employees. Indeed, monitoring trends may reveal periods characterized by collective or individual heightened levels of emotional exhaustion, that thus might be followed by recovery activities and/or recovery experiences (Sonnentag et al., 2022).
Thirdly, while the above findings referred to the unconditional analyses (i.e., we analyzed the two constructs separately), at the conditional (or bivariate) level we parametrize a RDSEM – in more detail a Multilevel Bivariate VAR(1) Model – that allowed to explore the reciprocal longitudinal effect exerted by the two investigated constructs (i.e., emotional exhaustion and mental well-being), after taking into account their degree of autoregression and trend. According to our third group of hypotheses (H3, H3a, and H3b), we found support for the strict relationship between burnout and clinical phenomena (Bianchi et al., 2015, 2019, 2021). Indeed, despite a few portions of variance remain to be explained after controlling for autoregression and trend, the week-by-week effect exerted by emotional exhaustion on mental well-being, as well as the week-by-week effect exerted by mental well-being on emotional exhaustion, proved to be negative and significantly different from zero. Also, both cross-lagged relationships had a significant between-level of variance. Again, from a practical perspective, this between-level finding may open new avenues of research in occupational health psychology, as future studies may investigate the degree of between-level variance in other cross-lagged relationships, as well as probing which individual-level factors may affect the strengths of these cross-lagged relationships. Regarding our study variables, the negative reciprocal effects between emotional exhaustion and mental well-being underscore the need for integrated workplace programs. Such programs should address both emotional exhaustion and mental well-being simultaneously. For example, employee assistance programs could offer counseling services for mental well-being alongside training to manage burnout. This holistic approach reduces the risk of ineffectiveness arising from focusing solely on one aspect, be it emotional exhaustion or mental well-being.
Limitations and future directions
Although the several strengths of this contribution, such as the use of intensive longitudinal data, the use of a novel analytical framework (DSEM), a new specification of RDSEM that allowed us to test our specific hypotheses, and the sufficiently high sample size (if we consider the intensive research design adopted), several limitations should be acknowledged.
First, data analytic strategies related to DSEM are still in early development, and thus we do not know if, in the immediate future, some procedures (such as the model comparison using DIC) may change. Also, the Bayesian estimation method applied to SEM requires some decisions that are not well established (e.g., the choice of the “thinning,” the number of iterations, the number of Markov chains, etc.; see for example, Hamaker et al., 2018; Depaoli, 2021; Geiser, 2021).
Second, we exclusively used self-reported data, hence future studies may adopt other (objective or other reported) measurements of emotional exhaustion and mental well-being.
Third, given the computational demands of the models (all models were run on a desktop computer booked on purpose to the IT office of the Department of Psychology and Cognitive Science at the University of Trento, and the elapsed time was about 6 h) we did not explore either predictors or outcomes or even simple correlations at the between-level; thus, these relations may be investigated in future studies.
Fourth, we collected data exclusively from countries where our research teams were based, namely Germany and Italy, without any other criteria guiding country selection. Also, we concluded data collection in May 2021 due to a notable decline in participant responses to our survey.
Fifth, gender differences were not investigated due to the unbalanced sample (females and males were, respectively, 71.67% and 28.33%) as well as for the Third limitation reported in this paragraph; however, in future studies, our approach allows using gender as a between-level variable for testing hypotheses regarding its effect on the various random slopes and random intercepts (presented in details in this paper) that can be estimated using DSEMs.
Sixth, our DSEMs did not utilize measurement models; instead, emotional exhaustion and mental well-being were gauged by averaging their respective items. Future research might consider incorporating latent variables to (a) control for measurement error and (b) employ measurement invariance routines to verify if scales remain invariant across both time and individuals (Schuurman and Hamaker, 2019; McNeish et al., 2021).
Conclusion
In conclusion, this contribution aimed to show the applicability of the DSEM framework to unravel autoregression, trend, cross-lagged relations, and their associated between-level variance in two of the most studied constructs in the field of occupational health psychology, namely emotional exhaustion and mental well-being. We found support for the importance of studying relationships among occupational health constructs employing the DSEM framework, in particular during a challenging (and full of changes) period such as the COVID-19 pandemic (Shoss, 2021). Indeed, (a) we found a significant increase and decline in emotional exhaustion and mental well-being, respectively; (b) we found the negative week-to-week relationship between emotional exhaustion and mental well-being to be significant even after taking into account autoregressions and trends; (c) we found that autoregressions, trends, and cross-lagged relationships all had a significant degree of between-level variance, and discussed the consequences; and finally, (d) we provided a new specification of RDSEM that offered the possibility to explore cross-lagged relationships. Furthermore, while the primary focus of this contribution is methodological, we highlighted how results have potential applications for workplace interventions and practical strategies. Hence, we hope that this substantive-methodological contribution may advance and stimulate future similar applications in the field of occupational health psychology.
Data availability statement
The original contributions presented in the study are included in the article/Supplementary material, further inquiries can be directed to the corresponding author.
Ethics statement
All procedures involving research study participants were approved by the ethics committee of the Institute of Psychology of the University of Duisburg-Essen. The studies were conducted in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study.
Author contributions
FK and AM contributed to conception and design of the research project. EP conceptualized and drafted the manuscript and conducted all the statistical analyses. MV, FK, AM, and MG collected the data. All authors were involved in the original project, revised, contributed, and approved the submitted version.
Funding
EP was supported by a research fellowship (WeBeWo LAB n. 40600134) granted by the University of Trento and by a Starting Grant for Young Researchers awarded by the University of Trento titled “Big data and machine learning approaches in the workplace: Advancing the quality of industrial/organizational research” (ATENEO_Starting Grant_2021).
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyg.2023.1222845/full#supplementary-material
Footnotes
1. ^More information on Bayesian analysis specifications (e.g., number of iterations, thinning, number of chains) can be found in Mplus syntaxes (under the command ANALYSIS) reported in Supplementary material.
References
Asparouhov, T., Hamaker, E. L., and Muthén, B. (2018). Dynamic structural equation models. Struct. Equ. Model. Multidiscip. J. 25, 359–388. doi: 10.1080/10705511.2017.1406803
Asparouhov, T., and Muthén, B. (2020). Comparison of models for the analysis of intensive longitudinal data. Struct. Equ. Model. Multidiscip. J. 27, 275–297. doi: 10.1080/10705511.2019.1626733
Aymerich, C., Pedruzo, B., Pérez, J. L., Laborda, M., Herrero, J., Blanco, J., et al. (2022). COVID-19 pandemic effects on health worker’s mental health: systematic review and meta-analysis. Eur. Psychiatry 65:e10. doi: 10.1192/j.eurpsy.2022.1
Bianchi, R., Schonfeld, I. S., and Laurent, E. (2015). Burnout–depression overlap: a review. Clin. Psychol. Rev. 36, 28–41. doi: 10.1016/j.cpr.2015.01.004
Bianchi, R., Schonfeld, I. S., and Laurent, E. (2019). Burnout: moving beyond the status quo. Int. J. Stress. Manag. 26, 36–45. doi: 10.1037/str0000088
Bianchi, R., Verkuilen, J., Schonfeld, I. S., Hakanen, J. J., Jansson-Fröjmark, M., Manzano-García, G., et al. (2021). Is burnout a depressive condition? A 14-sample meta-analytic and bifactor analytic study. Clin. Psychol. Sci. 9, 579–597. doi: 10.1177/2167702620979597
Bleidorn, W., Hill, P. L., Back, M. D., Denissen, J. J. A., Hennecke, M., Hopwood, C. J., et al. (2019). The policy relevance of personality traits. Am. Psychol. 74, 1056–1067. doi: 10.1037/amp0000503
Bolger, N., and Laurenceau, J.-P. (2013). Intensive longitudinal methods: an introduction to diary and experience sampling research. New York: Guilford Press.
Castro-Alvarez, S., Tendeiro, J. N., Meijer, R. R., and Bringmann, L. F. (2022). Using structural equation modeling to study traits and states in intensive longitudinal data. Psychol. Methods 27, 17–43. doi: 10.1037/met0000393
Fusar-Poli, P., Salazar de Pablo, G., De Micheli, A., Nieman, D. H., Correll, C. U., Kessing, L. V., et al. (2020). What is good mental health? A scoping review. Eur. Neuropsychopharmacol. 31, 33–46. doi: 10.1016/j.euroneuro.2019.12.105
Geiser, C. (2021). Longitudinal structural equation modeling with Mplus: A latent state-trait perspective. New York: The Guilford Press.
Hamaker, E. L. (2012). “Why researchers should think “within-person”: a paradigmatic rationale” in Handbook of research methods for studying daily life. eds. M. R. Mehl and T. S. Conner. (New York: The Guilford Press), 43–61.
Hamaker, E. L., Asparouhov, T., Brose, A., Schmiedek, F., and Muthén, B. (2018). At the frontiers of modeling intensive longitudinal data: dynamic structural equation models for the affective measurements from the COGITO study. Multivar. Behav. Res. 53, 820–841. doi: 10.1080/00273171.2018.1446819
Hamaker, E. L., Asparouhov, T., and Muthén, B. (2023). “Dynamic structural equation modeling as a combination of time series modeling, multilevel modeling, and structural equation modeling” in Handbook of structural equation modeling. ed. R. H. Hoyle. 2nd ed. (New York: The Guilford Press), 576–596.
Hamaker, E. L., Kuiper, R. M., and Grasman, R. P. P. P. (2015). A critique of the cross-lagged panel model. Psychol. Methods 20, 102–116. doi: 10.1037/a0038889
Hobfoll, S. E., Halbesleben, J., Neveu, J.-P., and Westman, M. (2018). Conservation of resources in the organizational context: the reality of resources and their consequences. Annu. Rev. Organ. Psych. Organ. Behav. 5, 103–128. doi: 10.1146/annurev-orgpsych-032117-104640
Hofmans, J., Morin, A. J. S., Breitsohl, H., Ceulemans, E., Chénard-Poirier, L. A., Driver, C. C., et al. (2021). The baby and the bathwater: on the need for substantive–methodological synergy in organizational research. Ind. Organ. Psychol. 14, 497–504. doi: 10.1017/iop.2021.111
Hu, J., He, W., and Zhou, K. (2020). The mind, the heart, and the leader in times of crisis: how and when COVID-19-triggered mortality salience relates to state anxiety, job engagement, and prosocial behavior. J. Appl. Psychol. 105, 1218–1233. doi: 10.1037/apl0000620
Jeon, L., Buettner, C. K., and Grant, A. A. (2018). Early childhood teachers’ psychological well-being: exploring potential predictors of depression, stress, and emotional exhaustion. Early Educ. Dev. 29, 53–69. doi: 10.1080/10409289.2017.1341806
Kniffin, K. M., Narayanan, J., Anseel, F., Antonakis, J., Ashford, S. P., Bakker, A. B., et al. (2021). COVID-19 and the workplace: implications, issues, and insights for future research and action. Am. Psychol. 76, 63–77. doi: 10.1037/amp0000716
Lüdtke, O., Marsh, H. W., Robitzsch, A., Trautwein, U., Asparouhov, T., and Muthén, B. (2008). The multilevel latent covariate model: a new, more reliable approach to group-level effects in contextual studies. Psychol. Methods 13, 203–229. doi: 10.1037/a0012869
Maslach, C., Schaufeli, W. B., and Leiter, M. P. (2001). Job Burnout. Annu. Rev. Psychol. 52, 397–422. doi: 10.1146/annurev.psych.52.1.397
McCormick, B. W., Reeves, C. J., Downes, P. E., Li, N., and Ilies, R. (2020). Scientific contributions of within-person research in management: making the juice worth the squeeze. J. Manag. 46, 321–350. doi: 10.1177/0149206318788435
McFarland, L. A., Reeves, S., Porr, W. B., and Ployhart, R. E. (2020). Impact of the COVID-19 pandemic on job search behavior: an event transition perspective. J. Appl. Psychol. 105, 1207–1217. doi: 10.1037/apl0000782
McNeish, D. (2021). Specifying location-scale models for heterogeneous variances as multilevel SEMs. Organ. Res. Methods 24, 630–653. doi: 10.1177/1094428120913083
McNeish, D., and Hamaker, E. L. (2020). A primer on two-level dynamic structural equation models for intensive longitudinal data in Mplus. Psychol. Methods 25, 610–635. doi: 10.1037/met0000250
McNeish, D., Mackinnon, D. P., Marsch, L. A., and Poldrack, R. A. (2021). Measurement in intensive longitudinal data. Struct. Equ. Model. Multidiscip. J. 28, 807–822. doi: 10.1080/10705511.2021.1915788
Muthén, L. K., and Muthén, B. O. (1998–2017). Mplus user’s guide. 8th. Los Angeles, CA: Muthén & Muthén
Newman, A., Eva, N., Bindl, U. K., and Stoverink, A. C. (2022). Organizational and vocational behavior in times of crisis: a review of empirical work undertaken during the COVID-19 pandemic and introduction to the special issue. Appl. Psychol. 71, 743–764. doi: 10.1111/apps.12409
Nimrod, G. (2022). Technostress in a hostile world: older internet users before and during the COVID-19 pandemic. Aging Ment. Health 26, 526–533. doi: 10.1080/13607863.2020.1861213
Podsakoff, N. P., Spoelma, T. M., Chawla, N., and Gabriel, A. S. (2019). What predicts within-person variance in applied psychology constructs? An empirical examination. J. Appl. Psychol. 104, 727–754. doi: 10.1037/apl0000374
Prenoveau, J. M. (2016). Specifying and interpreting latent state–trait models with autoregression: an illustration. Struct. Equ. Model. Multidiscip. J. 23, 731–749. doi: 10.1080/10705511.2016.1186550
R Core Team. (2022). R: A language and environment for statistical computing (4.2.1). R foundation for statistical computing, Vienna, Austria. Available at: https://www.R-project.org/
Revelle, W. (2022). Psych: procedures for psychological, psychometric, and personality research (R package version 2.2.5) [computer software]. Available at: https://CRAN.R-project.org/package=psych
Revelle, W., and Wilt, J. (2019). Analyzing dynamic data: A tutorial. Personal. Individ. Differ. 136, 38–51. doi: 10.1016/j.paid.2017.08.020
Roberts, B. W., Luo, J., Briley, D. A., Chow, P. I., Su, R., and Hill, P. L. (2017). A systematic review of personality trait change through intervention. Psychol. Bull. 143, 117–141. doi: 10.1037/bul0000088
Rudolph, C. W., Allan, B., Clark, M., Hertel, G., Hirschi, A., Kunze, F., et al. (2021). Pandemics: implications for research and practice in industrial and organizational psychology. Ind. Organ. Psychol. 14, 1–35. doi: 10.1017/iop.2020.48
Schaufeli, W. B., Desart, S., and De Witte, H. (2020). Burnout assessment tool (BAT)—development, validity, and reliability. Int. J. Environ. Res. Public Health 17:24. doi: 10.3390/ijerph17249495
Schuurman, N. K., and Hamaker, E. L. (2019). Measurement error and person-specific reliability in multilevel autoregressive modeling. Psychol. Methods 24, 70–91. doi: 10.1037/met0000188
Shoss, M. (2021). Occupational Health Psychology research and the COVID-19 pandemic. J. Occup. Health Psychol. 26, 259–260. doi: 10.1037/ocp0000292
Shrout, P. E., and Lane, S. P. (2012). “Psychometrics” in Handbook of research methods for studying daily life. eds. M. R. Mehl and T. S. Conner. (New York: The Guilford Press), 302–320.
Sonnentag, S., Cheng, B. H., and Parker, S. L. (2022). Recovery from work: advancing the field toward the future. Annu. Rev. Organ. Psych. Organ. Behav. 9, 33–60. doi: 10.1146/annurev-orgpsych-012420-091355
Stadtbaeumer, N., Kreissl, S., and Mayer, A. (in press). Comparing revised latent state–trait models including autoregressive effects. Psychol Methods. doi: 10.1037/met0000523
Steyer, R., Mayer, A., Geiser, C., and Cole, D. A. (2015). A theory of states and traits—revised. Annu. Rev. Clin. Psychol. 11, 71–98. doi: 10.1146/annurev-clinpsy-032813-153719
Topp, C. W., Østergaard, S. D., Søndergaard, S., and Bech, P. (2015). The WHO-5 well-being index: a systematic review of the literature. Psychother. Psychosom. 84, 167–176. doi: 10.1159/000376585
Vaziri, H., Casper, W. J., Wayne, J. H., and Matthews, R. A. (2020). Changes to the work–family interface during the COVID-19 pandemic: examining predictors and implications using latent transition analysis. J. Appl. Psychol. 105, 1073–1087. doi: 10.1037/apl0000819
Wagner, J., Orth, U., Bleidorn, W., Hopwood, C. J., and Kandler, C. (2020). Toward an integrative model of sources of personality stability and change. Curr. Dir. Psychol. Sci. 29, 438–444. doi: 10.1177/0963721420924751
Wang, H., and Li, J. (2015). How trait curiosity influences psychological well-being and emotional exhaustion: the mediating role of personal initiative. Personal. Individ. Differ. 75, 135–140. doi: 10.1016/j.paid.2014.11.020
Wang, J., and Wang, X. (2020). Structural equation modeling: applications using Mplus. 2nd Edn. Hoboken, NJ, USA:John Wiley & Sons.
World Health Organization. (1998). Use of well-being measures in primary health care/the DepCare project. WHO Regional Office for Europe: Copenhagen. Available at: https://www.euro.who.int/__data/assets/pdf_file/0016/130750/E60246.pdf
Zhou, L., Wang, M., and Zhang, Z. (2021). Intensive longitudinal data analyses with dynamic structural equation modeling. Organ. Res. Methods 24, 219–250. doi: 10.1177/1094428119833164
Zyphur, M. J., Allison, P. D., Tay, L., Voelkle, M. C., Preacher, K. J., Zhang, Z., et al. (2020a). From data to causes I: building a general cross-lagged panel model (GCLM). Organ. Res. Methods 23, 651–687. doi: 10.1177/1094428119847278
Keywords: Dynamic Structural Equation Modeling (DSEM), multilevel models, emotional exhaustion, mental well-being, occupational health
Citation: Perinelli E, Vignoli M, Kröner F, Müller A, Genrich M and Fraccaroli F (2023) Workers’ emotional exhaustion and mental well-being over the COVID-19 pandemic: a Dynamic Structural Equation Modeling (DSEM) approach. Front. Psychol. 14:1222845. doi: 10.3389/fpsyg.2023.1222845
Edited by:
Fahmida Laghari, Xijing University, ChinaReviewed by:
Ye Hoon Lee, Hankuk University of Foreign Studies, Republic of KoreaLawrence Ejike Ugwu, Renaissance University, Nigeria
Tulika Borah, Assam Agricultural University, India
Copyright © 2023 Perinelli, Vignoli, Kröner, Müller, Genrich and Fraccaroli. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Enrico Perinelli, enrico.perinelli@unitn.it
†ORCID: Enrico Perinelli https://orcid.org/0000-0002-7168-4847
Michela Vignoli
https://orcid.org/0000-0002-2583-5384
Friedrich Kröner
https://orcid.org/0000-0003-0548-641X
Andreas Müller
https://orcid.org/0000-0002-7447-700X
Melanie Genrich
https://orcid.org/0000-0001-9866-8049
Franco Fraccaroli
https://orcid.org/0000-0002-8893-7644