Renzo Bianchi
Irvin Sam Schonfeld- 1Institute of Work and Organizational Psychology, University of Neuchâtel, Neuchâtel, Switzerland
- 2Department of Psychology, The City College of the City University of New York, New York, NY, United States
The Occupational Depression Inventory (ODI) was recently developed to assess depressive symptoms that individuals specifically attribute to their work. Research on the criterion validity of the instrument is still in its infancy. In this study, we examined whether the ODI predicted performance on, and appreciation of, a cognitively challenging test. In light of the link established between clinical depression and neuropsychological impairment, and considering that individuals with depressive symptoms are more likely to feel helpless under challenging circumstances, we hypothesized that occupational depression would be associated with poorer cognitive performance and a darkened appreciation of the task undertaken. We relied on a sample of 1,359 educational staff members. We used an abridged version of Raven’s Advanced Progressive Matrices (RAPMs) as a cognitively challenging task and measure of cognitive performance. RAPMs assess so-called eductive ability (meaning-making and problem-solving abilities) through items of various degrees of difficulty. Transient mood was assessed with a three-item measure before RAPMs were administered. Task appreciation was assessed with a single-item measure after the completion of RAPMs. We found occupational depression to be negatively linked to cognitive performance. A two-step cluster analysis, in which ODI and RAPMs scores were used as classifiers, revealed two profiles of respondents. The first profile was characterized by relatively low levels of depressive symptoms and high levels of cognitive performance; the second profile, by relatively high levels of depressive symptoms and low levels of cognitive performance. The two profiles differed strongly from one another, as indexed by Cohen’s ds of 2.492 regarding depressive symptoms and 1.263 regarding cognitive performance. As anticipated, occupational depression predicted a darkened appreciation of the test. The association remained statistically significant, and largely unchanged, controlling for pretest mood and test performance. The highest levels of depressive symptoms were observed among individuals evaluating the task as “frustrating” and “discouraging.” Our study suggests that occupational depression predicts poorer cognitive performance and a negativized experience of cognitive challenge. Such features may be part of a self-sustaining loop fostering the maintenance of depressive symptoms. The extent to which the ODI predicts performance in the work context needs to be investigated.
Introduction
The Occupational Depression Inventory (ODI) was recently developed to assess depressive symptoms that individuals specifically attribute to their work (Bianchi and Schonfeld, 2020, 2021a,b). The ODI references the nine diagnostic symptom criteria for major depressive disorder found in the Diagnostic and statistical manual of mental disorders (5th ed.; DSM-5; American Psychiatric Association, 2013). The ODI thus assesses anhedonia, depressed mood, sleep alterations, fatigue/loss of energy, appetite alterations, feelings of worthlessness, cognitive impairment, psychomotor alterations, and suicidal ideation. The ODI was devised to overcome limitations of current measures of job-related distress, most notably, burnout measures (Bianchi et al., 2017, 2020, 2021; Rotenstein et al., 2018; Schwenk and Gold, 2018; Schonfeld et al., 2019a,b; Verkuilen et al., 2020; Vinkers and Schaafsma, 2021). Available evidence indicates that the ODI has excellent psychometric and structural properties and constitutes a promising tool for occupational health specialists (Bianchi and Schonfeld, 2020, 2021a,b). The ODI can be found in Bianchi and Schonfeld’s (2020) original article on the instrument and on the website of the Society for Occupational Health Psychology.1
Among individuals with no noticeable vulnerability to depression, the development of depressive symptoms and disorders has been critically linked to situations of unresolvable stress (Willner et al., 2013; Moscarello and Hartley, 2017; Grahek et al., 2019). Situations of unresolvable stress are situations in which individuals cannot take effective action to neutralize the stressors encountered and are, therefore, reduced to passively enduring the adverse effects of those stressors. Put differently, individuals are trapped in the face of stressors perceived as uncontrollable (Laborit, 1974, 1986; Seligman, 1975; Breier et al., 1987; Abramson et al., 1989; Dohrenwend, 2000; Pryce et al., 2011; Bhanji et al., 2016). An important characteristic of such states of helplessness and resignation is that they generalize to new challenging situations (Seligman, 1975; Pryce et al., 2011; Moscarello and Hartley, 2017). It is noteworthy that dealing successfully with stress-eliciting situations is fundamentally rewarding—to act effectively is to act rewardingly (Pryce et al., 2011; Rolls, 2016; Bondy et al., 2021). Unresolvable stress thus involves reward-hindering and punitive states. Such states are reflected in a disruption of allostasis and a promotion of allostatic load (McEwen, 2000; Honkalampi et al., 2021). The imbalance between positive affect and negative affect lies at the heart of the etiology of depression. Over the last decades, interest in depression in the context of work has grown considerably (Schonfeld and Chang, 2017). Many workers find themselves trapped in situations where (a) they perceive the job stressors that assail them as unmanageable and unchangeable and (b) they consider leaving their job impossible because such an option would result, for instance, in pension loss, long-term unemployment, and/or financial ruin—i.e., in situations evaluated as even more undesirable than their current situation. The ODI is intended to help occupational health specialists deal with job-ascribed forms of depression more effectively.
A key aspect of depressive symptomatology lies in altered cognitive functioning, in terms of (a) processing efficacy and (b) information selection and construction. Regarding information selection and construction, there is ample evidence that depressive symptoms are associated with so-called biases in favor of “negative” information (or to the detriment of “positive” information) at the levels of attention, interpretation, and memory (Everaert et al., 2014; Bianchi and Laurent, 2015; Bianchi and Schonfeld, 2016; Bianchi et al., 2018; Bianchi and da Silva Nogueira, 2019; LeMoult and Gotlib, 2019). Regarding processing efficacy, depression has been associated with pervasive impairment, for instance, at the level of executive functions (Snyder, 2013; Rock et al., 2014; Ahern and Semkovska, 2017; Semkovska et al., 2019; Pettersson et al., 2021). These findings are consistent with the difficulties in concentration and decision-making frequently reported by depressed patients in clinical settings as well as with the fact that cognitive impairment constitutes a diagnostic criterion for major depressive disorder (American Psychiatric Association, 2013). Cognitive alterations have been regarded as a central mediator of the link between clinical depression and psychosocial impairment, including deteriorations in job performance (McIntyre et al., 2013; Lam et al., 2014; Pan et al., 2019).
Although the ODI has displayed excellent psychometric and structural properties to date (Bianchi and Schonfeld, 2020), research on the criterion validity of the instrument is still in its infancy. In the present study, we inquired into the criterion validity of the ODI by examining whether the ODI predicted performance on, and appreciation of, a cognitively challenging test. Investigating the criterion validity of the ODI in relation to cognitive functioning appears to be particularly relevant given that, as mentioned above, cognitive alterations are assumed to play a mediating role in the relationship between clinical depression and psychosocial impairment, notably from the standpoint of worker performance (McIntyre et al., 2013; Lam et al., 2014; Pan et al., 2019). In light of the well-established link between clinical depression and neuropsychological impairment (Snyder, 2013; Rock et al., 2014; Ahern and Semkovska, 2017; Semkovska et al., 2019; Pettersson et al., 2021), and considering that individuals with depressive symptoms are more likely to feel helpless under challenging circumstances (Seligman, 1975; Pryce et al., 2011), we hypothesized that occupational depression would be associated with poorer cognitive performance and a darkened appreciation of the task undertaken. Learning more about the criterion validity of the ODI is important in order to further estimate the (practical) utility of the instrument for occupational health specialists.
Materials and Methods
Study Sample
This study involved a convenience sample of educational staff members (e.g., teachers, principals, librarians) employed in K-12 schools in France. Educational staff members tend to be exposed to a variety of chronic work stressors (e.g., verbal intimidation and physical violence; Schonfeld, 2006; Reddy et al., 2013; Longobardi et al., 2019) fostering the development of depressive symptoms (e.g., Schonfeld, 2001; Galand et al., 2007). Assuming that variability in the extent to which educators are subject to chronic work stressors is related to variability in ODI scores, we expected to observe a range of scores from ‘‘low’’ to ‘‘medium’’ to ‘‘high’’ on the ODI, thus providing the variance needed for our analyses. Participants were reached through email contacts with school administrators and directors. Participation in the study was voluntary and without compensation. Consent to participate was requested. Our study complied with the ethical standards of the institutional review board of the University of Neuchâtel. The study was conducted online using Qualtrics.2
Our survey included the ODI, an abridged version of Raven’s Advanced Progressive Matrices (RAPMs), measures of transient mood and task appreciation, and sociodemographic items. At the very end of the survey, participants were asked if they had completed the RAPMs alone and without help. A negative response to this item was eliminatory. Of the 1,743 participants who had completed the survey, 323 were excluded on this basis (18.531% of the initial sample). Of the 1,420 remaining participants, 61 were eliminated (4.296% of the corrected sample) due to survey completion durations exceeding 60 min. Durations exceeding 60 min were considered aberrantly long because (a) the completion of RAPMs—presumably the most time-consuming part of the study—was not expected to take more than 20 min given the use of an abbreviated version (Arthur and Day, 1994; Raven et al., 1998) and (b) the rest of the survey comprised a limited number of relatively brief measures (e.g., the ODI). A 60-min cutoff thus allowed us to exclude participants with completion durations reflecting extreme degrees of distraction (e.g., durations signaling survey completion on more than a day) without being overly restrictive. The most rapid respondent completed the survey in 6.133 min. The respondent in question displayed an above-average score of 0.833 on the RAPMs, suggesting that a lower boundary for aberrant response duration was not needed. A total of 1,359 participants eventually constituted the study sample (mean completion time = 15.332, SD = 7.585). Participants’ mean age was 45.309 (SD = 9.876). About 85% of the participants were women (n = 1,149), consistent with the large overrepresentation of women in the French K-12 academic system.3
Measures of Interest
The pivotal study measure was the ODI (Bianchi and Schonfeld, 2020, 2021a,b). The ODI comprises nine core symptom items rated on a frequency scale from 0 (“never or almost never”) to 3 (“nearly every day”). All of these items are negatively worded. As previously mentioned, the ODI was designed with reference to the nine diagnostic symptom criteria for major depressive disorder found in the DSM-5 (American Psychiatric Association, 2013). The ODI includes six anhedonic-somatic symptom items (anhedonia, sleep alterations, fatigue/loss of energy, appetite alterations, cognitive impairment, and psychomotor alterations) and three dysphoric symptom items (depressed mood, feelings of worthlessness, and suicidal ideation). A sample item is: “My experience at work made me feel like a failure.” In this study, the ODI had a McDonald’s ω of 0.933. As per Bianchi and Schonfeld (2020), we reexamined the factorial structure of the ODI based on exploratory structural equation modeling (ESEM) bifactor analysis. We did so in Mplus 8 (Muthén and Muthén, 1998–2017). We treated the items as ordinal. We used the WLSMV estimator and relied on a partially specified target (orthogonal) rotation (Marsh et al., 2014; Li, 2016). Two bifactors were considered in addition to the general “Occupational Depression” factor. One was an “Anhedonic-Somatic” bifactor, reflecting the six anhedonic-somatic symptom items of the ODI. The other was a “Dysphoric” bifactor, reflecting the three dysphoric symptom items of the ODI. The model showed a satisfactory fit: RMSEA = 0.000 (90% confidence interval: 0.000, 0.026); CFI = 1.000; TLI = 1.000, WRMR = 0.271; χ2(12) = 11.185. The general factor accounted for 88.691% of the common variance extracted, a proportion indicative of essential unidimensionality (Rodriguez et al., 2016). Consistent with these findings, a confirmatory factor analysis (CFA) in which we treated the items as ordinal and used the WLSMV estimator showed that a one-factor model had an acceptable fit: RMSEA = 0.071 (90% confidence interval: 0.062, 0.080); CFI = 0.988; TLI = 0.985; SRMR = 0.041; χ2(27) = 211.159. The ODI includes a subsidiary question related to turnover intention: “If you have encountered at least some of the problems mentioned above, do these problems lead you to consider leaving your current job or position?” Three response options are provided: “yes,” “no,” and “I don’t know.” In this study, nearly one third of the participants (n = 440) answered this question in the affirmative.
We used a 12-item version of RAPMs as a cognitively challenging task and a measure of cognitive performance (Arthur and Day, 1994; Raven et al., 1998). RAPMs were designed to assess so-called eductive ability (also known as meaning-making ability), i.e., the ability to generate order and infer valid structuring rules (Raven and Raven, 2003). The stronger an individual’s eductive ability, the higher the probability for this individual to decipher complex stimuli. RAPMs are non-verbal in nature. Each matrix is made up of three rows and three columns. In each of the matrices, eight shapes are present and one shape is missing. The participant’s goal is to identify the missing shape that logically completes the set. A sample matrix adapted from RAPMs is displayed in Figure 1. RAPMs showed a McDonald’s ω of 0.916 in this study. Relying on Mplus 8 (Muthén and Muthén, 1998–2017), we submitted RAPMs to a CFA in which the items were treated as categorical and the WLSMV estimator was used. A one-factor model showed a satisfactory fit: RMSEA = 0.024 (90% confidence interval: 0.016, 0.032); CFI = 0.989; TLI = 0.987; SRMR = 0.048; χ2(54) = 97.771. The RAPMs session was divided into two blocks. The first block, consisting of eight relatively easy matrices, was a training block intended to familiarize participants with the test and its interface. The second block, consisting of four relatively difficult matrices, was our target block for examining individuals’ cognitive performance. For each matrix, participants were presented with eight response options and asked to select the answer they considered correct. A correct answer was coded 1 and any incorrect answer was coded 0, leading to a mean score between 0 and 1. Detailed descriptive statistics for RAPMs are available in Table 1.
Figure 1. Sample matrix adapted from Raven’s Advanced Progressive Matrices.
Table 1. Descriptive statistics for Raven’s Advanced Progressive Matrices (RAPMs).
We assessed transient mood with a three-item measure focusing on positive mood, dejected mood, and irritable mood (van Eck et al., 1998). We relied on the following items: “I feel fine, I am in a good mood”; “I feel down, demoralized”; “I feel angry, irritated.” Items were rated on a scale from 1 (“strongly agree”) to 5 (“strongly disagree”). The first item (“I feel fine, I am in a good mood”) was reverse-coded when computing mean scores. Higher mean scores were, therefore, indicative of more negative mood states. Transient mood was evaluated before RAPMs were administered (see Figure 2 for a summary of the study protocol). McDonald’s ω was 0.892.4
Figure 2. Summary of the study procedure (RAPMs: Raven’s Advanced Progressive Matrices; ODI: Occupational Depression Inventory).
In order to assess task appreciation, we asked our participants to indicate which, of seven terms, best described the test they had completed. The terms were divided into: three positive expressions---amusing, stimulating, and captivating; three negative expressions---boring, frustrating, and discouraging; and one expression deemed to be neutral---unusual.5 ODI scores associated with each appreciation term are displayed in Figure 3. We recoded the terms into three categories—0 for negative expressions, 1 for the neutral expression, and 2 for positive expressions for our analyses. Higher task appreciation scores were thus reflective of more favorable evaluations of the test. Task appreciation was assessed right after RAPMs were completed.
Figure 3. Mean score on the Occupational Depression Inventory (± 1 standard error) per task appreciation category.
Data Analyses
We first examined the link between occupational depression and cognitive performance using correlational analysis, hierarchical linear regression analysis, and two-step cluster analysis. Two-step cluster analysis allows the investigator to identify individual profiles based on characteristics of interest, called classifiers, and is thus anchored in a person-centered approach (as opposed to a variable-centered approach; Howard and Hoffman, 2017; for specific examples, see Ahola et al., 2014; Bianchi et al., 2015; Vicent-Gil et al., 2020). We employed occupational depression and cognitive performance as classifiers. We relied on a Euclidean distance measure and used Schwarz’s Bayesian clustering criterion. We did not prespecify the number of clusters. Model fit was estimated with the Silhouette coefficient, an index of cluster cohesion and separation. We additionally used Welch’s analysis of variance (ANOVA), analysis of covariance, and Pearson’s chi-squared test to examine the characteristics of our clusters.
We then focused on the link between occupational depression and task appreciation relying on correlational analysis and hierarchical linear regression analysis. We anticipated that pretest mood and cognitive performance would need to be controlled given likely links between these two variables and both our main predictor (occupational depression) and our outcome of interest (task appreciation).
Results
Occupational Depression and Cognitive Performance
Occupational depression correlated negatively with cognitive performance, ρ = -0.093, p = 0.001, and r = -0.098, p < 0.001 (Table 2). The association remained statistically significant controlling for age, sex, and pretest transient mood in hierarchical linear regression analysis (Supplementary Table 1). When corrected for measurement error within a confirmatory factor analytic framework, the correlation between the Occupational Depression and Eductive Ability factors reached -0.155, p < 0.001 [RMSEA = 0.034 (90% confidence interval: 0.028, 0.041), CFI = 0.994, TLI = 0.993, SRMR = 0.034]. The raw correlation between occupational depression and pretest mood was large, ρ = 0.557, p < 0.001, and r = 0.568, p < 0.001.
Table 2. Spearman and Pearson correlations among the main study variables.
Two-step cluster analysis revealed two individual profiles. The first cluster (Cluster 1; n = 1,214) involved individuals with relatively low ODI scores (M = 0.935, SD = 0.572) and relatively high cognitive performance (M = 0.541, SD = 0.284). The second cluster (Cluster 2; n = 145) involved individuals with relatively high ODI scores (M = 2.172, SD = 0.407) and relatively low cognitive performance (M = 0.226, SD = 0.209). The model showed a satisfactory fit, with a Silhouette coefficient of 0.4 (Vicent-Gil et al., 2020). Welch’s ANOVAs revealed that the two clusters differed substantially from one another in terms of both ODI scores, aF(1, 218.360) = 1083.277, p < 0.001, Cohen’s d = 2.492, and cognitive performance, aF(1, 213.427) = 269.956, p < 0.001, Cohen’s d = 1.263. Characteristics of the two clusters (in terms of age, sex, pretest mood, and task appreciation) are presented in Table 3.
Table 3. Between-cluster comparisons.
Occupational Depression and Task Appreciation
Correlational analyses indicated that occupational depression was associated with a darkened appreciation of the task undertaken, ρ = -0.180, p < 0.001, and r = -0.179, p < 0.001 (Table 2). Hierarchical linear regression analysis showed that the association remained statistically significant, and largely unchanged, controlling for pretest mood and cognitive performance (Table 4).6 Pretest mood did not interact with occupational depression in predicting task appreciation, whether controlling for cognitive performance (p = 0.685) or not (p = 0.493).
Table 4. Summary of hierarchical linear regression analysis—occupational depression predicting task appreciation.
Discussion
The present study examined whether the ODI predicted performance on, and appreciation of, a cognitively challenging test. In so doing, our goal was to learn more about the criterion validity of the ODI. In light of the well-established link between clinical depression and neuropsychological impairment (Snyder, 2013; Rock et al., 2014; Ahern and Semkovska, 2017; Semkovska et al., 2019; Pettersson et al., 2021), and considering that individuals with depressive symptoms are more likely to feel helpless under challenging circumstances (Seligman, 1975; Pryce et al., 2011), we hypothesized that occupational depression would be associated with (a) poorer cognitive performance and (b) a darkened appreciation of the task undertaken.
Consistent with our first hypothesis, we found occupational depression to be negatively associated with cognitive performance. The correlations that we obtained between occupational depression and cognitive performance fall in the range of the documented correlations between RAPMs and self-reported measures of depressive symptoms such as the Center for Epidemiological Studies-Depression scale (du Pont et al., 2020). By adopting a person-centered, cluster-analytic approach to the link between occupational depression and cognitive performance, we were able to identify two distinct individual profiles. The first profile was characterized by relatively low levels of work-attributed depressive symptoms and high levels of cognitive performance whereas the second profile was marked by relatively high levels of work-attributed depressive symptoms and low levels of cognitive performance. Between-profile differences were large in terms of both occupational depression and cognitive performance, as indexed by Cohen’s ds ≥ 1.263. Such effect sizes are consistent with those found in cluster-analytic research pertaining to neuropsychological functioning in clinical depression (Vicent-Gil et al., 2020). Our findings underline the utility of combining variable- and person-centered approaches in depression research. Our results dovetail with those pertaining to the link between clinical depression and neuropsychological impairment (Snyder, 2013; Rock et al., 2014; Ahern and Semkovska, 2017; Semkovska et al., 2019; Pettersson et al., 2021).
Consistent with our second hypothesis, we found occupational depression to be associated with a darkened appreciation of the test. Importantly, the association remained statistically significant controlling not only for pretest mood but also for test performance, suggesting that occupational depression darkens individuals’ view of the task undertaken in a way that is partly independent of their ability to handle the task in question. These results are in keeping with the well-established finding that depression involves a negative filter in the processing of information (Bianchi et al., 2018; Bianchi and da Silva Nogueira, 2019; LeMoult and Gotlib, 2019). In addition, we found that individuals evaluating the task as “frustrating” and “discouraging” were also those who exhibited the highest levels of depressive symptoms. This finding resonates with the observation that feelings of helplessness and resignation constitute a hallmark of depression (Seligman, 1975; Pryce et al., 2011).
In keeping with Bianchi and Schonfeld’s (2020) findings regarding the psychometric and structural properties of the ODI, we found the ODI to exhibit strong reliability, high factorial validity, and essential unidimensionality. In Bianchi and Schonfeld’s (2020) study, the ODI manifested moderate to large correlations, in the expected direction, with a variety of self-reported measures, including self-reported measures of job satisfaction, dedication to work, willingness to stay in the job, social support in work life, active search for another job/position, trait anxiety, general health status, and life satisfaction. By documenting a link between individuals’ scores on the ODI and RAPMs, this study extends our knowledge of the ODI’s properties by suggesting that the ODI is predictive of “objective,” test-assessed cognitive performance. This constitutes an important step in the examination of the predictive value and practical utility of the ODI.
At least five limitations to the present study can be underlined. First, although relatively large in size (N = 1,359), our study sample was a convenience sample. Because our participants were self-selected, the representativeness of our study sample vis-à-vis its population of reference is not clear (e.g., in terms of basic demographics). Second, our study sample consisted only of educational staff members. The extent to which our findings can be generalized to other occupational groups remains to be elucidated. Education professionals may, for instance, better compensate for the undermining effects of depressive symptoms on cognitive performance than other occupational groups thanks to above-average cognitive reserves (Stern, 2009). Third, we assessed participants’ appreciation of the task undertaken using a single-item measure. Although single-item measures can do a fine job under a number of circumstances (e.g., Friedman et al., 2017) and are much more reliable than often assumed (Bowling, 2005; Mõttus and Rozgonjuk, 2021), using multiple-item measures is generally preferable. Fourth, even if RAPMs mobilize a wide array of cognitive abilities, the inclusion of a broader set of cognitive tests would have been a plus. Fifth, our study was conducted online, which involves a lesser degree of control over test-taking conditions compared to classical laboratory settings. Reassuringly, however, web-based studies have proved valid and reliable in psychological research and beyond (Horton et al., 2011; Gosling and Mason, 2015; Anwyl-Irvine et al., 2021). We also note that, as mentioned earlier, we took measures to identify and exclude careless participants.
Conclusion
The present study suggests that the ODI predicts poorer cognitive performance and a negativized experience of cognitively challenging circumstances. Such features may be part of a self-sustaining loop fostering the maintenance of depressive symptoms. Depressive symptoms may render cognitive challenges both more difficult and more unpleasant to handle, which, in turn, may feed depressive symptoms further. Both replication studies and studies assessing performance directly in the work context are needed to learn more about the criterion validity of the ODI.
Data Availability Statement
The datasets presented in this article are not readily available because of confidentiality and data protection commitments. Requests to access the datasets should be directed to corresponding author.
Ethics Statement
Ethical review and approval was not required for the study on human participants in accordance with the local legislation and institutional requirements. The patients/participants provided their written informed consent to participate in this study.
Author Contributions
RB developed the study concept, designed the study protocol, collected the data, and drafted the manuscript. RB and IS performed data analysis. Both authors took part in result interpretation, reviewed and edited several versions of the manuscript. Both authors provided critical revisions and approved the final version of the manuscript for submission.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary Material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyg.2021.695539/full#supplementary-material
Footnotes
- ^ https://sohp-online.org/resources/research-resources/
- ^ https://www.qualtrics.com/
- ^ https://www.education.gouv.fr/
- ^ We do not report on model fit for a one-factor CFA of our measure of transient mood because a CFA with three items and one latent variable is “just-identified.” The fit of such a model is meaningless. Factor loadings ranged from 0.719 to 0.931, with standard errors ranging from 0.009 to 0.015.
- ^ Here is the original list in French: amusant; stimulant; captivant; ennuyant; frustrant; décourageant; insolite.
- ^ Age and sex were not included in the models because these two variables were essentially unrelated to the outcome of interest.
References
Abramson, L. Y., Metalsky, G. I., and Alloy, L. B. (1989). Hopelessness depression: a theory-based subtype of depression. Psychol. Rev. 96, 358–372. doi: 10.1037/0033-295x.96.2.358
Ahern, E., and Semkovska, M. (2017). Cognitive functioning in the first-episode of major depressive disorder: a systematic review and meta-analysis. Neuropsychology 31, 52–72. doi: 10.1037/neu0000319
Ahola, K., Hakanen, J., Perhoniemi, R., and Mutanen, P. (2014). Relationship between burnout and depressive symptoms: a study using the person-centred approach. Burn. Res. 1, 29–37. doi: 10.1016/j.burn.2014.03.003
American Psychiatric Association (2013). Diagnostic and Statistical Manual of Mental Disorders, 5th Edn. Washington, DC: American Psychiatric Publishing.
Anwyl-Irvine, A., Dalmaijer, E. S., Hodges, N., and Evershed, J. K. (2021). Realistic precision and accuracy of online experiment platforms, web browsers, and devices. Behav. Res. Methods 53, 1407–1425. doi: 10.3758/s13428-020-01501-5
Arthur, W., and Day, D. V. (1994). Development of a short form for the Raven Advanced Progressive Matrices Test. Educ. Psychol. Meas. 54, 394–403. doi: 10.1177/0013164494054002013
Bhanji, J. P., Kim, E. S., and Delgado, M. R. (2016). Perceived control alters the effect of acute stress on persistence. J. Exp. Psychol. Gen. 145, 356–365. doi: 10.1037/xge0000137
Bianchi, R., and da Silva Nogueira, D. (2019). Burnout is associated with a depressive interpretation style. Stress Health 35, 642–649. doi: 10.1002/smi.2897
Bianchi, R., and Laurent, E. (2015). Emotional information processing in depression and burnout: an eye-tracking study. Eur. Arch. Psychiatry Clin. Neurosci. 265, 27–34. doi: 10.1007/s00406-014-0549-x
Bianchi, R., Laurent, E., Schonfeld, I. S., Verkuilen, J., and Berna, C. (2018). Interpretation bias toward ambiguous information in burnout and depression. Pers. Individ. Dif. 135, 216–221. doi: 10.1016/j.paid.2018.07.028
Bianchi, R., and Schonfeld, I. S. (2016). Burnout is associated with a depressive cognitive style. Pers. Individ. Dif. 100, 1–5. doi: 10.1016/j.paid.2016.01.008
Bianchi, R., and Schonfeld, I. S. (2020). The Occupational Depression Inventory: a new tool for clinicians and epidemiologists. J. Psychosom. Res. 138:110249. doi: 10.1016/j.jpsychores.2020.110249
Bianchi, R., and Schonfeld, I. S. (2021a). The Occupational Depression Inventory—a solution for breaking the impasse of burnout measurement. JAMA Surgery 156, 589–590. doi: 10.1001/jamasurg.2021.0018
Bianchi, R., and Schonfeld, I. S. (2021b). The occupational depression inventory—a solution for estimating the prevalence of job-related distress. Psychiatry Res. 305:114181. doi: 10.1016/j.psychres.2021.114181
Bianchi, R., Schonfeld, I. S., and Laurent, E. (2015). Is burnout separable from depression in cluster analysis? A longitudinal study. Soc. Psychiatry Psychiatr. Epidemiol. 50, 1005–1011. doi: 10.1007/s00127-014-0996-8
Bianchi, R., Schonfeld, I. S., and Laurent, E. (2017). Can we trust burnout research? Ann. Oncol. 28, 2320–2321. doi: 10.1093/annonc/mdx267
Bianchi, R., Schonfeld, I. S., and Verkuilen, J. (2020). A five-sample confirmatory factor analytic study of burnout-depression overlap. J. Clin. Psychol. 76, 801–821. doi: 10.1002/jclp.22927
Bianchi, R., Verkuilen, J., Schonfeld, I. S., Hakanen, J. J., Jansson-Fröjmark, M., Manzano-García, G., et al. (2021). Is burnout a depressive condition? A 14-sample meta-analytic and bifactor analytic study. Clin. Psychol. Sci. 9, 579–597. doi: 10.1177/2167702620979597
Bondy, E., Baranger, D. A. A., Balbona, J., Sputo, K., Paul, S. E., Oltmanns, T. F., et al. (2021). Neuroticism and reward-related ventral striatum activity: probing vulnerability to stress-related depression. J. Abnorm. Psychol. 130, 223–235. doi: 10.1037/abn0000618
Bowling, A. (2005). Just one question: If one question works, why ask several? J. Epidemiol. Community Health 59, 342–345. doi: 10.1136/jech.2004.021204
Breier, A., Albus, M., Pickar, D., Zahn, T. P., Wolkowitz, O. M., and Paul, S. M. (1987). Controllable and uncontrollable stress in humans: alterations in mood and neuroendocrine and psychophysiological function. Am. J. Psychiatry 144, 1419–1425. doi: 10.1176/ajp.144.11.1419
Dohrenwend, B. P. (2000). The role of adversity and stress in psychopathology: some evidence and its implications for theory and research. J. Health Soc. Behav. 41, 1–19. doi: 10.2307/2676357
du Pont, A., Karbin, Z., Rhee, S. H., Corley, R. P., Hewitt, J. K., and Friedman, N. P. (2020). Differential associations between rumination and intelligence subtypes. Intelligence 78:101420. doi: 10.1016/j.intell.2019.101420
Everaert, J., Duyck, W., and Koster, E. H. (2014). Attention, interpretation, and memory biases in subclinical depression: a proof-of-principle test of the combined cognitive biases hypothesis. Emotion 14, 331–340. doi: 10.1037/a0035250
Friedman, M. R., Coulter, R. W., Silvestre, A. J., Stall, R., Teplin, L., Shoptaw, S., et al. (2017). Someone to count on: social support as an effect modifier of viral load suppression in a prospective cohort study. AIDS Care 29, 469–480. doi: 10.1080/09540121.2016.1211614
Galand, B., Lecocq, C., and Philippot, P. (2007). School violence and teacher professional disengagement. Br. J. Educ. Psychol. 77, 465–477. doi: 10.1348/000709906X114571
Gosling, S. D., and Mason, W. (2015). Internet research in psychology. Annu. Rev. Psychol. 66, 877–902. doi: 10.1146/annurev-psych-010814-015321
Grahek, I., Shenhav, A., Musslick, S., Krebs, R. M., and Koster, E. H. W. (2019). Motivation and cognitive control in depression. Neurosci. Biobehav. Rev. 102, 371–381. doi: 10.1016/j.neubiorev.2019.04.011
Honkalampi, K., Virtanen, M., Hintsa, T., Ruusunen, A., Mäntyselkä, P., Ali-Sisto, T., et al. (2021). Comparison of the level of allostatic load between patients with major depression and the general population. J. Psychosom. Res. 143:110389. doi: 10.1016/j.jpsychores.2021.110389
Horton, J. J., Rand, D. G., and Zeckhauser, R. J. (2011). The online laboratory: conducting experiments in a real labor market. Exp. Econ. 14, 399–425. doi: 10.1007/s10683-011-9273-9
Howard, M. C., and Hoffman, M. E. (2017). Variable-centered, person-centered, and person-specific approaches: Where theory meets the method. Organ. Res. Methods 21, 846–876. doi: 10.1177/1094428117744021
Lam, R. W., Kennedy, S. H., McLntyre, R. S., and Khullar, A. (2014). Cognitive dysfunction in major depressive disorder: effects on psychosocial functioning and implications for treatment. Can. J. Psychiatry 59, 649–654. doi: 10.1177/070674371405901206
LeMoult, J., and Gotlib, I. H. (2019). Depression: a cognitive perspective. Clin. Psychol. Rev. 69, 51–66. doi: 10.1016/j.cpr.2018.06.008
Li, C. H. (2016). Confirmatory factor analysis with ordinal data: comparing robust maximum likelihood and diagonally weighted least squares. Behav. Res. Methods 48, 936–949. doi: 10.3758/s13428-015-0619-7
Longobardi, C., Badenes-Ribera, L., Fabris, M. A., Martinez, A., and McMahon, S. D. (2019). Prevalence of student violence against teachers: a meta-analysis. Psychol. Violence 9, 596–610. doi: 10.1037/vio0000202
Marsh, H. W., Morin, A. J., Parker, P. D., and Kaur, G. (2014). Exploratory structural equation modeling: an integration of the best features of exploratory and confirmatory factor analysis. Annu. Rev. Clin. Psychol. 10, 85–110. doi: 10.1146/annurev-clinpsy-032813-153700
McEwen, B. S. (2000). Allostasis and allostatic load: implications for neuropsychopharmacology. Neuropsychopharmacology 22, 108–124. doi: 10.1016/S0893-133X(99)00129-3
McIntyre, R. S., Cha, D. S., Soczynska, J. K., Woldeyohannes, H. O., Gallaugher, L. A., Kudlow, P., et al. (2013). Cognitive deficits and functional outcomes in major depressive disorder: determinants, substrates, and treatment interventions. Depress. Anxiety 30, 515–527. doi: 10.1002/da.22063
Moscarello, J. M., and Hartley, C. A. (2017). Agency and the calibration of motivated behavior. Trends Cogn. Sci. 21, 725–735. doi: 10.1016/j.tics.2017.06.008
Mõttus, R., and Rozgonjuk, D. (2021). Development is in the details: age differences in the Big Five domains, facets, and nuances. J. Pers. Soc. Psychol. 120, 1035–1048. doi: 10.1037/pspp0000276
Muthén, L. K., and Muthén, B. O. (1998-2017). Mplus User’s Guide, 8th Edn. Los Angeles, CA: Muthén & Muthén.
Pan, Z., Park, C., Brietzke, E., Zuckerman, H., Rong, C., Mansur, R., et al. (2019). Cognitive impairment in major depressive disorder. CNS Spectr. 24, 22–29. doi: 10.1017/S1092852918001207
Perneger, T. V. (1998). What’s wrong with Bonferroni adjustments. Br. Med. J. 316, 1236–1238. doi: 10.1136/bmj.316.7139.1236
Pettersson, E., Lichtenstein, P., Larsson, H., D’Onofrio, B. M., Lahey, B. B., and Latvala, A. (2021). Associations of resting heart rate and intelligence with general and specific psychopathology: a prospective population study of 899,398 Swedish men. Clin. Psychol. Sci. 9, 524–532. doi: 10.1177/2167702620961081
Pryce, C. R., Azzinnari, D., Spinelli, S., Seifritz, E., Tegethoff, M., and Meinlschmidt, G. (2011). Helplessness: a systematic translational review of theory and evidence for its relevance to understanding and treating depression. Pharmacol. Ther. 132, 242–267. doi: 10.1016/j.pharmthera.2011.06.006
Raven, J., and Raven, J. (2003). “Raven progressive matrices,” in Handbook of Nonverbal, ed. R. S. McCallum (Boston, MA: Springer), 223–237. doi: 10.1007/978-1-4615-0153-4_11
Raven, J., Raven, J. C., and Court, J. H. (1998). Raven Manual Section 4: Advanced Progressive Matrices. Oxford: Oxford Psychologists Press.
Reddy, L. A., Espelage, D., McMahon, S. D., Anderman, E. M., Lane, K. L., Brown, V. E., et al. (2013). Violence against teachers: case studies from the APA task force. Int. J. Sch. Educ. Psychol. 1, 231–245. doi: 10.1080/21683603.2013.837019
Rock, P. L., Roiser, J. P., Riedel, W. J., and Blackwell, A. D. (2014). Cognitive impairment in depression: a systematic review and meta-analysis. Psychol. Med. 44, 2029–2040. doi: 10.1017/s0033291713002535
Rodriguez, A., Reise, S. P., and Haviland, M. G. (2016). Evaluating bifactor models: calculating and interpreting statistical indices. Psychol. Methods 21, 137–150. doi: 10.1037/met0000045
Rolls, E. T. (2016). A non-reward attractor theory of depression. Neurosci. Biobehav. Rev. 68, 47–58. doi: 10.1016/j.neubiorev.2016.05.007
Rotenstein, L. S., Torre, M., Ramos, M. A., Rosales, R. C., Guille, C., Sen, S., et al. (2018). Prevalence of burnout among physicians: a systematic review. JAMA 320, 1131–1150. doi: 10.1001/jama.2018.12777
Schonfeld, I. S. (2001). Stress in 1st-year women teachers: the context of social support and coping. Genet. Soc. Gen. Psychol. Monogr. 127, 133–168.
Schonfeld, I. S. (2006). “School violence,” in Handbook of Workplace Violence, eds E. K. Kelloway, J. Barling, and J. J. Hurrell Jr. (Thousand Oaks, CA: Sage Publications), 169–229. doi: 10.4135/9781412976947.n9
Schonfeld, I. S., and Chang, C.-H. (2017). Occupational Health Psychology: Work, Stress, and Health. New York, NY: Springer.
Schonfeld, I. S., Verkuilen, J., and Bianchi, R. (2019a). An exploratory structural equation modeling bi-factor analytic approach to uncovering what burnout, depression, and anxiety scales measure. Psychol. Assess. 31, 1073–1079. doi: 10.1037/pas0000721
Schonfeld, I. S., Verkuilen, J., and Bianchi, R. (2019b). Inquiry into the correlation between burnout and depression. J. Occup. Health Psychol. 24, 603–616. doi: 10.1037/ocp0000151
Schwenk, T. L., and Gold, K. J. (2018). Physician burnout—a serious symptom, but of what? JAMA 320, 1109–1110. doi: 10.1001/jama.2018.11703
Seligman, M. E. P. (1975). Helplessness: On Depression, Development, and Death. New York, NY: W. H. Freeman.
Semkovska, M., Quinlivan, L., O’Grady, T., Johnson, R., Collins, A., O’Connor, J., et al. (2019). Cognitive function following a major depressive episode: a systematic review and meta-analysis. Lancet Psychiatry 6, 851–861. doi: 10.1016/S2215-0366(19)30291-3
Snyder, H. R. (2013). Major depressive disorder is associated with broad impairments on neuropsychological measures of executive function: a meta-analysis and review. Psychol. Bull. 139, 81–132. doi: 10.1037/a0028727
Stern, Y. (2009). Cognitive reserve. Neuropsychologia 47, 2015–2028. doi: 10.1016/j.neuropsychologia.2009.03.004
van Eck, M., Nicolson, N. A., and Berkhof, J. (1998). Effects of stressful daily events on mood states: relationship to global perceived stress. J. Pers. Soc. Psychol. 75, 1572–1585. doi: 10.1037/0022-3514.75.6.1572
Verkuilen, J., Bianchi, R., Schonfeld, I. S., and Laurent, E. (2020). Burnout-depression overlap: exploratory structural equation modeling bifactor analysis and network analysis. Assessment 28, 1583–1600. doi: 10.1177/1073191120911095
Vicent-Gil, M., Portella, M. J., Serra-Blasco, M., Navarra-Ventura, G., Crivillés, S., Aguilar, E., et al. (2020). Dealing with heterogeneity of cognitive dysfunction in acute depression: a clustering approach. Psychol. Med. doi: 10.1017/S0033291720001567 [Epub ahead of print].
Vinkers, C. H., and Schaafsma, F. G. (2021). Burnout urgently needs robust research. Nature 592:188. doi: 10.1038/d41586-021-00896-1
Keywords: Occupational Depression Inventory, cognition, job performance, mood, work stress, positive feedback loop, helplessness, burnout
Citation: Bianchi R and Schonfeld IS (2021) Occupational Depression, Cognitive Performance, and Task Appreciation: A Study Based on Raven’s Advanced Progressive Matrices. Front. Psychol. 12:695539. doi: 10.3389/fpsyg.2021.695539
Received: 15 April 2021; Accepted: 01 September 2021;
Published: 20 September 2021.
Edited by:
Con Stough, Swinburne University of Technology, AustraliaReviewed by:
Karla Olmo-Sánchez, Universidad Autónoma de Ciudad Juárez, MexicoStefano Zago, IRCCS Ca’ Granda Foundation Maggiore Policlinico Hospital, Italy
Copyright © 2021 Bianchi and Schonfeld. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Renzo Bianchi, cmVuem8uYmlhbmNoaUB1bmluZS5jaA==