- 1Department of Clinical-Psychological Intervention, Freie Universität Berlin, Berlin, Germany
- 2Department of Clinical Psychology and Experimental Psychopathology, Faculty of Behavioral and Social Sciences, University of Groningen, Groningen, Netherlands
- 3Department of Psychology, Health, and Technology, Faculty of Behavioural, Management, and Social Sciences, University of Twente, Enschede, Netherlands
- 4Department of Clinical Psychology, Faculty of Social Sciences, Utrecht University, Utrecht, Netherlands
Background: The loss of a significant other can lead to variety of responses, including prolonged grief disorder (PGD), posttraumatic stress disorder (PTSD), and depression. The aim of this study was to replicate and extend previous research that indicated that three subgroups of bereaved individuals can be distinguished based one similar post-loss symptom profiles using latent class analysis (LCA). The second aim was to examine whether sociodemographic and loss-related characteristics as well as the extent of meaning making were related to classes with more pervasive psychopathology.
Methods: Telephone-based interviews with 433 Dutch and German speaking persons who had lost a significant other at last 6 months earlier were conducted. Self-rated PGD, PTSD, and depression symptoms were assessed. LCA was conducted and correlates of class-membership were examined using the 3step approach.
Results: The LCA resulted in three distinct classes: a no symptoms class (47%), a moderate PGD, low depression/PTSD class (32%), and a high PGD, moderate depression/PTSD class (21%). A multivariate analysis indicated that female gender, a shorter time since loss, an unexpected loss and less meaning made to a loss were significantly associated with membership to the moderate PGD, low depression/PTSD and high PGD, moderate depression/PTSD class compared to membership to the no symptom class. Losing a child or spouse, a shorter time since loss, and having made less meaning to the loss further distinguished between the high PGD, moderate depression/PTSD symptom class and the moderate PGD, low depression/PTSD class.
Discussion: We found that the majority of individuals coped well in response to their loss since the no symptom class was the largest class. Post-loss symptoms could be categorized into classes marked by different intensity of symptoms, rather than qualitatively different symptom patterns. The findings indicate that perceiving the loss as more unexpected, finding less meaning in the loss, and loss-related factors, such as the recentness of a loss and the loss of a partner or child, were related to class membership more consistently than sociodemographic factors.
Introduction
In the face of the death of a significant other, people react differently toward their loss. Grief can take up many forms, often including yearning, sadness, and difficulties experiencing positive emotions. The majority of those who experienced a loss resume daily routines and retake part in social or occupational activities within a couple of months and adjust well (1). For others, adjustment is more difficult and grief reactions may take up the form of prolonged grief disorder (PGD), depression, and/ or, in the face of a loss due to traumatic circumstances, posttraumatic stress disorder (PTSD) (2–5).
Factors accounting for maladjustment to loss are manifold. Sociodemographic factors, such as female gender or lower level of education, play a role in the development of PGD, depression and PTSD, while factors inherent to the death and the deceased such as a close kinship to the deceased, and a shorter time since the death were more consistently shown to be associated with PGD (6–8). A violent or sudden nature of the loss has been demonstrated to be associated with PGD, PTSD and depression (9, 10). The way a bereaved person cognitively processes a loss can have an enormous impact on their adjustment. Meaning-making refers to the capacity of an individual to integrate the loss into their belief system about the world and themselves, and to find an explanation or even growth in the loss (11, 12). It has repeatedly been shown that a greater extent of meaning-making is associated with better adjustment to loss as evidenced in lower rates of PGD, depression and PTSD (11, 13–15). Although these cognitive factors have the potential to be targeted in treatment, they are less often investigated (6).
After decades of research and considerable debate (3, 16, 17), PGD was introduced as diagnostic entity in the 11th version of the International Classification of Diseases (ICD-11), which has come into effect on January 1st, 2022. ICD-11 PGD is characterized by separation distress defined as longing or persistent preoccupation with the deceased accompanied by intense emotional pain (e.g., sadness, guilt, anger, or difficulty accepting the death) (18). A diagnosis can be made when the above-mentioned symptoms last for more than 6 months and exceed the social, cultural, or religious norms of the individual's culture or context. While the related concept “Persistent Complex Bereavement Disorder” (PCBD) was included only as condition for further study (section III) within the Fifth Edition of the Diagnostic and Statistical Manual of Mental Disorders (DSM-5), the American Psychiatric Association added prolonged grief disorder in section II in its newest DSM-5-TR edition published in March 2022 (19, 20). PGD shares several features with PTSD and depression and has been shown to be often comorbid, particularly in the wake of violent losses (6, 21). Yet, evidence similarly exists that PGD constitutes a specific syndrome, with separation distress representing a unique feature that is not captured by other disorders (22–25).
To diverge from the notion of examining how disorders do or do not overlap using diagnostic algorithms, some researchers have explored how symptoms of PGD and other indicators of mental health co-occur in bereaved individuals using latent class analysis (LCA). Latent class analysis is a person-centered statistical approach that finds subtypes of related cases in empirical data and thus explores whether there are subgroups of individuals that endorse similar symptom profiles (26). The majority of previous research on PGD using LCA included only two mental health indicators (e.g., PGD and depression or PGD and PTSD) (27, 28). Only a few studies exploring latent classes of PGD and other indicators of mental health included all three mental health indicators PGD, PTSD, and depression. Most LCA studies found three classes: a no symptom class marked by low probabilities to endorse symptoms, a high distress class marked by high probabilities to endorse all PGD, PTSD, and/or depression symptoms, and a PGD class marked by high probabilities to endorse symptoms specific to PGD (29–31).
Moreover, previous studies on LCA mostly relied on the DSM-definitions of the examined disorders. However, definitions of PGD/PCBD and PTSD in ICD-11 vs. DSM-5 differ from each other with regard to the number and content of the symptoms (18, 32). Research has shown that the overlap between the respective definitions is not optimal and that prevalence rates were higher for ICD-11-PGD than for DSM-5 PCBD (33–36). Findings obtained with one definition of a disorder may thus not necessarily apply to another definition of the disorder.
In the light of the ICD-11 coming into effect, aim of this study was to replicate and extend previous findings by examining latent classes of PGD, PTSD, and depression symptoms in bereaved people using the ICD-11 definitions of the disorders. Based on prior LCA studies in bereaved people, we expected to identify at least three latent classes: a (1) low symptom, (2) PGD only, and (3) high symptom class (29–31). Our second aim was to examine correlates of class-membership. We expected that people in the classes with more pervasive symptomatology were more likely to be female, less educated, to make less meaning of their loss, and more likely to have experienced an unexpected or violent loss (29, 31).
Method Section
Procedure
This cross-sectional study is part of a longitudinal study on TGI-CA Assessment after Loss in Europe (TALE project), which focuses on the development and validation of an instrument to assess a grief disorder as defined in ICD-11 and DSM-5(-TR) (18, 20). For more information about the study and measures used see https://osf.io/a6hmc/. The study is a joint project at the University of Twente, Groningen, Utrecht, and the Freie University Berlin. It was approved by the Ethical Committee of Psychology of the University of Groningen and the Freie University in Berlin. Data were collected between November 2019 and September 2020 through structured telephone interviews. The breakout of the COVID-19 pandemic occurred after interviews with about 300 participants had already been conducted. We continued our efforts to assess data nonetheless. Pandemic-related restrictions may thus have an effect on part of our data. Interviews were conducted by Dutch and German psychologists (all B.A.) who had received a training on the phenomenology and theoretical background of PGD, the use of questionnaire measures, and interview techniques. This study was pre-registered on the Open Science Framework (see https://archive.org/details/osf-registrations-6hzxw-v1).
Participants
Participants were recruited through a convenience sampling approach with the help of self-help organizations, mourning cafés, and hospices. In addition, advertisements were placed on social media as well as in the student pool of the respective universities to recruit participants. Interested participants signed up for the study online and provided their informed consent. They were then contacted by the interviewer to schedule a date for the interview. Participants did not receive financial compensation; however, first year psychology students received course credits for taking part in the study. Inclusion criteria required participants to be 18 years or older and to have lost a significant other (i.e., spouse, family member, or friend) at least 6 months prior to the interview. Exclusion criteria were the presence of a psychotic disorder and acute suicidal ideation assessed with single items in the interview. Interviews took about 45 min to complete. A total of 448 participants were recruited (n = 221 Dutch speaking, n = 227 German speaking). Interviews were not completed with six participants because they fulfilled exclusion criteria. Moreover, nine people were excluded from data analysis as their most significant loss had occurred < 6 months ago, resulting in a final sample size of N = 433.
Measures
The following background and loss-related characteristics were assessed: gender, age of participant, educational level, number of losses, kinship to the deceased, time since loss, cause of loss (i.e., physical illness, accident, suicide, murder/manslaughter, other), unexpectedness of loss (1-5; 1 = totally not unexpected, 5 = completely unexpected), meaning made to the loss [i.e., “To what extent would you say that you were able to give meaning to your loss?”(11) (1 = no meaning through 4 = a good deal of meaning)], history of general psychological support (i.e., “Did you ever receive support for your own problems prior to the death of your loved one from a psychologist, therapist or psychiatrist?” 0 = no, 1 = yes), and received professional bereavement care (i.e., “Did you ever receive support from a psychologist, therapist or psychiatrist related to the death of your loved one?,” 0 = no, 1 = yes).
Traumatic Grief Assessment—Clinician Administered
PGD symptoms were assesses using the TGI-CA. The 22-item TGI-CA was developed in the context of the TALE project and is based on 22-item Traumatic Grief Inventory-Self Report Plus (TGI-SR+; 37). The English, German, and Dutch translation of the TGI-CA are freely available via the Open Science Framework (https://osf.io/a6hmc/). The TGI-SR+ is a reliable and valid survey to assess PGD symptoms in terms of ICD-11 and DSM-5-TR (37). The TGI-CA deviates from the TGI-SR+ in two aspects: (1) in the TGI-SR+ items were phrased as statement, while in the TGI-CA items were phrased as questions, and (2) in the items and instruction of the TGI-SR+ we refer to “deceased loved one,” while in the TGI-CA we replaced this wording with the first name (e.g., “Albert,” “Mary”) or relationship (e.g., “your husband”) of the deceased person. Participants who reported more than one loss were asked to specify which loss was most distressing or most often in their mind and to relate their answers on the TGA-CA to that loss. Participants rated how often they experienced each symptom during the past month with 1 = never, 2 = seldom, 3 = sometimes, 4 = often, 5 = always. PGD according to ICD-11 criteria is measured using the 12 items that correspond to the ICD-11 classification, namely TGI-CA items 1, 2, 3, 5, 8, 9, 10, 16, 19, 20, 21, 22. Internal reliability in the current study was high (α = 0.90).
PTSD Checklist for DSM-5
PTSD symptoms were measured with the Dutch and German version of the PCL-5, a 20-item self-report screening instrument that corresponds to the DSM-5 symptoms of PTSD (38–40). Items are rated on a five-point Likert scale from 1 (not at all) to 5 (extremely). In accordance with previous research (34, 41), six items approximating the ICD-11 operationalization of PTSD were selected to tap ICD-11 PTSD. These items included item 2 (repeated, disturbing dreams), 3 (feeling or acting as if the experience were happening again) 6, (avoidance of internal reminders), 7 (avoidance of external reminders), 17 (being “superalert,” watchful or on guard) and 18 (feeling jumpy, easily startled). Cronbach's alpha levels in the current study was 0.68.
Patient-Health-Questionnaire-9
Depression was assessed using the Dutch and German versions of the Patient Health Questionnaire [PHQ-9; (42–44)]. The PHQ-9 is a dimensional screening instrument consisting of nine items based on the diagnostic criteria of depression according to DSM-5. Participants are asked to indicate the severity on a four-point Likert Scale from 1 (not at all) to 4 (almost every day). Internal consistency for the PHQ was 0.80.
Work and Social Adjustment Scale (WSAS)
The 5-item Work and Social Adjustment Scale (WSAS) was used to measure functional impairment (45–47). People rated on 9-point scales with anchors 1 = not at all through 9 = severely to what extent the death of their loved one impaired them in their (i) work, (ii) household chores, (iii) social activities, (iv) leisure activities, and (v) close relationships. We added the answer option “not applicable” to the item referring to work. The WSAS demonstrated good internal consistency (α = 0.80).
Statistical Analysis
Dichotomized item scores of PGD, PTSD, and depression were used as indicators in the LCA. Following prior research (48, 49), the five-point Likert scale of the ICD-11 PGD items of the TGI-CA and ICD-11 PTSD items of the PCL-5 were dichotomized by treating a score of 1 and 2 as symptom absence and a score of 3, 4, and 5 as symptom presence. For depression the four-point Likert scale was recoded by considering a score of 1 and 2 as symptom absent and a score of 3 and 4 as symptom endorsed (48).
The fit of a 1-class through 6-class model was compared using statistical and non-statistical criteria. Model preference relied on a lower (Sample-Size Adjusted) Bayesian Information Criterion (SA-BIC and BIC) and Akaike's Information Criterion (AIC), bootstrap likelihood ratio test (BLRt) with a p-value of <0.05, (3) higher entropy R2 value, (4) not too small class sample sizes, and (5) accordance with prior LCA research. In case statistical fit indices were indecisive, we relied on the BIC (50). When interpreting LCA symptom profiles, we considered a symptom presentation probability of <0.15 as low, a symptom presentation probability of ≥0.15 and ≤ 0.59 as moderate, and symptom presentation probability of ≥0.60 as high (27). The statistical program LatentGold was used for the LCA (51).
For descriptive purposes we included the total scores on PGD, PTSD, depression, and functional impairment as separate correlates in the model to examine to what extent the classes differed in terms of these severity levels. We did so by using the 3step-approach in LatentGold, which takes the classification error into account when examining correlates of class-membership. We calculated 95% confidence intervals (95% CIs) for class-comparisons. When zero was not included in the 95% CIs the class-comparisons were considered significant.
Correlates of class-membership were examined using again the 3step approach. The following correlates were included simultaneously in a multinomial logistic regression analysis: gender (0 = male, 1 = female), age (in years), educational level (0 = primary, high school, vocational school, 1= university), number of losses (0 = 1 loss, 1 = multiple losses), kinship to the deceased (0 = other than child/spouse, 1 = child/spouse), time since loss (in years), cause of loss (0 = natural, 1 = unnatural), unexpectedness of loss (1-5; 1 = totally not unexpected, 5 = completely unexpected), meaning made to the loss (1 = no sense through 4 = a lot of sense), history of general psychological support (0 = no, 1 = yes), and received professional bereavement care (0 = no, 1 = yes). Based on Chi-square tests and correlation analyses, there was no concern for multicollinearity. Maximum of five responses (1.2%) were missing on the indicators. These missing data were handled using full information maximum likelihood estimation. Missing data on the correlates were handled using listwise deletion. A maximum of one response was missing per correlate.
Results
Participants
Table 1 displays the sample characteristics. The sample consisted of 352 female (81.3%) and 81 male participants (18.7%). The mean age was 43 years (SD = 16.89; range: 18-86). The majority of participants indicated having been born in either Germany (n = 214, 49.9%) or the Netherlands (n = 192; 44.5%). About half of the participants had a university degree as their highest educational attainment (n = 216; 49.9%) and about both a quarter indicated high school (n = 113; 26.1%) or a vocational education (n = 101, 23.3%) as their highest educational attainment.
Loss-Related Variables
More than half of the participants reported having experienced multiple losses. When asked whose loss was the most difficult to cope with, n = 130 (30.0%) reported the loss of a parent, n = 119 (27.5%) the loss of their partner, n = 73 (16.9%) the loss of a grandparent and n = 51 (11.8%) the loss of their child. The average time since the most significant loss was M = 6.7 years (SD = 8.2, range = 6 months-60.7 years). About 20% of the participants had lost their significant other to violent causes and half of the participants indicated that the death of their significant other came “very” or “completely” unexpected. Moreover, 43.9% reported that they had made no or little sense to their loss.
Latent Class Model Fit
The fit indices for the one through six class models are shown in Table 2. When increasing the number of classes, the AIC and SA-BIC values kept decreasing and all entropy R2 values were acceptable (>0.80). The BLRt showed that the two class model showed a significantly better fit than the 1 class model. All other BLRt p-values were >0.05. The BIC value was lowest for the three class model. The three class model showed symptom patterns that accords with prior LCA research in bereaved people (29, 52). We therefore selected the three class model as optimal solution.
Latent Classes of PGD, PTSD, and Depression
See Figure 1 for probability estimates of the three class model. Figures for other latent class models are displayed in the Supplementary Material. The largest class consisted of 204 individuals (47%) and was characterized by low probability of endorsement of PGD, PTSD, and depression symptoms, except for two PGD symptoms and two depression symptoms that had moderate probability. We labeled this class the “no symptom class.” The second class included 139 people (32%) and was marked by moderate to high probability of endorsement of PGD symptoms and low to moderate probability of endorsement of PTSD and depression symptoms. This class was named “Moderate PGD, low depression/ PTSD class.” The third and smallest class comprised 90 people (21%) that had high probability of endorsement of 8 out of 12 PGD symptoms and moderate probability of all PTSD symptoms and moderate probability for five out of nine depression symptoms. We labeled this class the “High PGD, moderate depression/ PTSD class.” The probability estimates and standard errors are shown in Supplementary Table 1.
The three classes differed significantly in severity levels of PGD, PTSD, depression, and functional impairment, such that the “no symptom class” < “moderate PGD, low depression/ PTSD class” < “high PGD, moderate depression/ PTSD class” (see Table 3). See Supplementary Table 2 for estimates and 95% CIs.
Table 3. Univariate associations between PGD, PTSD, depression, and functional impairment levels and classes (N = 433).
Background and Loss-Related Correlates of Classes
Correlates of classes were entered simultaneously into the model. Results are displayed in Table 4. Compared to the “no symptom class,” membership to the “high PGD, moderate depression/ PTSD class” was associated with female gender, the loss of a child or spouse, less time since the loss occurred, unexpectedness of the loss, and less meaning made to the loss. Equally relative to the no symptom class, membership to the moderate PGD, low depression/PTSD class was more likely for female participants, those whose loss had occurred more recently, those who experienced their loss as more unexpected and those who had made less meaning of their loss. Moreover, members of the moderate PGD, low depression/PTSD class were more likely to have received bereavement care than members of the no symptoms class. Lastly, compared to the moderate PGD, low depression/PTSD class, membership to the high PGD, moderate depression/PTSD class was associated with the loss of a child or spouse, less time since the loss, and less meaning made to the loss. Estimates and 95% CIs are presented in Supplementary Table 2.
Discussion
This study examined latent classes of PGD, PTSD, and depression symptoms in a sample of Dutch and German bereaved individuals using the ICD-11 definitions of the disorders. The findings of the current study were broadly in line with previous LCA findings using the DSM definitions of the disorders regarding the number of extracted classes and the factors associated with classes with more pervasive psychopathology.
The LCA revealed that a three-class solution fitted the data best. The largest class was termed no symptoms class and comprised almost half of the participants. It was characterized by low item probabilities for almost all PGD, PTSD, and depression symptoms. The moderate PGD, low depression/PTSD class included a third of the participants and was characterized by low to moderate item probabilities for the PTSD and depression symptoms and moderate to high item probabilities for the PGD symptoms. The smallest class, labeled as high PGD, moderate depression/PTSD class, included the remaining 21% of the sample and was marked by high item probabilities for the majority of PGD and three of the depression symptoms and moderate item probabilities for the PTSD and remaining depression symptoms. A three-class solution is consistent with the majority of LCA studies including PGD, PTSD, and depression symptoms (29, 52, 53). However, while previous LCA studies on PGD found classes that were separable by both severity and quality (or “type”) of symptoms (30, 53), classes in the present study differed merely by the severity of symptoms. This indicates that in the current sample, there was no particular PGD response, but rather a high comorbidity of PGD with PTSD and depression within the more symptomatic classes. Members in the high PGD, moderate depression/PTSD class, had, among other symptoms, high probabilities to experience the PGD symptoms “sadness,” “lack of positive mood,” and depression symptoms “little interest/pleasure” and “feeling tired.” These symptoms overlap in content and may thus contribute to higher comorbidity. On the other hand, items indicative of negative sense of self-worth or blame (i.e., items “blame,” “self-blame,” or “feeling bad about oneself”) had low probabilities across all classes. These observations might support previous research that symptoms centering around specific themes are connected across syndromes (49). While some LCA studies found a particular PTSD class (27, 54) it seems plausible that PTSD classes rather emerge in studies with survivors who have been confronted with both loss and trauma in the context of war or forced displacement.
We also tested the differences in PGD, PTSD, functional impairment and depression scores across the classes. The average severity of PGD, PTSD, depression and functional impairment was highest in the high PGD, moderate depression/PTSD class, followed by the moderate PGD, low depression/PTSD class and was lowest in the no symptom class. Only the average PTSD scores did not differ significantly between no symptom and moderate PGD, low depression/ PTSD classes. We thus concluded that the classes were distinguishable meaningfully.
The second aim of this study was to examine the relationship of several sociodemographic and loss-related factors with class membership. In this study, the subjective perception of the loss (i.e., perceived expectedness and meaning made to the loss) and loss-related factors (such as time since loss and relationship to the deceased) predicted class membership more consistently than sociodemographic factors (such as age, gender, education). More specifically, the extent to which participants had made meaning of their loss and the recentness of the loss distinguished between all classes and having lost a child or spouse additionally distinguished between the moderate PGD, low depression/PTSD and high PGD, moderate depression/PTSD class, while age and education were found to be unrelated. Our finding that the extent of meaning made to the loss clearly distinguishes between the classes is in line with previous findings that showed that less meaning made to a loss was associated with more PGD symptoms (55). This has important implications for clinical practice. Compared to sociodemographic or loss-related factors that are invariant (e.g., gender, relationship to the deceased) or systemic in nature (e.g., time since loss), reconstructing meaning can be addressed in treatment and thus facilitate adjustment. A meaning reconstruction approach through writing assignments and a ritual of remembrance may be a promising intervention to finding meaning and reducing PGD symptoms (56, 57). However, future research should also investigate whether meaning making is indeed a constructive coping strategy that results in “actual” meaning-finding or rather the result of a cognitive bias that also contains illusory aspects (58).
In addition to recentness of the loss and meaning making, having perceived the loss as unexpected, having received professional grief support, and female gender distinguished between the no symptom and the moderate PGD, low depression/PTSD class. Contrary to our hypothesis, the cause of the loss was unrelated to class membership when taking other covariates into account. Our findings suggest that in the current sample, it was rather the subjective perception of the loss (expected vs. unexpected) than the objective cause (violent vs. non-violent loss) that was associated with adverse mental health outcomes. Cause and unexpectedness of death are related constructs as most violent deaths are unexpected and it might be that in our sample, cause did not explain unique variance beyond the unexpectedness of a loss. This accords also with prior findings that an objective measure of unexpectedness (measured as “number of days between forewarning of death and the actual death”) was not associated with PGD symptoms (59), while a subjective measure of perceived unexpectedness was linked to elevated levels of PGD symptoms (60, 61). Further recent research demonstrates that bereaved persons who experienced their loss as unexpected reported higher levels of PGD, even when other variables were controlled (62, 63).
It is a promising finding that among the more symptomatic classes, more than half had sought professional grief support, potentially indicating positive attitudes toward professional help within the current sample. However, half of them did not seek grief support which points again to a treatment gap in bereavement care which has also been identified in prior research (64). It seems conceivable that individuals who had developed symptoms after their loss were also more likely to seek professional grief support. There is some evidence highlighting potential barriers to seeking mental health care among bereaved people, such as thinking the problems will naturally disappear, pain of talking about the loss, and difficulty finding help (64, 65). These two prior studies on barriers to seek support were conducted in people bereaved by traffic accidents and parents who lost a child due to cancer. It would be desirable for future research to examine these barriers in people bereaved by other causes. Finding out about these barriers to professional grief support may entail important knowledge how to approach individuals in need of mental health care, particularly in light of the inclusion of PGD in the ICD-11, which enables evidence-based treatment covered by health insurance.
Limitations
Some aspects should be discussed that may impact the interpretation of results. Data for the current study were gathered before and during the breakout of the COVID-19 pandemic and the pandemic-related restrictions and additional stressors are likely to have had an impact on the well-being of our participants. Research to date has focused primarily on the negative consequences of the pandemic for adults who have suffered a loss due to the virus or during the pandemic (66, 67). Less is known about the impact of the pandemic on the grief intensity of people who have experienced a loss before the pandemic (68). It is possible that social isolation and the respective lack of social support, increased worries about oneself and relatives have increased the mental health burden. For others, the pandemic may also have had a positive effect by providing more time to process a loss. It would be desirable if future research addressed the specific impact of the pandemic on the grief process of the bereaved.
A few limitations should be considered when interpreting the results. Data for the current study were gathered in telephone-based interviews. Even though interviewers were trained, it is possible that differences in data assessment between telephone and in-person administration exist. For example, telephone-based interviews may enable participants to talk more openly about their distress, but misunderstandings due to the lack of transmission of non-verbal cues are possible. Second, we used a selection of PCL-5 items to assess ICD-11 PTSD. Although the PCL-5 is a validated instrument to assess PTSD for DSM-5, it was not developed to assess ICD-11 PTSD. However, items in the PCL-5 are mostly congruent and equivalent in content with the formulation of items within the International Trauma Questionnaire, an instrument specifically developed for the assessment of ICD-11 PTSD (69). Third, different guidelines for interpreting probability estimates have been suggested (27, 70). For the purpose of comparability, we used cut-off scores that are most commonly used in the field of latent classes of PGD. These interpretation guidelines have a relatively low threshold to consider the probability of a symptom as “moderate” or “high.” Similarly, we followed other LCA research (28, 29) by using the three highest answer options on the TGI-CA as symptom presence. For the aforementioned reasons, a possible risk of pathologizing scores should be considered. Fourth, expectedness of loss and meaning making were assessed with one item, respectively. Future research could use multi-item or more observational instruments to assess these constructs, for example the Grief and Meaning Reconstruction Inventory (71). Fifth, despite our efforts to include male participants in our study, female participants predominate this sample by far. Results can thus not be generalized to a male sample. Some evidence suggests that male forms of grief may be different, e.g., that socially constructed ideals may encourage stoic behavior or expression of grief as anger (72, 73). Even though it seems challenging, future research should increase efforts to include men in grief-research to a gender-balanced level. Last, the cross-sectional nature of this study does not allow to draw conclusions about the causal relationship between variables.
Conclusion
In conclusion, LCA revealed three subgroups differing in symptom severity of PGD, PTSD, and depression in a large sample of Dutch and German bereaved individuals. While the majority of bereaved individuals coped well in response to their loss, results show that women, those who had lost a close relative recently and unexpectedly and those who expressed difficulties to make meaning of their loss had a higher probability to show psychological symptoms, in particular PGD and depression.
In cases of more pervasive psychopathology, addressing meaning reconstruction in treatment might be an important pathway to help bereaved individuals to integrate the loss into their world view. More than half of participants in the more pervasive symptom classes received professional grief support, which can be interpreted as an encouraging indication of the openness toward professional support among those in need of help.
Data Availability Statement
The datasets presented in this study can be found in online repositories. The names of the repository/repositories and accession number(s) can be found at: https://osf.io/a6hmc/.
Ethics Statement
The studies involving human participants were reviewed and approved by Freie University Berlin and University of Groningen. The patients/participants provided their written informed consent to participate in this study.
Author Contributions
CH and LL are responsible for the study design and concept. Data were assessed by CH, MF, HH, and LL. LL undertook the statistical analyses. CH and LL drafted the manuscript, which was critically revised by CK, HH, and MF. All authors contributed to and have approved the final manuscript.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Acknowledgments
We acknowledge support by the Open Access Publication Initiative of Freie Universität Berlin. We would like to express our gratitude to the following people for their support in recruiting participants and collecting the data by telephone interviews: Stance Hollander, Marleen van den Munckhof, Ria Vranken, Noa Becker, Philip Frohn, Nina Heeres, Marianne Hoekstra, Marjel Buiter, Jil Maiß, Judith Kramer, Annalena Korn, Judith Walther, and Leah Fisches. We would also like to thank Heidi Müller, Iris Hilgeman, Sarah Schoenmakers, Sanne ten Broeke, Ewout Poelmann, Daan van Heertum, and Faber van der Klift for their help with recruitment.
Supplementary Material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyt.2022.878773/full#supplementary-material
References
1. Nielsen MK, Carlsen AH, Neergaard MA, Bidstrup PE, Guldin M-B. Looking beyond the mean in grief trajectories: A prospective, population-based cohort study. Soc Sci Med. (2019) 232:460–9. doi: 10.1016/j.socscimed.2018.10.007
2. Rosner R, Comtesse H, Vogel A, Doering BK. Prevalence of prolonged grief disorder. J Affect Disord. (2021) 287:301–7. doi: 10.1016/j.jad.2021.03.058
3. Prigerson HG, Horowitz MJ, Jacobs SC, Parkes CM, Aslan M, Goodkin K, et al. Prolonged grief disorder: psychometric validation of criteria proposed for DSM-V and ICD-11. PLoS Med. (2009) 6:e10000121. doi: 10.1371/journal.pmed.1000121
4. Lenferink LIM, Nickerson A, De Keijser J, Smid GE, Boelen PA. Reciprocal associations among symptom levels of disturbed grief, posttraumatic stress, and depression following traumatic loss: a four-wave cross-lagged study. Clin Psychol Sci. (2019) 7:1330–9. doi: 10.1177/2167702619858288
5. Kuo SC, Sun JL, Tang ST. Trajectories of depressive symptoms for bereaved family members of chronically ill patients: a systematic review. J Clin Nurs. (2017) 26:3784–99. doi: 10.1111/jocn.13720
6. Heeke C, Kampisiou C, Niemeyer H, Knaevelsrud C. A systematic review and meta-analysis of correlates of prolonged grief disorder in adults exposed to violent loss. Eur J Psychotraumatol. (2019) 10:1583524. doi: 10.1080/20008198.2019.1583524
7. Lobb EA, Kristjanson LJ, Aoun SM, Monterosso L, Halkett GKB, Davies A. Predictors of complicated grief: a systematic review of empirical studies. Death Stud. (2010) 34:673–98. doi: 10.1080/07481187.2010.496686
8. Wijngaards-De Meij L, Stroebe M, Schut H, Stroebe W, Van Bout JD, Van Der Heijden P, et al. Couples at risk following the death of their child: predictors of grief versus depression. J Consult Clin Psychol. (2005) 73:617–23. doi: 10.1037/0022-006X.73.4.617
9. Boelen PA, De Keijser J, Smid G. Cognitive–behavioral variables mediate the impact of violent loss on post-loss psychopathology. Psychol Trauma Theory Res Pract Policy. (2015) 7:382. doi: 10.1037/tra0000018
10. Mancini AD, Prati G, Black S. Self-worth mediates the effects of violent loss on PTSD symptoms. J Trauma Stress. (2011) 24:116–20. doi: 10.1002/jts.20597
11. Currier JM, Holland JM, Neimeyer RA. Sense-making, grief, and the experience of violent loss: toward a mediational model. Death Stud. (2006) 30:403–28. doi: 10.1080/07481180600614351
12. Milman E, Neimeyer RA, Fitzpatrick M, Mackinnon CJ, Muis KR, Cohen SR. Prolonged grief and the disruption of meaning: establishing a mediation model. J Couns Psychol. (2019) 66:714–25. doi: 10.1037/cou0000370
13. Neimeyer RA, Baldwin SA, Gillies J. Continuing bonds and reconstructing meaning: mitigating complications in bereavement. Death Stud. (2006) 30:715–38. doi: 10.1080/07481180600848322
14. Coleman RA, Neimeyer RA. Measuring meaning: searching for and making sense of spousal loss in late-life. Death Stud. (2010) 34:804–34. doi: 10.1080/07481181003761625
15. Norris-Bell RL. Bereavement among urban university students: the role of meaning making in adjustment to loss. ProQuest Inform Learn. (2013) 74.
16. Prigerson HG, Maciejewski PK, Reynolds CF, Bierhals AJ, Newsom JT, Fasiczka A, et al. Inventory of complicated grief: a scale to measure maladaptive symptoms of loss. Psychiatry Res. (1995) 59:65–79. doi: 10.1016/0165-1781(95)02757-2
17. Horowitz MJ, Siegel B, Holen A, Bonanno GA, Milbrath C, Stinson CH. Diagnostic criteria for complicated grief disorder. Am J Psychiatry. (1997) 154:904–10. doi: 10.1176/ajp.154.7.904
18. World Health Organization. ICD-11 for Mortality and Morbidity Statistics: 6B42 Prolonged grief disorder (2019). Available online at: https://icd.who.int/browse11/l-m/en#/http://id.who.int/icd/entity/1183832314 (accessed December 23, 2021).
19. Prigerson HG, Boelen PA, Xu J, Smith KV, Maciejewski PK. Validation of the new DSM-5-TR criteria for prolonged grief disorder and the PG-13-Revised (PG-13-R) scale. World Psychiatry. (2021) 20:96–106. doi: 10.1002/wps.20823
20. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders (DSM-5-TR), Washington, DC: American Psychiatric Association Publishing (2022).
21. Simon NM, Shear MK, Reynolds CF, Cozza SJ, Mauro C, Zisook S, et al. Commentary on evidence in support of a grief-related condition as a DSM diagnosis. Depress Anxiety. (2020) 37:9–16. doi: 10.1002/da.22985
22. Dillen L, Fontaine JRJ, Verhofstadt-Deneve L. Confirming the distinctiveness of complicated grief from depression and anxiety among adolescents. Death Stud. (2009) 33:437–61. doi: 10.1080/07481180902805673
23. Maercker A, Znoj H. The younger sibling of PTSD: Similarities and differences between complicated grief and posttraumatic stress disorder. Eur J Psychotraumatol. (2010) 1. doi: 10.3402/ejpt.v1i0.5558
24. Robinaugh DJ, Mauro C, Bui E, Stone L, Shah R, Wang Y, et al. Yearning and its measurement in complicated grief. J Loss Trauma. (2016) 21:410–20. doi: 10.1080/15325024.2015.1110447
25. Lenferink LIM, Van Den Munckhof MJA, De Keijser J, Boelen PA. DSM-5-TR prolonged grief disorder and DSM-5 posttraumatic stress disorder are related, yet distinct: confirmatory factor analyses in traumatically bereaved people. Eur J Psychotraumatol. (2021) 12:1386988. doi: 10.1080/20008198.2021.2000131
26. Colins LM, Lanza ST. Latent Class and Latent Transition Analysis: With Applications in the Social, Behavioral, and Health Sciences. Hoboken, NJ: Wiley (2010).
27. Nickerson A, Liddell BJ, Maccallum F, Steel Z, Silove D, Bryant RA. Posttraumatic stress disorder and prolonged grief in refugees exposed to trauma and loss. BMC Psychiatry. (2014) 14. doi: 10.1186/1471-244X-14-106
28. Kokou-Kpolou CK, Adansikou K, Park S, Hajizadeh S, Iorfa SK, Cénat JM. Prolonged grief and posttraumatic growth among middle-aged and older widowed persons: a latent class analysis and testing for the role of social support. Death Stud. (2021). doi: 10.1080/07481187.2021.1978115
29. Boelen PA. Symptoms of prolonged grief disorder as per DSM-5-TR, posttraumatic stress, and depression: latent classes and correlations with anxious and depressive avoidance. Psychiatry Res. (2021) 302:114033. doi: 10.1016/j.psychres.2021.114033
30. Boelen PA, Lenferink LIM. Symptoms of prolonged grief, posttraumatic stress, and depression in recently bereaved people: symptom profiles, predictive value, and cognitive behavioural correlates. Soc Psychiatry Psychiatr Epidemiol. 55:765–77. (2019). doi: 10.1007/s00127-019-01776-w
31. Djelantik A, Smid GE, Kleber RJ, Boelen PA. Symptoms of prolonged grief, post-traumatic stress, and depression after loss in a Dutch community sample: a latent class analysis. Psychiatry Res. (2017) 247:276–81. doi: 10.1016/j.psychres.2016.11.023
32. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders (DSM-5). Washington, DC: American Psychiatric Publishing (2013).
33. Boelen PA, Lenferink LIM. Comparison of six proposed diagnostic criteria sets for disturbed grief. Psychiatry Res. (2020) 285:112786. doi: 10.1016/j.psychres.2020.112786
34. Schellong J, Hanschmidt F, Ehring T, Knaevelsrud C, Schäfer I, Rau H, et al. Diagnostik der PTBS im Spannungsfeld von DSM-5 und ICD-11. Nervenarzt. (2019) 90:733–39. doi: 10.1007/s00115-018-0668-0
35. Brewin CR, Cloitre M, Hyland P, Shevlin M, Maercker A, Bryant RA, et al. A review of current evidence regarding the ICD-11 proposals for diagnosing PTSD and complex PTSD. Clin Psychol Rev. (2017) 58:1–15. doi: 10.1016/j.cpr.2017.09.001
36. Cozza SJ, Shear MK, Reynolds CF, Fisher JE, Zhou J, Maercker A, et al. Optimizing the clinical utility of four proposed criteria for a persistent and impairing grief disorder by emphasizing core, rather than associated symptoms. Psychol Med. (2020) 50:438–45. doi: 10.1017/S0033291719000254
37. Lenferink LIM, Eisma MC, Smid GE, De Keijser J, Boelen PA. Valid measurement of DSM-5 persistent complex bereavement disorder and DSM-5-TR and ICD-11 prolonged grief disorder: the Traumatic Grief Inventory-Self Report Plus (TGI-SR+). Compr Psychiatry. (2022) 112:152281. doi: 10.1016/j.comppsych.2021.152281
38. Weathers FW, Litz BT, Keane TM, Palmieri PA, Marx BP, Schnurr PP. The PTSD Checklist for DSM-5 (PCL-5). Boston, MA: National Center for PTSD (2013).
39. Krüger-Gottschalk A, Knaevelsrud C, Rau H, Dyer A, Schäfer I, Schellong J, et al. The German version of the Posttraumatic Stress Disorder Checklist for DSM-5 (PCL-5): psychometric properties and diagnostic utility. BMC Psychiatry. (2017) 17:379. doi: 10.1186/s12888-017-1541-6
40. Boeschoten M, Bakker A, Jongedijk R, Olff M. PTSD Checklist for DSM-5–Dutch Version. Diemen: Arq Psychotrauma Expert Group (2014).
41. Kuester A, Köhler K, Ehring T, Knaevelsrud C, Kober L, Krüger-Gottschalk A, et al. Comparison of DSM-5 and proposed ICD-11 criteria for PTSD with DSM-IV and ICD-10: changes in PTSD prevalence in military personnel. Eur J Psychotraumatol. (2017) 8:1386988. doi: 10.1080/20008198.2017.1386988
42. Gräfe K, Zipfel S, Herzog W, Löwe B. Screening psychischer Störungen mit dem Gesundheitsfragebogen für Patienten (PHQ-D). Diagnostica. (2004) 50:171–81. doi: 10.1026/0012-1924.50.4.171
43. Kroenke K, Spitzer RL, Williams JBW. The PHQ-9. J Gen Intern Med. (2001) 16:606–13. doi: 10.1046/j.1525-1497.2001.016009606.x
44. Van Steenbergen-Weijenburg KM, De Vroege L, Ploeger RR, Brals JW, Vloedbeld MG, Veneman TF, et al. Validation of the PHQ-9 as a screening instrument for depression in diabetes patients in specialized outpatient clinics. BMC Health Serv Res. (2010) 10:235. doi: 10.1186/1472-6963-10-235
45. Lutz W, Neu R, Rubel JA. Evaluation und Effekterfassung in der Psychotherapie, Göttingen: Hogrefe Verlag (2019). doi: 10.1026/02912-000
46. De Graaf LE, Gerhards SAH, Arntz A, Riper H, Metsemakers JFM, Evers SMAA, et al. Clinical effectiveness of online computerised cognitive–behavioural therapy without support for depression in primary care: randomised trial. Br J Psychiatry. (2009) 195:73–80. doi: 10.1192/bjp.bp.108.054429
47. Mundt JC, Marks IM, Shear MK, Greist JM. The Work and Social Adjustment Scale: a simple measure of impairment in functioning. Br J Psychiatry. (2002) 180:461–4. doi: 10.1192/bjp.180.5.461
48. Soydas S, Smid GE, Lenferink LIM, Djelantik AAMJ, Goodfellow B, Wilson R, et al. Psychopathology in a treatment-seeking sample of homicidally bereaved individuals: Latent class analysis. J Affect Disord. (2021) 292:234–41. doi: 10.1016/j.jad.2021.05.026
49. Djelantik A, Robinaugh DJ, Kleber RJ, Smid GE, Boelen PA. Symptomatology following loss and trauma: Latent class and network analyses of prolonged grief disorder, posttraumatic stress disorder, and depression in a treatment-seeking trauma-exposed sample. Depress Anxiety. (2020) 37:26–34. doi: 10.1002/da.22880
50. Van De Schoot R, Sijbrandij M, Winter SD, Depaoli S, Vermunt JK. The GRoLTS-checklist: guidelines for reporting on latent trajectory studies. Struct Equation Model Multidisciplin J. (2017) 24:451–67. doi: 10.1080/10705511.2016.1247646
51. Vermunt JK, Magidson J. Latent GOLD 5.0 Upgrade Manual. Belmont, MA: Statistical Innovations Inc (2013).
52. Lenferink LIM, De Keijser J, Smid GE, Djelantik A, Boelen PA. Prolonged grief, depression, and posttraumatic stress in disaster-bereaved individuals: latent class analysis. Eur J Psychotraumatol. (2017) 8:1298311. doi: 10.1080/20008198.2017.1298311
53. Djelantik A, Aryani P, Boelen PA, Lesmana CBJ, Kleber RJ. Prolonged grief disorder, posttraumatic stress disorder, and depression following traffic accidents among bereaved Balinese family members: Prevalence, latent classes and cultural correlates. J Affect Disord. (2021) 292:773–81. doi: 10.1016/j.jad.2021.05.085
54. Heeke C, Stammel N, Heinrich M, Knaevelsrud C. Conflict-related trauma and bereavement: exploring differential symptom profiles of prolonged grief and posttraumatic stress disorder. BMC Psychiatry. (2017) 17. doi: 10.1186/s12888-017-1286-2
55. Keesee NJ, Currier JM, Neimeyer RA. Predictors of grief following the death of one's child: the contribution of finding meaning. J Clin Psychol. (2008) 64:1145–63. doi: 10.1002/jclp.20502
56. Wojtkowiak J, Lind J, Smid GE. Ritual in therapy for prolonged grief: a scoping review of ritual elements in evidence-informed grief interventions. Front Psychiatry. (2021) 11. doi: 10.3389/fpsyt.2020.623835
57. Neimeyer RA, Young-Eisendrath P. Assessing a buddhist treatment for bereavement and loss: the mustard seed project. Death Stud. (2015) 39:263–73. doi: 10.1080/07481187.2014.937973
58. Frazier P, Tennen H, Gavian M, Park C, Tomich P, Tashiro T. Does self-reported posttraumatic growth reflect genuine positive change? Psychol Sci. (2009) 20:912–9. doi: 10.1111/j.1467-9280.2009.02381.x
59. Kaltman S, Bonanno GA. Trauma and bereavement: examining the impact of sudden and violent deaths. J Anxiety Disord. (2003) 17:131–47. doi: 10.1016/S0887-6185(02)00184-6
60. Nielsen MK, Neergaard MA, Jensen AB, Vedsted P, Bro F, Guldin MB. Preloss grief in family caregivers during end-of-life cancer care: a nationwide population-based cohort study. Psychooncology. (2017) 26:2048–56. doi: 10.1002/pon.4416
61. Barry LC, Kasl SV, Prigerson HG. Psychiatric disorders among bereaved persons - The role of perceived circumstances of death and preparedness for death. Am J Geriatr Psychiatry. (2002) 10:447–57. doi: 10.1097/00019442-200207000-00011
62. Doering BK, Barke A, Vogel A, Comtesse H, Rosner R. Predictors of prolonged grief disorder in a German representative population sample: unexpectedness of bereavement contributes to grief severity and prolonged grief disorder. Front Psychiatry. (2022) 13:853698. doi: 10.3389/fpsyt.2022.853698
63. Sekowski M, Prigerson HG. Disorganized attachment and prolonged grief. J Clin Psychol. (2022) 1–18. doi: 10.1002/jclp.23325
64. Lenferink LIM, De Keijser J, Eisma MC, Smid GE, Boelen PA. Treatment gap in bereavement care: (Online) bereavement support needs and use after traumatic loss. Clin Psychol Psychother. (2021) 28:907–16. doi: 10.1002/cpp.2544
65. Lichtenthal WG, Corner GW, Sweeney CR, Wiener L, Roberts KE, Baser RE, et al. Mental health services for parents who lost a child to cancer: If we build them, will they come? J Clin Oncol. (2015) 33:406. doi: 10.1200/JCO.2014.59.0406
66. Goveas JS, Shear MK. Grief and the COVID-19 pandemic in older adults. Am J Geriatr Psychiatry. (2020) 28:1119–25. doi: 10.1016/j.jagp.2020.06.021
67. Tang S, Xiang Z. Who suffered most after deaths due to COVID-19? Prevalence and correlates of prolonged grief disorder in COVID-19 related bereaved adults. Glob Health. (2021) 17:19. doi: 10.1186/s12992-021-00669-5
68. Eisma MC, Tamminga A. Grief before and during the COVID-19 pandemic: multiple group comparisons. J Pain Symptom Manage. (2020) 60:e1–4. doi: 10.1016/j.jpainsymman.2020.10.004
69. Cloitre M, Shevlin M, Brewin C, Bisson JI, Roberts NP, Maercker A, et al. The International Trauma Questionnaire: development of a self-report measure of ICD-11 PTSD and complex PTSD. Acta Psychiatr Scand. (2018) 138:536–46. doi: 10.1111/acps.12956
70. Masyn KE. Latent class analysis and finite mixture modeling. In: Little TD, Little TD, editors. The Oxford Handbook of Quantitative Methods (Vol 2): Statistical analysis. New York, NY: Oxford University Press (2013).
71. Gillies JM, Neimeyer RA, Milman E. The Grief and meaning reconstruction inventory (GMRI): initial validation of a new measure. Death Stud. (2015) 39:61–74. doi: 10.1080/07481187.2014.907089
72. Creighton G, Oliffe JL, Butterwick S, Saewyc E. After the death of a friend: young Men's grief and masculine identities. Soc Sci Med. (2013) 84:35–43. doi: 10.1016/j.socscimed.2013.02.022
Keywords: prolonged grief, PTSD, depression, latent classes, meaning making
Citation: Heeke C, Franzen M, Hofmann H, Knaevelsrud C and Lenferink LIM (2022) A Latent Class Analysis on Symptoms of Prolonged Grief, Post-Traumatic Stress, and Depression Following the Loss of a Loved One. Front. Psychiatry 13:878773. doi: 10.3389/fpsyt.2022.878773
Received: 18 February 2022; Accepted: 05 May 2022;
Published: 27 May 2022.
Edited by:
Michal Mahat-Shamir, Ariel University, IsraelReviewed by:
Marcin Sekowski, The Maria Grzegorzewska University, PolandRachele Mariani, Sapienza University of Rome, Italy
Copyright © 2022 Heeke, Franzen, Hofmann, Knaevelsrud and Lenferink. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Carina Heeke, Y2FyaW5hLmhlZWtlJiN4MDAwNDA7ZnUtYmVybGluLmRl