- 1Department of Psychology, University of Oslo, Oslo, Norway
- 2Neurovascular Research Laboratory, Vall d’Hebron Research Institute, Barcelona, Balearic Islands, Spain
- 3BarcelonaBeta Brain Research Center, Barcelona, Catalonia, Spain
- 4Department of Neurosurgery, Cruces University Hospital, Bilbao, Spain
Introduction: There is controversy regarding the comorbidity of posttraumatic stress disorder (PTSD) and traumatic brain injury (TBI). The present study translated the PTSD Checklist for DSM-5 (PCL-5) to Spanish and validated it in a sample of patients with TBI 6 months after the injury.
Methods: The study included 233 patients (162 males and 71 females) recruited from four Spanish hospitals within 24 h of traumatic brain injury. A total of 12.2% of the sample met the provisional PTSD diagnostic criteria, and the prevalence was equal between male and female participants.
Results: The analysis confirmed the internal consistency of the translated instrument (α = 0.95). The concurrent validity of the instrument was confirmed based on high correlation coefficients of 0.7 and 0.74 with the General Anxiety Disorder-7 (GAD-7) and Patient Health Questionnaire (PHQ-9), respectively. Exploratory factor analysis also confirmed that the items on the PCL-5 can be differentiated from the GAD-7 and PHQ-9 items. Confirmatory factor analysis (CFA) was used to examine the structural validity of the Spanish translation of the PCL-5 with three different models. CFA partially confirmed the four-factor PTSD model, whereas both the six-factor anhedonia model and the seven-factor hybrid model showed adequate fit. However, the difference between the anhedonia and hybrid models was not statistically significant; moreover, both models showed signs of overfitting. Therefore, the utility of these models should be reexamined in future studies.
Conclusion: Overall, the results suggest that the Spanish translation of the PCL-5 is a reliable and valid instrument for screening PTSD symptoms among Spanish TBI patients. The Spanish translation of the PCL-5 is also presented in the manuscript.
Introduction
One of the widely used instruments for assessing posttraumatic stress disorder (PTSD) is the PTSD Checklist (PCL; Weathers et al., 1993; Blanchard et al., 1996), which was developed based on the DSM-IV diagnostic criteria for PTSD (American Psychiatric Association, 1994). The PCL has shown good psychometric properties for a variety of samples (Keen et al., 2008; McDonald and Calhoun, 2010). The fifth version of the DSM (DSM-5; American Psychiatric Association, 2013) introduces different classification criteria for PTSD, placing it in the category of trauma-and stressor-related disorders (American Psychiatric Association, 2013; Weathers et al., 2014); consequently, the PCL-5 questionnaire was developed to correspond to the new diagnostic criteria (Weathers et al., 2013). The PCL-5 has been validated for a variety of languages, such as Chinese, French, German, Persian, and Dutch (Wang et al., 2015; Ashbaugh et al., 2016; Bovin et al., 2016; Sadeghi et al., 2016; Krüger-Gottschalk et al., 2017; Van Praag et al., 2020). The current study is the first to translate this instrument to Spanish and examine the reliability and validity of the translated version in a sample of individuals with traumatic brain injury (TBI).
PTSD models
There is controversy regarding the factorial structure of PTSD. The four-factor PTSD model derived from the symptom categories of the DSM-5 – frequently referred to as the DSM-5 PTSD model – is often criticized in the literature for lacking structural validity (Armour et al., 2015). The DSM-5 has eight criteria for the diagnosis of PTSD, and these criteria apply to adults, adolescents, and children older than 6 years (different PTSD criteria are provided for younger children). However, the main PTSD symptoms are divided in four categories: (B) intrusion, (C) avoidance, (D) negative alterations in cognitions and mood, and (E) alterations in arousal and reactivity. The other categories (A, F, G, and H) focus on additional diagnostic requirements, such as exposure to trauma (direct, indirect, witnessed, etc.) as well as the causes of the symptoms and the duration of the disturbance, which should last for a minimum of 1 month. Therefore, the four-factor model is constructed using the B, C, D, and E categories. In recent years, several PTSD models have been proposed to show a better fit than the aforementioned four-factor DSM-5 model. The majority of these models are consistent with DSM-5 symptoms and only vary in terms of suggesting different factors, breaking a category of symptoms into smaller groups of highly related symptoms. Two of these models have gained more popularity, i.e., the six-factor anhedonia model (Liu et al., 2014) and the seven-factor hybrid model (Armour et al., 2015). The anhedonia model breaks the “negative alterations in cognitions and mood” factor into two factors: “negative affect” and “anhedonia.” It also distinguishes “dysphoric arousal” from “anxious arousal” by dividing the “alterations in arousal and reactivity” factor. Like the anhedonia model, the hybrid model also suggested a division in the “negative alterations in cognitions and mood” factor. However, it suggests a three arousal factors instead of the “alterations in arousal and reactivity” factor, namely, “dysphoric arousal,” “anxious arousal,” and “externalizing behavior.”
Comorbidity of PTSD and TBI
The prevalence of PTSD among individuals suffering from TBI has been an area of dispute (Jaffee et al., 2007). Recent studies suggest that PTSD occurs more frequently after mild TBI (Carlson et al., 2011; for a review, see Van Praag et al., 2019). The DSM-5 added a section for differential diagnosis between PTSD and TBI and warned that PTSD and TBI-related neurocognitive symptoms may overlap or occur concurrently. There are a few symptoms that are specific to PTSD, such as avoidance, as well as symptoms specific to TBI, such as disorientation and confusion. Nevertheless, there is a high risk of comorbidity between PTSD and TBI. For instance, the prevalence of PTSD is estimated to be as high as 32 to 66% among veterans with a history of TBI (Hoge et al., 2014), and for civilians with a history of TBI, it has been estimated to range from 11 to 40% across different reports (Bryant et al., 2001; Bombardier et al., 2006; Haarbauer-Krupa et al., 2017). For both veterans and civilians, the estimated occurrence rate has a wide range, which indicates that additional research on the prevalence of PTSD after TBI, as well as reliable PTSD screening instruments, is needed.
Current study
The first aim of the current study was to translate the PCL-5 to the Spanish language. The second aim of the study was to assess the validity and reliability of the translated version among a sample of individuals with TBI. The third purpose of this study was to assess the prevalence of a provisional PTSD diagnosis among TBI patients 6 months after the injury. Finally, this study assessed three factorial models, including the four-factor PTSD model directly derived from the DSM-5, the anhedonia model and the hybrid model. Based on the literature, we expected that both models provide better fits than the four-factor model. To our knowledge, this manuscript is the first to publish a systematic translation of the PCL-5 to the Spanish language and examine its psychometric properties.
Method
Sample
The data used in this article are from 6-month postinjury assessments, as PTSD symptoms are expected to be more evident approximately 6 months after the TBI occurs (Bombardier et al., 2006; Haarbauer-Krupa et al., 2017). The data were obtained from four medical centers in Spain (Barcelona, Bilbao, Valencia, and Madrid) that participated in a prospective longitudinal nonrandomized observational study carried out by the Collaborative European NeuroTrauma Effectiveness Research in TBI (CENTER-TBI). The data for the CENTER-TBI study were collected through the Quesgen Electronic Case Report Form (e-CRF; Quesgen Systems, Inc., USA), hosted on the INCF platform1 and extracted via the INCF Neurobot tool (INCF, Sweden). The CENTER-TBI study included all participants who attended one of the involved hospitals within 24 h of the injury, had a clinical diagnosis of TBI with a clinical indication for CT scan, and signed an informed consent form to participate in the study. There was no age limit, and only patients with severe preexisting neurological disorders were excluded from the study. The current analysis, however, was carried out on participants who were at least 16 years old, which was the recommended age for the questionnaires used herein.
Measures
The CENTER-TBI study included multiple outcome assessments conducted by a physician, neuropsychologist, and/or study nurse. The assessments were carried out 6 months after the TBI occurred. The data used herein only included the questionnaires completed by the patients 6 months after the injury. These instruments are further explained below.
PCL-5
Participants were asked to complete the 20-item PCL-5. Compared to the PCL, the most notable changes in the PCL-5 are the addition of three items for assessing the new PTSD symptoms recognized by the DSM-5: blame, negative emotions and self-destructive behavior (Blevins et al., 2015). Moreover, some of the items from the original PCL were reworded to reflect the new criteria of the DSM-5. Finally, the Likert rating scale was changed from 1–5 to 0–4. For example, the first item inquires “In the past month, how much were you bothered by repeated, disturbing, and unwanted memories of the stressful experience?,” and the possible responses range from 0 (not at all) to 4 (extremely). Therefore, the sum of the scores of the PCL-5 can range from 0 to 80. Even though the PCL-5 is a screening instrument and is not sufficient for making a diagnosis on its own, several cutoff values are suggested for provisional diagnosis, ranging from 28 to 38 (Ashbaugh et al., 2016). The commonly used cutoff score for the PCL-5 is 33, as recommended by Weathers et al. (2013).
The translation and linguistic validation of the PCL-5 from English to Spanish followed a strict procedure by a team of CENTER-TBI collaborators. First, two independent Spanish translations of the PCL-5 were made by native Spanish speakers who were fluent in English. Next, a consensus version was developed by combining the two translations. This version was further edited by a psychologist in collaboration with the translators to confirm the conceptual equivalence. Then, a native English speaker who was fluent in Spanish retranslated the consensus version, and all the translators involved in the procedure approved the back-translation to be compatible with the original version. Furthermore, a cognitive debriefing of the translated instrument was performed. Three PTSD patients and three healthy volunteers were interviewed and asked to comment on the items to ensure that participants comprehended the items as intended by the original instrument. Finally, after reviewing the results of the cognitive debriefing interviews, further adjustments were made to the translation by five language coordinators involved in the CENTER-TBI study. The Spanish translation of the PCL-5 is included in the Appendix.
PHQ-9
The PHQ-9 (Kroenke et al., 2001; Kroenke and Spitzer, 2002) is the mood subscale of the Patient Health Questionnaire (PHQ), which includes 9 items corresponding to depression criteria in the DSM-IV. The PHQ-9 items ask participants how often the symptoms have bothered them within the previous 2 weeks, and the responses are provided on a Likert scale ranging from 0 (not at all) to 3 (nearly every day). Therefore, the total score of the questionnaire ranges from 0 to 27. The PHQ-9 has been used for screening for depression (Kroenke et al., 2001; Kroenke and Spitzer, 2002; Löwe et al., 2004; Martin et al., 2006) and has been shown to exhibit good validity and reliability among the general population and TBI patients (Teymoori et al., 2020a,b).
GAD-7
The GAD-7 (Spitzer et al., 2006) is a brief, 7-item self-report scale for measuring the severity of general anxiety disorder (GAD). The questionnaire is based on the DSM-IV and assesses how often the subject has been affected by GAD symptoms within the last 2 weeks. Each item is answered on a Likert scale ranging from 0 (not at all) to 3 (nearly every day). The scale’s score is computed by summing the scores of the items, with the total score ranging from 0 to 21. The reliability and validity of the GAD-7 have been confirmed in different populations (Swinson, 2006; Löwe et al., 2008; Ruiz et al., 2011; Beard and Björgvinsson, 2014).
Sociodemographic and health data
The sociodemographic background assessment included age, sex, race, level of education, employment status and marital status. Furthermore, participants were asked to provide details about the cause of their injury and their mental health history before the head injury. In particular, the participants were asked whether they had (1) sought treatment for problems related to use of alcohol or other substances, (2) sought treatment for mood or anxiety-related disorders (e.g., depression), (3) sought treatment for any other mental health problem, or (4) been admitted to the hospital for psychiatric reasons. A binary variable was created to mark preexisting mental health issues based on participants’ self-reported history of mental health, where 0 was lack of seeking help for mental health problems and 1 meant seeking help for one or more of the aforementioned categories. Finally, we also included patient type of admission to the hospital, which was categorized into three types: emergency (ER), admission (AD), and intensive care unit (ICU).
Statistical analyses
Reliability
The reliability of the Spanish PCL-5 was examined at the item level and the scale level. At the item level, the items’ mean score and distribution skewness were evaluated to check for anomalies. At the scale level, Cronbach’s alpha, split-half, item-total correlations, and McDonald’s omega are reported. As a rule of thumb, the literature suggests that Cronbach’s alpha coefficients ranging from 0.7 to 0.95 indicate acceptable reliability (Tavakol and Dennick, 2011) at the group level. However, some studies have suggested that a minimum alpha of 0.90 is adequate and that an alpha of 0.95 is desirable when examining the clinical application of instruments at the individual level (Bland and Altman, 1997). For the split-half analysis, we used the R package psych version 1.7.8 (Revelle, 2017) with its default setting (10,000 random split-halves).
Validity
The concurrent validity of the Spanish PCL-5 was examined by evaluating the relationship of PTSD with depression and general anxiety measured at 6 months postinjury. PTSD was expected to be strongly correlated with depression and general anxiety. Additionally, the structural validity of the instrument was examined using both exploratory factor analysis (EFA) and confirmatory factor analysis (CFA). For the EFA, parallel analysis with the MinRes algorithm from the psych R package (Revelle, 2017) was carried out to identify the number of factors for the PCL-5 instrument. An additional parallel analysis and EFA were carried out to examine whether items in the PCL-5 cluster were affected by distinct factors and thus could be differentiated from items in the PHQ-9 and GAD-7 instruments. For the CFA, the four-factor DSM-5 model, the six-factor anhedonia (Liu et al., 2014) and the seven-factor hybrid models (Armour et al., 2015) were assessed. To carry out the CFA analyses, each item was specified to load on only one latent factor, and only correlations between the latent variables were allowed. The CFA analyses were performed using the weighted least square mean and variance adjusted (WLSMV) estimator (Muthén et al., 1997) in R statistical software version 3.4.1 and the lavaan package version 0.6.1 (Rosseel, 2012). The WLSMV estimator is known to be more appropriate than the maximum likelihood (ML) estimator for performing CFA analysis on ordinal variables (Beauducel and Herzberg, 2006) and can result in less biased estimations (Nussbeck et al., 2006). The fitness of the CFA models was evaluated with the chi-square goodness of fit, root mean square error of approximation (RMSEA), RMSEA confidence interval, standardized root mean square residual (SRMR), comparative fit index (CFI), and Tucker Lewis index (TLI). For evaluating the CFA results, values of CFI and TLI above 0.95, RMSEA less than 0.06, and SRMR below 0.08 were considered to indicate adequate model fit (Hu and Bentler, 1999). Despite the dominant role of goodness-of-fit chi-square statistics in model testing, the chi-square test is known to be too liberal (Bryant and Satorra, 2012). Furthermore, many factors can lead to a type I error, such as sample size, model complexity, multivariate normality, and skewness (Marsh et al., 1988; Green et al., 1997; Alavi et al., 2020), even when using the WLSMV estimator (Muthén et al., 1997). Therefore, we placed more weight on the other goodness-of-fit indices when interpreting the CFA results.
Explorative analysis
In addition to examining the reliability and validity of the instrument, we explored the relationships between demographic variables (gender, age, level of education, and prior mental health) and patient type of admission and the PTSD score using Pearson’s correlation analysis and linear regression in R statistical software.
Results
Descriptive analysis
Of the 392 individuals (269 men and 123 women) who participated in the CENTER-TBI study from Spain, 257 (65.6%) responded to the 6-month postinjury re-examination, and 135 participants (90 men and 45 women) did not return the questionnaires. Four participants (1.5%) completed less than 70% of the items on the PCL-5 and were therefore removed from the analysis. Of the remaining 253 participants, 175 were men (mean age = 43.7, SD = 16.66) and 78 were women (mean age = 54.58, SD = 23.05). Approximately 84% of the participants reported being white European. This sample size was consistent with the recommendations for CFA (e.g., above 200 and for each model variable more than 10 observations are available; see Alavi et al., 2020) and was considered to be large enough for the WLSMV estimator to provide stable and reliable parameter estimations (Nussbeck et al., 2006). The variables describing the socioeconomic background of the study sample are summarized in Table 1.
The PCL-5 total scores (sum of items) were low and right-skewed (skew = 1.41), and the scores ranged from 0 to 72 (out of 80). As shown in Table 2, the mean PCL-5 score was equal for both men and women, although men scored higher on the Intrusion and Avoidance categories, and women scored higher on the Cognitions & Mood and Arousal & Reactivity categories. Females had significantly greater scores on the GAD-7 and PHQ-9 than males (GAD-7: ; PHQ-9: ).
Using a cutoff value of 33 for the total score, 31 TBI patients (12.2%) met the criteria for a provisional PTSD diagnosis. The characteristics (i.e., distribution of sex, age, level of education, and type of admission) of these 31 participants were fairly comparable to those of the overall sample. However, nearly 39% of them reported prior mental health problems. Overall, the total score was marginally correlated with the demographic variables. For example, the PCL-5 score was negatively correlated with age ( ) and positively correlated with a prior history of mental health problems ( ). However, the correlation between education level and PTSD was nonsignificant. Multiple linear regression analysis was used to examine the relationships of demographic variables (sex, age, years of education, prior history of psychological problems, and admission to the ER, AD or ICU) with the PTSD score. The results of the regression indicated that although the model was significant, it only explained 7% of the variance in PTSD scores ( ). Prior mental health problems ( ) and admission to the ICU ( ) were the only significant factors.
Internal consistency and reliability
The Cronbach’s alpha and McDonald’s omega coefficients were 0.94 and 0.95, respectively, indicating that the Spanish translation of the PCL-5 showed excellent internal consistency. Similarly, all the DSM-5 categories had good Cronbach’s alpha coefficients (intrusion = 0.88, avoidance = 0.82, negative alterations in cognitions and mood = 0.87, and alterations in arousal and reactivity = 0.84). Furthermore, using the split-half method, a reliability of 0.97 was computed for the instrument. Additional item-level information is presented in Table 3. All the items showed a reasonable correlation with the total score, and their low mean and positive skewness were in line with the low mean and positive skewness of the total score on the PCL-5.
Table 3. Item descriptive statistics for the Spanish version of the PCL-5, divided by DSM-5 categories.
Validity
The Pearson correlations of GAD-7 and PHQ-9 scores with PCL-5 scores were 0.68 ( ) and 0.69 ( ), respectively. As expected, there was a high positive correlation of 0.76 ( ) between the PHQ-9 and the GAD-7 total scores. To examine the structural validity of the Spanish translation of the PCL-5, parallel analysis was performed, which suggested two factors. The first factor included items in the Intrusive and Avoidance categories, and the second factor included items in the negative cognitive and mood category and the arousal and reactivity category. The only exceptions were the items assessing “hypervigilance,” which was loaded on the first factor instead of the second, as well as the items assessing “exaggerated startle response” and “persistent shame, guilt, and fear,” which had high loadings on both factors. EFA was subsequently used to examine whether the PCL-5, GAD-7, and PHQ-9 load on distinct factors, indicating that these instruments measure differentiable outcomes despite their strong correlation, comorbidity, and conceptual overlap. Parallel analysis suggested a four-factor solution, which is presented in Table 4. Overall, the items of each instrument grouped with one another, indicating that they are indeed differentiable.
In addition, three confirmatory factor analyses were carried out, examining the four-factor DSM-5 model, the six-factor anhedonia model and the seven-factor hybrid model. Figure 1 shows the correlation between the factors of these models. As shown in this figure, in all the models, the factors had high correlation coefficients, ranging from 0.59 (between anhedonia and avoidance) to 0.93 (between avoidance and intrusive). However, the anhedonia and hybrid models seemed to have multiple factors with high correlations near 0.9 or above, which indicated that these factors might be redundant and could result in model overfitting.
Figures 2–4 show the structure of the models, the standardized factor loadings, and the correlations between the latent factors. The four-factor model only had a partial fit (RMSEA = 0.071, RMSEA 95% CI 0.061–0.080, CFI = 0.993, TLI = 0.992, SRMR = 0.069) because the RMSEA 95% confidence interval was above the threshold and its chi-square test was unsatisfactory ( = 370.37, p < 0.001). However, the other indices (CFI, TLI, and SRMR) were satisfactory. A summary of the CFA analyses is shown in Table 5.
Figure 2. CFA of the four-factor PTSD model based on DSM-5 symptomatology. All estimates are standardized.
Following the criteria we considered for evaluating the CFA models, the anhedonia model ( = 157.81, p = 0.422) and the hybrid model ( = 151.82, p = 0.42) showed a better fit than the DSM-5 four-factor model and met all of the criteria we considered for an acceptable model (i.e., CFI and TLI > 0.95, RMSEA <0.06, SRMR <0.08, Hu and Bentler, 1999). The scaled chi-square difference test (Satorra and Bentler, 2010) showed that, compared to the four-factor DSM-5 model, both the anhedonia [ diff (9) = 67.86, p < 0.001] and the hybrid model [ diff (15) = 89.16, p < 0.001] provided a significantly better model fit. However, when the anhedonia and hybrid models were compared with one another, the chi-square difference test yielded nonsignificant results, indicating that the anhedonia and the hybrid models did not outperform one another [ diff (6) = 4.19, p = 0.138].
Discussion
In the present study, we systematically translated the PCL-5 from English to Spanish, validated it linguistically and assessed its psychometric properties in a sample of individuals 6 months after having a traumatic brain injury. To our knowledge, this was the first study to thoroughly validate the Spanish version of the PCL-5. The participants’ mean score on the PCL-5 was low, and the distribution was right skewed. Only 12.2% of the TBI patients had elevated PTSD scores at 6 months after the injury, which is comparable to previous findings from civilians (Bryant et al., 2001; Bombardier et al., 2006; Haarbauer-Krupa et al., 2017). Furthermore, the association between sex and PTSD incidence was not significant, despite previous results indicating a greater PTSD risk for women after TBI (Olff et al., 2007). Overall, the Spanish translation of the PCL-5 showed excellent internal consistency. The Cronbach’s alpha coefficient of 0.94 that was obtained herein is similar to the Cronbach’s alpha reported for the English version as well as for the German and French translations of the PCL-5 (Blevins et al., 2015; Ashbaugh et al., 2016; Krüger-Gottschalk et al., 2017). The McDonald’s omega coefficient and the split-halve reliability values also confirmed the reliability of the Spanish translation of the PCL-5 instrument. Similarly, the item-total correlations were satisfactory, and only two items showed relatively lower correlations— item 8 “Dissociative amnesia” and item 16 “Recklessness and self-destruction.” Interestingly, item 16, which had the lowest item-total correlations among all the items, is one of the newly symptoms in the DSM-5.
As expected, strong correlations between PTSD, GAD, and depression were detected, which is also in line with the literature and confirms the concurrent validity of the Spanish translation of the PCL-5 instrument. For example, using the same instruments as in the present study, Bovin et al. (2016) reported a correlation of 0.74 between the PHQ-9 and the PCL-5 instruments. Durham et al. (2015) also reported similar correlations between GAD-7 scores and PTSD symptoms, ranging from 0.5 to 0.6. Another study on US combat soldiers, however, reported stronger correlations (ranging from 0.78 to 0.79) between the GAD-7 score and the PCL-5 score (Hoge et al., 2014). These results were expected because PTSD highly overlaps with depression and GAD, and distinguishing it from mood and other anxiety-related disorders has been a challenge for clinicians (Yehuda and McFarlane, 1995). For example, depression frequently cooccurs with PTSD and is estimated to be present in 30–50% of PTSD patients (Nixon et al., 2004; Campbell et al., 2007). Keane et al. (1997) reported four reasons for the comorbidity of these disorders: (1) the PTSD construct shares multiple symptoms with depression and GAD, (2) PTSD is more likely to appear in individuals vulnerable to stress, (3) PTSD might increase the probability of other mental disorders over time, and (4) PTSD frequently appears with other disorders, particularly GAD and major depressive disorder (MDD) (Brown et al., 2001; Post et al., 2011; Contractor et al., 2015).
However, despite the comorbidity of PTSD, depression, and GAD, the results of the exploratory factor analysis indicated that the items of these instruments load on distinct factors, which further supports the validity of the PCL-5 instrument. Interestingly, however, items of the PCL-5 and PHQ-9 assessing disordered eating and sleep disturbance, loaded only on the GAD-7 instrument; however, their loading was the lowest among the items of this factor, suggesting that disordered eating and sleep disturbance could form different factors if they were accompanied by other items reflecting these two outcomes, which should be examined in future studies.
We also examined the structural validity of the PCL-5 using three PTSD models. The CFA analyses showed that the PTSD model derived from the DSM-5 diagnostic categories partially met the specified criteria for a valid model, in contrast to the anhedonia and the hybrid models, which showed adequate and significantly better fits than did the DSM-5 model. The analysis also indicated that the difference between the anhedonia and hybrid models was not significant. However, both the anhedonia and hybrid models had a CFI and TLI of 1.00, which indicates overfitting of the model. Although these models provide better goodness of fit than the four-factor model, an overfitted model limits the generalization of the results and hints that a simpler model is favorable; i.e., the additional complexity of the six- and seven-factor models is not desirable. The high correlation between the anhedonia and the hybrid models indicated that the suggested factors might be redundant and that the improved model fit might be an artifact of the additional complexity as well as the greater correlation between the factors. The strong correlation between the factors also explains why parallel analysis suggested 2 factors for the PCL-5 instrument. In addition to the concerns regarding the overfitting of the anhedonia and the hybrid models, the results of the chi-square statistics must also be interpreted with caution (Bryant and Satorra, 2012). This test is known to be liberal, even with the WLSMV estimator (Muthén et al., 1997). For example, the WLSMV estimator is known to perform well for sample sizes as small as 200; however, a sample size of 400 is recommended for skewed distributions (Muthén et al., 1997; Liang and Yang, 2014).
Evaluating factorial structures solely based on fitness indices is not recommended, and the theoretical foundation and implications of the models should be taken into consideration, especially when presumptuous statistical procedures such as confirmatory factor analysis are utilized. For example, the DSM-5 model is formulated using the diagnostic categories and criteria of the DSM-5. These categories facilitate PTSD diagnosis by grouping conceptually distinct symptoms that are not mutually exclusive for a PTSD diagnosis. For the diagnosis of PTSD, individuals with negative cognitive or mood symptoms or a combination of both would meet the criteria of category D. Although it is known that cognition and emotions influence one another (Pessoa, 2008), there is a large body of literature to conclude that they involve different processes that justify their differentiation (Power and Dalgleish, 2015). Therefore, grouping negative cognitive and mood symptoms according to diagnostic criteria is practical because of the simplification of diagnostic criteria or because these symptoms are comorbid and not mutually exclusive. Therefore, although the results of the CFA analysis support the structural validity of the instrument, it is inconclusive which model is more trustworthy or applicable. There is clearly a need for further research to better understand symptoms of PTSD and its factorial structure.
The current study has a few limitations. First, the data used in the study came from a larger observational study; thus, data were not collected for validating the Spanish translation of the PCL-5 instrument. As a result, some of the typical methods for examining an instrument, such as test–retest reliability, were not performed. For the same reason, the compatibility of the Spanish translation of the PCL-5 with structured clinical interviews was not assessed; thus, it is not clear to what extent the provisional diagnoses we are reporting are accurate or comparable with rates reported in the literature. In addition, our data suffered from a floor effect, with most of the subjects scoring very low on the PCL-5 instrument. To address this problem, however, we applied the WLSMV estimator instead of the maximum likelihood estimator, which is also more suitable for ordinal data (Beauducel and Herzberg, 2006). Finally, the incidence of PTSD is known to vary considerably in different countries (Burri and Maercker, 2014); thus, the reader should consider that the data of the current study were collected solely from four cities in Spain and only from adults with traumatic brain injuries.
Conclusion
Overall, our results suggest that the Spanish translation of the PCL-5 has good internal consistency and reliability and, similar to the English, French, and German versions of the instrument. The instrument’s validity was also confirmed, both with EFA and CFA analyses as well as correlation with the PHQ-9 and GAD-7 instruments. Future studies should further examine sex differences in the response to different diagnostic categories of PTSD. In addition, the relationships of disordered eating and sleep disturbances with PTSD and GAD should be further investigated.
Data availability statement
The data of the analysis are not published in the repository to protect sensitive information about the participants. However, access to the data can be requested from CENTER-TBI via https://center-tbi.eu/data.
Ethics statement
This study was approved by the CENTER-TBI ethical committee. The CENTER-TBI study (EC grant 602,150) was conducted in accordance with all relevant laws of the EU if directly applicable or because of direct effects and all relevant laws of the country where the recruiting sites were located, including but not limited to the relevant privacy and data protection laws and regulations (the “Privacy Law”), the relevant laws and regulations on the use of human materials, and all relevant guidance relating to clinical studies from time to time in force, including but not limited to the ICH Harmonized Tripartite Guideline for Good Clinical Practice (CPMP/ICH/135/95) (“ICH GCP”) and the World Medical Association Declaration of Helsinki titled “Ethical Principles for Medical Research Involving Human Subjects.” Informed consent was obtained from the patients and/or the legal representative/next of kin, according to the local legislation, for all patients recruited in the Core Dataset of CENTER-TBI and documented in the e-CRF. Ethical approval was obtained for each recruiting site. The list of sites, ethical committees, approval numbers and approval dates can be found on the following website: https://www.center-tbi.eu/project/ethical-approval.
Author contributions
EFH conceived, planned, and performed the analysis and wrote the manuscript. JS, AR, IP, and GL collected the data. All authors contributed to the article and approved the submitted version.
Funding
The data used in preparation of this manuscript were obtained in the context of CENTER-TBI, a large collaborative project with the support of the European Union 7th Framework program (EC grant 602150). Additional funding was obtained from Hannelore Kohl Stiftung (Germany), OneMind (USA) and Integra LifeSciences Corporation (USA). However, none of the funders had any role in any step of the current research.
Acknowledgments
Several researchers have collaborated in CENTER-TBI, which directly and indirectly helped us to write this manuscript. The authors would like to thank other CENTER-TBI collaborators (see https://www.center-tbi.eu/project/participants for the complete list of collaborators), who are not collaborators on the current manuscript but were involved in the process of data collection, translation of the PCL-5 and translation of other instruments used in the CENTER-TBI study.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Footnotes
References
Alavi, M., Visentin, D. C., Thapa, D. K., Hunt, G. E., Watson, R., and Cleary, M. (2020). Chi-square for model fit in confirmatory factor analysis. J Adv Nurs 76, 2209–2211. doi: 10.1111/jan.14399
American Psychiatric Association (1994). Diagnostic and statistical manual of mental disorders. 4th Edn. Washington, DC: American Psychiatric Association.
American Psychiatric Association (2013). Diagnostic and statistical manual of mental disorders (DSM-5®). Washington, DC: American Psychiatric Association.
Armour, C., Tsai, J., Durham, T. A., Charak, R., Biehn, T. L., Elhai, J. D., et al. (2015). Dimensional structure of DSM-5 posttraumatic stress symptoms: support for a hybrid anhedonia and externalizing behaviors model. J. Psychiatr. Res. 61, 106–113. doi: 10.1016/j.jpsychires.2014.10.012
Ashbaugh, A. R., Houle-Johnson, S., Herbert, C., El-Hage, W., and Brunet, A. (2016). Psychometric validation of the English and French versions of the posttraumatic stress disorder checklist for DSM-5 (PCL-5). PLoS One 11:e0161645. doi: 10.1371/journal.pone.0161645
Beard, C., and Björgvinsson, T. (2014). Beyond generalized anxiety disorder: psychometric properties of the GAD-7 in a heterogeneous psychiatric sample. J. Anxiety Disord. 28, 547–552. doi: 10.1016/j.janxdis.2014.06.002
Beauducel, A., and Herzberg, P. Y. (2006). On the performance of maximum likelihood versus means and variance adjusted weighted least squares estimation in CFA. Struct. Equ. Model. 13, 186–203. doi: 10.1207/s15328007sem1302_2
Blanchard, E. B., Jones-Alexander, J., Buckley, T. C., and Forneris, C. A. (1996). Psychometric properties of the PTSD checklist (PCL). Behav. Res. Ther. 34, 669–673. doi: 10.1016/0005-7967(96)00033-2
Bland, J. M., and Altman, D. G. (1997). Statistics notes: Cronbach's alpha. BMJ 314:572. doi: 10.1136/bmj.314.7080.572
Blevins, C. A., Weathers, F. W., Davis, M. T., Witte, T. K., and Domino, J. L. (2015). The posttraumatic stress disorder checklist for DSM-5 (PCL-5): development and initial psychometric evaluation. J. Trauma. Stress. 28, 489–498. doi: 10.1002/jts.22059
Bombardier, C. H., Fann, J. R., Temkin, N., Esselman, P. C., Pelzer, E., Keough, M., et al. (2006). Posttraumatic stress disorder symptoms during the first six months after traumatic brain injury. J. Neuropsychiatry Clin. Neurosci. 18, 501–508. doi: 10.1176/jnp.2006.18.4.501
Bovin, M. J., Marx, B. P., Weathers, F. W., Gallagher, M. W., Rodriguez, P., Schnurr, P. P., et al. (2016). Psychometric properties of the PTSD checklist for diagnostic and statistical manual of mental disorders–fifth edition (PCL-5) in veterans. Psychol. Assess. 28, 1379–1391. doi: 10.1037/pas0000254
Brown, T. A., Campbell, L. A., Lehman, C. L., Grisham, J. R., and Mancill, R. B. (2001). Current and lifetime comorbidity of the DSM-IV anxiety and mood disorders in a large clinical sample. J. Abnorm. Psychol. 110, 585–599. doi: 10.1037/0021-843X.110.4.585
Bryant, R. A., Marosszeky, J. E., Crooks, J., Baguley, I. J., and Gurka, J. A. (2001). Posttraumatic stress disorder and psychosocial functioning after severe traumatic brain injury. J. Nerv. Ment. Dis. 189, 109–113. doi: 10.1097/00005053-200102000-00006
Bryant, F. B., and Satorra, A. (2012). Principles and practice of scaled difference chi-square testing. Struct. Equ. Model. Multidiscip. J. 19, 372–398. doi: 10.1080/10705511.2012.687671
Burri, A., and Maercker, A. (2014). Differences in prevalence rates of PTSD in various European countries explained by war exposure, other trauma and cultural value orientation. BMC. Res. Notes 7, 1–11. doi: 10.1186/1756-0500-7-407
Campbell, D. G., Felker, B. L., Liu, C.-F., Yano, E. M., Kirchner, J. E., Chan, D., et al. (2007). Prevalence of depression–PTSD comorbidity: implications for clinical practice guidelines and primary care-based interventions. J. Gen. Intern. Med. 22, 711–718. doi: 10.1007/s11606-006-0101-4
Carlson, K. F., Kehle, S. M., Meis, L. A., Greer, N., MacDonald, R., Rutks, I., et al. (2011). Prevalence, assessment, and treatment of mild traumatic brain injury and posttraumatic stress disorder: a systematic review of the evidence. J. Head Trauma Rehabil. 26, 103–115. doi: 10.1097/HTR.0b013e3181e50ef1
Contractor, A. A., Elhai, J. D., Fine, T. H., Tamburrino, M. B., Cohen, G., Shirley, E., et al. (2015). Latent profile analyses of posttraumatic stress disorder, depression and generalized anxiety disorder symptoms in trauma-exposed soldiers. J. Psychiatr. Res. 68, 19–26. doi: 10.1016/j.jpsychires.2015.05.014
Durham, T. A., Elhai, J. D., Fine, T. H., Tamburrino, M., Cohen, G., Shirley, E., et al. (2015). Posttraumatic stress disorder’s dysphoria dimension and relations with generalized anxiety disorder symptoms. Psychiatry Res. 228, 150–155. doi: 10.1016/j.psychres.2015.04.034
Green, S. B., Akey, T. M., Fleming, K. K., Hershberger, S. L., and Marquis, J. G. (1997). Effect of the number of scale points on chi-square fit indices in confirmatory factor analysis. Struct. Equ. Model. Multidiscip. J. 4, 108–120. doi: 10.1080/10705519709540064
Haarbauer-Krupa, J., Taylor, C. A., Yue, J. K., Winkler, E. A., Pirracchio, R., Cooper, S. R., et al. (2017). Screening for post-traumatic stress disorder in a civilian emergency department population with traumatic brain injury. J. Neurotrauma 34, 50–58. doi: 10.1089/neu.2015.4158
Hoge, C. W., Riviere, L. A., Wilk, J. E., Herrell, R. K., and Weathers, F. W. (2014). The prevalence of post-traumatic stress disorder (PTSD) in US combat soldiers: a head-to-head comparison of DSM-5 versus DSM-IV-TR symptom criteria with the PTSD checklist. Lancet Psychiatry 1, 269–277. doi: 10.1016/S2215-0366(14)70235-4
Hu, L., and Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct. Equ. Model. Multidiscip. J. 6, 1–55. doi: 10.1080/10705519909540118
Jaffee, M. S., Stokes, J. W., and Leal, F. O. (2007). Posttraumatic stress disorder and posttraumatic stress disorder-like symptoms and mild traumatic brain injury. J. Rehabil. Res. Dev. 44, 895–920. doi: 10.1682/JRRD.2006.12.0166
Keane, T. M., Taylor, K. L., and Penk, W. E. (1997). Differentiating post-traumatic stress disorder (PTSD) from major depression (MDD) and generalized anxiety disorder (GAD). J. Anxiety Disord. 11, 317–328. doi: 10.1016/S0887-6185(97)00013-3
Keen, S. M., Kutter, C. J., Niles, B. L., and Krinsley, K. E. (2008). Psychometric properties of PTSD checklist in sample of male veterans. J. Rehabil. Res. Develop. 45, 465–474. doi: 10.1682/JRRD.2007.09.0138
Kroenke, K., and Spitzer, R. L. (2002). The PHQ-9: a new depression diagnostic and severity measure. Psychiatr. Ann. 32, 509–515. doi: 10.3928/0048-5713-20020901-06
Kroenke, K., Spitzer, R. L., and Williams, J. B. (2001). The PHQ-9: validity of a brief depression severity measure. J. Gen. Intern. Med. 16, 606–613. doi: 10.1046/j.1525-1497.2001.016009606.x
Krüger-Gottschalk, A., Knaevelsrud, C., Rau, H., Dyer, A., Schäfer, I., Schellong, J., et al. (2017). The German version of the posttraumatic stress disorder checklist for DSM-5 (PCL-5): psychometric properties and diagnostic utility. BMC Psychiatry 17. doi: 10.1186/s12888-017-1541-6
Liang, X., and Yang, Y. (2014). An evaluation of WLSMV and Bayesian methods for confirmatory factor analysis with categorical indicators. Int. J. Quant. Res. Educ. 2, 17–38. doi: 10.1504/IJQRE.2014.060972
Liu, P., Wang, L., Cao, C., Wang, R., Zhang, J., Zhang, B., et al. (2014). The underlying dimensions of DSM-5 posttraumatic stress disorder symptoms in an epidemiological sample of Chinese earthquake survivors. J. Anxiety Disord. 28, 345–351. doi: 10.1016/j.janxdis.2014.03.008
Löwe, B., Decker, O., Müller, S., Brähler, E., Schellberg, D., Herzog, W., et al. (2008). Validation and standardization of the generalized anxiety disorder screener (GAD-7) in the general population. Med. Care 46, 266–274. doi: 10.1097/MLR.0b013e318160d093
Löwe, B., Kroenke, K., Herzog, W., and Gräfe, K. (2004). Measuring depression outcome with a brief self-report instrument: sensitivity to change of the patient health questionnaire (PHQ-9). J. Affect. Disord. 81, 61–66. doi: 10.1016/S0165-0327(03)00198-8
Marsh, H. W., Balla, J. R., and McDonald, R. P. (1988). Goodness-of-fit indexes in confirmatory factor analysis: the effect of sample size. Psychol. Bull. 103, 391–410. doi: 10.1037/0033-2909.103.3.391
Martin, A., Rief, W., Klaiberg, A., and Braehler, E. (2006). Validity of the brief patient health questionnaire mood scale (PHQ-9) in the general population. Gen. Hosp. Psychiatry 28, 71–77. doi: 10.1016/j.genhosppsych.2005.07.003
McDonald, S. D., and Calhoun, P. S. (2010). The diagnostic accuracy of the PTSD checklist: a critical review. Clin. Psychol. Rev. 30, 976–987. doi: 10.1016/j.cpr.2010.06.012
Muthén, B., du Toit, S., and Spisic, D. (1997). Robust inference using weighted least squares and quadratic estimating equations in latent variable modeling with categorical and continuous outcomes. Psychometrika 75, 40–45,
Nixon, R. D. V., Resick, P. A., and Nishith, P. (2004). An exploration of comorbid depression among female victims of intimate partner violence with posttraumatic stress disorder. J. Affect. Disord. 82, 315–320. doi: 10.1016/j.jad.2004.01.008
Nussbeck, F. W., Eid, M., and Lischetzke, T. (2006). Analysing multitrait–multimethod data with structural equation models for ordinal variables applying the WLSMV estimator: what sample size is needed for valid results? Br. J. Math. Stat. Psychol. 59, 195–213. doi: 10.1348/000711005X67490
Olff, M., Langeland, W., Draijer, N., and Gersons, B. P. (2007). Gender differences in posttraumatic stress disorder. Psychol. Bull. 133, 183–204. doi: 10.1037/0033-2909.133.2.183
Pessoa, L. (2008). On the relationship between emotion and cognition. Nat. Rev. Neurosci. 9, 148–158. doi: 10.1038/nrn2317
Post, L. M., Zoellner, L. A., Youngstrom, E., and Feeny, N. C. (2011). Understanding the relationship between co-occurring PTSD and MDD: symptom severity and affect. J. Anxiety Disord. 25, 1123–1130. doi: 10.1016/j.janxdis.2011.08.003
Power, M., and Dalgleish, T. (2015). Cognition and emotion: from order to disorder. 3rd Edn. New York, NY: Psychology press.
Rosseel, Y. (2012). Lavaan: an R package for structural equation modeling. J. Stat. Softw. 48:2012. doi: 10.18637/jss.v048.i02
Ruiz, M. A., Zamorano, E., García-Campayo, J., Pardo, A., Freire, O., and Rejas, J. (2011). Validity of the GAD-7 scale as an outcome measure of disability in patients with generalized anxiety disorders in primary care. J. Affect. Disord. 128, 277–286. doi: 10.1016/j.jad.2010.07.010
Sadeghi, M., Taghva, A., Goudarzi, N., and Rah Nejat, A. (2016). Validity and reliability of Persian version of “Post-traumatic stress disorder scale” in war veterans. Iran. J. War Public Health 8, 243–249,
Satorra, A., and Bentler, P. M. (2010). Ensuring positiveness of the scaled difference chi-square test statistic. Psychometrika 75, 243–248. doi: 10.1007/s11336-009-9135-y
Spitzer, R. L., Kroenke, K., Williams, J. B., and Löwe, B. (2006). A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch. Intern. Med. 166, 1092–1097. doi: 10.1001/archinte.166.10.1092
Swinson, R. P. (2006). The GAD-7 scale was accurate for diagnosing. Evidence Based Med. 11:184. doi: 10.1136/ebm.11.6.184
Tavakol, M., and Dennick, R. (2011). Making sense of Cronbach’s alpha. Int. J. Med. Educ. 2, 53–55. doi: 10.5116/ijme.4dfb.8dfd
Teymoori, A., Gorbunova, A., Haghish, F. E., Real, R., Zeldovich, M., Wu, Y.-J., et al. (2020a). Factorial structure and validity of depression (PHQ-9) and anxiety (GAD-7) scales after traumatic brain injury. J. Clin. Med. 9:873. doi: 10.3390/jcm9030873
Teymoori, A., Real, R., Gorbunova, A., Haghish, E., Andelic, N., Wilson, L., et al. (2020b). Measurement invariance of assessments of depression (PHQ-9) and anxiety (GAD-7) across sex, strata and linguistic backgrounds in a European-wide sample of patients after traumatic brain injury. J. Affect. Disord. 262, 278–285. doi: 10.1016/j.jad.2019.10.035
Van Praag, D. L. G., Cnossen, M. C., Polinder, S., Wilson, L., and Maas, A. I. R. (2019). Post-traumatic stress disorder after civilian traumatic brain injury: a systematic review and meta-analysis of prevalence rates. J. Neurotrauma 36, 3220–3232. doi: 10.1089/neu.2018.5759
Van Praag, D. L., Fardzadeh, H. E., Covic, A., Maas, A. I., and von Steinbüchel, N. (2020). Preliminary validation of the Dutch version of the posttraumatic stress disorder checklist for DSM-5 (PCL-5) after traumatic brain injury in a civilian population. PLoS One 15:e0231857. doi: 10.1371/journal.pone.0231857
Wang, L., Zhang, L., Armour, C., Cao, C., Qing, Y., Zhang, J., et al. (2015). Assessing the underlying dimensionality of DSM-5 PTSD symptoms in Chinese adolescents surviving the 2008 Wenchuan earthquake. J. Anxiety Disord. 31, 90–97. doi: 10.1016/j.janxdis.2015.02.006
Weathers, F. W., Litz, B. T., Herman, D. S., Huska, J. A., and Keane, T. M. (1993). The PTSD checklist (PCL): reliability, validity, and diagnostic utility, vol. 462.
Weathers, F. W., Litz, B. T., Keane, T. M., Palmieri, P. A., Marx, B. P., and Schnurr, P. P. (2013). The PTSD checklist for DSM-5 (PCL-5). Scale Available from the National Center for PTSD. Available at: www.ptsd.va.gov
Weathers, F. W., Marx, B. P., Friedman, M. J., and Schnurr, P. P. (2014). Posttraumatic stress disorder in DSM-5: new criteria, new measures, and implications for assessment. Psychol. Injury. Law 7, 93–107. doi: 10.1007/s12207-014-9191-1
Yehuda, R., and McFarlane, A. (1995). Conflict between current knowledge about posttraumatic stress disorder and its original conceptual basis. Trauma information pages. Nternet’ten 29 Kasım 2000’de elde edilmiştir. Am. J. Psychiatry 152, 1815–1818
Appendix
Spanish translation of the posttraumatic stress disorder checklist (PCL-5) Instrucción: Más abajo hay un listado de problemas que las personas tienen a veces debido a una experiencia muy estresante. Lea por favor cada problema detenidamente y después rodee uno de los números de la derecha para indicar con cuánta intensidad le ha molestado aquel problema durante el último mes.
Keywords: post-traumatic stress disorder, traumatic brain injury, PCL-5, Spanish, validation
Citation: Haghish EF, Sahuquillo J, Radoi A, Pomposo I and Lozano GC (2024) Validating the Spanish translation of the posttraumatic stress disorder checklist (PCL-5) in a sample of individuals with traumatic brain injury. Front. Psychol. 15:1216435. doi: 10.3389/fpsyg.2024.1216435
Edited by:
David Pineda, Miguel Hernández University of Elche, SpainReviewed by:
Kotaro Shoji, University of Human Environments, JapanÖmer Faruk Uygur, Atatürk University, Türkiye
Manuel Galán, San Antonio Catholic University of Murcia, Spain
Copyright © 2024 Haghish, Sahuquillo, Radoi, Pomposo and Lozano. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: E. F. Haghish, haghish@uio.no