- 1Department of Psychology, Lingnan University, Tuen Mun, Hong Kong SAR, China
- 2Department of Rehabilitation Sciences, The Hong Kong Polytechnic University, Kowloon, Hong Kong SAR, China
- 3Department of Social and Behavioural Sciences, City University of Hong Kong, Kowloon, Hong Kong SAR, China
Introduction: The COVID Stress Scales (CSS) assess six domains of COVID-19-related stress, including (a) COVID danger, (b) COVID socioeconomic consequences, (c) COVID xenophobia, (d) COVID contamination, (e) COVID traumatic stress symptoms, and (f) COVID compulsive checking. Although the CSS have been validated in various cultural contexts, their psychometric properties in Hong Kong have not been examined. This study endeavors to validate the traditional Chinese version of the 36-item CSS (CSS-36) and the 18-item CSS (CSS-18) in Hong Kong.
Method: Participants were 521 Hong Kong undergraduate students (61% female) aged from 18 to 26 years (M = 20.65, SD = 1.56). An online questionnaire was used for data collection.
Results: The results of confirmatory factor analyses supported a six-factor structure for both the CSS-36 and the CSS-18. Multiple-group confirmatory factor analyses established the gender invariance of the six-factor model for both the CSS-36 and the CSS-18. The CSS-36 and the CSS-18 exhibited good internal consistency reliability and concurrent validity with fear of COVID-19 and negative emotional states.
Discussion: The findings offer evidence for the psychometric properties of the traditional Chinese version of the CSS-36 and the CSS-18 in the Hong Kong context.
Introduction
The Coronavirus disease 2019 (COVID-19) pandemic has exerted long-lasting impacts on multiple domains of health (1–3). The first COVID-19 case was identified in Wuhan, China in December 2019 (4, 5). This disease was later declared by the World Health Organization (6) as a pandemic on 11 March 2020.
On top of its detrimental impacts on physical health (1–3), the COVID-19 pandemic has also undermined people's mental health (7), and elevated levels of stress, fear, and anxiety were common in the general population during pandemics [e.g., (8–10)]. A systematic review of studies documented that stress was prevalent across countries during the COVID-19 pandemic (11). The rate of psychological distress rose up to 8 times since the outbreak (12). Stress related to COVID-19 has emerged as a major public health issue during the pandemic (8–11).
COVID Stress Scales
Taylor et al. (13) developed the COVID-19 Stress Scales (CSS) to assess stress related to COVID-19. The CSS consist of 36 items measuring six domains of COVID-19-related stress: (a) fear of the danger of COVID-19 (COVID danger), (b) fear of the socioeconomic consequences of COVID-19 (COVID socioeconomic consequences), (c) fear that foreigners might carry COVID-19 (COVID xenophobia), (d) fear of sources of contamination related to COVID-19 (COVID contamination), (e) traumatic stress symptoms related to COVID-19 (COVID traumatic stress symptoms), and (f) compulsive checking and reassurance seeking related to COVID-19 (COVID compulsive checking). Most studies on the CSS have supported a six-factor structure (5, 14–18). Other studies have identified a five-factor structure, in which the items measuring COVID danger and COVID contamination were combined into a factor of COVID danger and contamination (13, 19, 20). The CSS have exhibited good concurrent validity with constructs such as fear of COVID-19 (16, 18, 21), depression, anxiety, stress (14, 16, 18), health anxiety, posttraumatic stress disorder symptoms, and compulsive washing (15).
The original English version of the CSS was first validated in the Canadian and American populations (13). Subsequently, the CSS have been translated into various languages and have demonstrated adequate psychometric properties in different cultural contexts such as Germany (15), Egypt (19), Iran (20), Mainland China (18), the Netherlands (21), Palestine (16), Poland (21), Saudi Arabia (19), Serbia (17), Spain (5), and Sweden (14). However, the psychometric properties of the CSS in Hong Kong have not been examined. Although Xia et al. (18) validated the simplified Chinese version of the CSS in Mainland China, simplified Chinese instruments may not be entirely applicable in the Hong Kong context because of linguistic and cultural differences (22, 23). While simplified Chinese is the official written language in Mainland China, traditional Chinese is the official written language in Hong Kong. Because of cultural and historical reasons, simplified Chinese and traditional Chinese have different writing systems and are not regarded as interchangeable (24). Moreover, there are cultural differences between Hong Kong and Mainland China, and Mainland Chinese generally perceive Hong Kong people as more Westernized than them (25, 26). Therefore, it is necessary to develop a traditional Chinese version of the CSS and investigate its psychometric properties in Hong Kong.
Besides, the gender invariance of the CSS has rarely been examined, although females tended to experience higher levels of fear and anxiety of COVID-19 (12). Nonetheless, group differences cannot be interpreted unambiguously without establishing factorial invariance (27). Hence, examining the gender invariance of the CSS is crucial for understanding gender differences in COVID-19-related stress. The study by Noe-Grijalva et al. (5) supported the gender invariance for the Spanish version of the CSS. It is of theoretical interest to examine whether the CSS are invariant across gender among people in Hong Kong.
One disadvantage of the original 36-item CSS (CSS-36) is that the scales are relatively lengthy (28). Thibault et al. (28) recently validated an 18-item CSS (CSS-18) in Canadian university students. This brief version provides researchers with an option to save time and lower participants' fatigue without compromising the psychometric properties. Further validation studies on the CSS-18 in other languages are needed.
The current study
Hong Kong had low COVID-19 infection and death rates until the outbreak of the Omicron variant in early 2022. The high population density of Hong Kong has implied a very high contagion risk (29). The coping responses (e.g., panic buying) observed in Hong Kong residents are considered maladaptive and anxiety provoking (30), and might lead to an elevated level of stress among Hong Kong people. It is timely to understand COVID-19-related stress among Hong Kong people.
During the COVID-19 outbreak, students worldwide have experienced high levels of stress (11). Research has shown that younger age and student status were significant risk factors for greater distress during the COVID-19 pandemic (11). Students have experienced decreased wellbeing and increased emotional problems after the COVID-19 outbreak (31–33). More than one tenth of undergraduate and graduate students had high levels of COVID-19 fear and psychological symptoms but low levels of resilience (10). The COVID-19-related stress and mental health of students deserve special attention. However, the COVID-19-related stress of students has not been well studied in the context of Hong Kong and further research is needed.
The primary goal of the current study is to validate the traditional Chinese version of the CSS-36 (13) and the CSS-18 (28) in a sample of undergraduate students in Hong Kong. First, we examined the factor structure of the CSS. Specifically, the five-factor (13, 19, 20) and six-factor models (5, 14, 16, 17) identified in past studies were tested. Second, we investigated the factorial invariance of the CSS across gender. Third, we examined the internal consistency reliability of the CSS. Fourth, we investigated the concurrent validity of the CSS by investigating their relationships with fear of COVID-19 and negative emotional states (depression, anxiety, and stress), which are conceptually and empirically related to the CSS domains (16).
Method
Participants and procedure
Participants were 521 undergraduate students from a local university in Hong Kong. The data were collected in June 2022. Inclusion criteria included undergraduate students in Hong Kong and the ability to read traditional Chinese. Exclusion criteria included age under 18 years and the inability to provide informed consent. The participants were recruited from a local university in Hong Kong. All undergraduate students from the university were invited through a mass email to participate in the present study. An online questionnaire was used for data collection. Each eligible participant received a unique and personal link. Informed consent was obtained from the participants prior to their participation in the study. Participation was on a voluntary basis. Each participant received a monetary incentive of $50 HKD (~$6.4 USD) for completing the survey.
Measures
COVID-19-related stress
The CSS (13) were used to measure the levels of COVID-19-related stress. Following Hambleton's (34) guidelines of test translation and adaptation, the original English items of the CSS were first translated into traditional Chinese by a translator and then back-translated to English by another translator to ensure conceptual equivalence and accuracy. The traditional Chinese items are presented in the Supplementary material Table 1. The CSS assess six domains of COVID-19-related stress, including (a) COVID danger, (b) COVID economic consequences, (c) COVID xenophobia, (d) COVID contamination, (e) COVID traumatic stress symptoms, and (f) COVID compulsive checking. Each domain is measured by 6 items in the CSS-36 (13) and by 3 items in the CSS-18 (28). Each item is rated on a 5-point scale ranging from 0 to 4.
Fear of COVID-19
Participants' fear of COVID-19 was assessed using the Fear of COVID-19 Scale [FCV-19S; (35)]. This instrument comprises seven items (e.g., “I am most afraid of coronavirus-19”). All items are rated on a 5-point scale ranging from 1 (strongly disagree) to 5 (strongly agree). This study adopted the Chinese verison of the FCV-19S validated by Chi et al. (36).
Negative emotional states
The 21-item Depression Anxiety Stress Scales [DASS-21; (37)] was used to measure participants' levels of negative emotional states. The DASS-21 consists of three subscales, including depression (seven items), anxiety (seven items), and stress (seven items). Each item is scored on a 4-point scale ranging from 0 (did not apply to me at all) to 3 (applied to me very much). This study employed the Chinese version of the DASS validated by Taouk et al. (38).
Data analysis
To investigate the factor structure of the CSS-36 and the CSS-18 in Hong Kong, CFAs were conducted using LISREL 8.80. The five-factor and six-factor models identified in prior studies were examined. Besides, an alternative one-factor model in which all items were loaded on a general factor was also tested. The model fit was evaluated with a combination of fit indices. A RMSEA value <0.10 represents an acceptable fit and <0.08 represents a satisfactory fit (39). A CFI > 0.95 and a NNFI > 0.95 indicate an adequate model fit (40). The Akaike information criterion (AIC) was adopted to compare the goodness-of-fit of the models. The AIC can compare nested or non-nested model, and a smaller value reflects a superior model fit (41).
To examine the gender invariance of the six-factor models for the CSS-36 and the CSS-18 in Hong Kong, multiple-group CFAs were performed using LISREL 8.80. A series of hierarchical steps were taken to evaluate factorial invariance (27). To assess configural invariance, the factor model without cross-group equality constraints was estimated across the two gender groups. Subsequently, equality constraints were imposed on the factor loadings (metric invariance), item intercepts (scalar invariance), error variances (error variance invariance), factor variances (factor variance invariance), and factor covariances (factor covariance invariance) across the two gender groups. Concerning model comparison, as the chi-square difference test is sensitive to sample size and excessively stringent, the change in CFI (ΔCFI) was used to examine gender invariance (27). A decrease in CFI > 0.01 reflects a significant decline in the model fit (27).
Results
Demographic characteristics
Among the 521 participants, there were 203 males (39.0%) and 318 females (61.0%). Their age ranged from 18 to 26 years (M = 20.65, SD = 1.56). They were from different faculties including arts (n = 218, 41.8%), business (n = 156, 29.9%), social sciences (n = 144, 27.6%), and others (n = 3, 0.6%).
Confirmatory factor analysis
Since the tests of multivariate skewness and kurtosis indicated that the data did not follow multivariate normality (ps < 0.001), the robust maximum likelihood (RML) estimation was employed, and the Satorra-Bentler scaled χ2 (S-Bχ2) statistics were calculated to adjust for the non-normal distribution.
Table 1 presents results of CFAs for the CSS-36. The one-factor model failed to achieve a good model fit. The five-factor model fitted the data reasonably well, S-Bχ2 (584, N = 521) = 2601.47, p < 0.001, RMSEA = 0.081, 90% CI [0.078, 0.085], CFI = 0.976, NNFI = 0.974, AIC = 2765.47. The six-factor model demonstrated a satisfactory model fit, S-Bχ2 (579, N = 521) = 2106.96, p < 0.001, RMSEA = 0.071, 90% CI [0.068, 0.075], CFI = 0.982, NNFI = 0.980, AIC = 2280.96. Moreover, the smallest AIC value was found for the six-factor model, indicating that it had the best model fit. The six-factor model was selected as the final model. As presented in Table 2, all standardized factor loadings were stronger than 0.30 (ps < 0.001), and significant correlations were found among the six factors (rs = 0.61 to 0.85, ps < 0.001).
The results of CFAs for the CSS-18 are presented in Table 1. The one-factor model did not exhibit a good model fit. The five-factor model showed an acceptable model fit, S-Bχ2 (125, N = 521) = 552.65, p < 0.001, RMSEA = 0.081, 90% CI [0.074, 0.088], CFI = 0.979, NNFI = 0.974, AIC = 664.65. The six-factor model attained an adequate model fit, S-Bχ2 (120, N = 521) = 421.99, p < 0.001, RMSEA = 0.070, 90% CI [0.062, 0.077], CFI = 0.985, NNFI = 0.981, AIC = 523.99. The six-factor model had the smallest AIC value and was chosen as the final model (see Table 1). As shown in Table 2, all standardized factor loadings were >30 (ps < 0.001), and the six factors were significantly intercorrelated (rs = 0.59 to 0.85, ps < 0.001).
Gender invariance
Because tests of multivariate skewness and kurtosis revealed that multivariate normality was not held for the data of males and females, the RML estimation was adopted and the S-Bχ2 statistics were computed.
The results of gender invariance tests are summarized in Table 3. For the CSS-36, the baseline model fitted the data well, S-Bχ2 (1,158, N = 521) = 2,741.87, p < 0.001, RMSEA = 0.073, 90% CI [0.069, 0.076], CFI = 0.981, NNFI = 0.979. Constraining the factor loadings (ΔCFI = 0.000), item intercepts (ΔCFI = −0.002), item error variances (ΔCFI = 0.000), factor variances (ΔCFI = 0.000), and factor covariances (ΔCFI = 0.000) to be equal across the two gender groups did not significantly reduce the model fit. The final model demonstrated a good model fit, S-Bχ2 (1,275, N = 521) = 3047.29, p < 0.001, RMSEA = 0.073, 90% CI [0.070, 0.077], CFI = 0.979, NNFI = 0.979. These results supported configural invariance, metric invariance, scalar invariance, error variance invariance, factor variance invariance, and factor covariance invariance across the two gender groups. The male group serves as the reference group, in which the factor means were set at zero. Hence, the factor means of the female group indicated the mean differences across the two groups. Females reported greater scores on the subscales of COVID xenophoia (t = 3.35, p < 0.001) and COVID contamination (t = 4.08, p < 0.001) than males did. No gender differences were found for the other subscale scores.
For the CSS-18, a satisfactory fit was found for the baseline model, S-Bχ2 (240, N = 521) = 555.88, p < 0.001, RMSEA = 0.071, 90% CI [0.063, 0.079], CFI = 0.984, NNFI = 0.980. Imposing cross-group equality constraints on the factor loadings (ΔCFI = 0.000), item intercepts (ΔCFI = −0.002), item error variances (ΔCFI = 0.000), factor variances (ΔCFI = 0.000), and factor covariances (ΔCFI = 0.000) did not significantly worsen the model fit. The final model achieved an adequate model fit, S-Bχ2 (303, N = 521) = 654.61, p < 0.001, RMSEA = 0.067, 90% CI [0.060, 0.074], CFI = 0.982, NNFI = 0.982. Configural invariance, metric invariance, scalar invariance, error variance invariance, factor variance invariance, and factor covariance invariance were established across the two gender groups. The factor means of the reference group (male) were set at zero. The factor means of the female group revealed that females reported greater subscale scores of COVID danger (t = 2.07, p < 0.05), COVID xenophoia (t = 2.97, p < 0.01) and COVID contamination (t = 4.68, p < 0.001) compared with males. Gender differences were not observed for the other subscale scores.
Concurrent validity
The descriptive statistics of the CSS-36 and the CSS18 are summarized in Table 4. To assess the concurrent validity of the CSS-36 and the CSS-18 in Hong Kong, the relationships of the CSS-36 and the CSS-18 with fear of COVID-19 and negative emotional states (depression, anxiety, and stress) were investigated. As indicated in Table 5, the measures of fear of COVID-19 and negative emotional states had adequate internal consistency reliability (Cronbach's αs = 0.85 to 0.95, McDonald's ω = 0.85 to 0.95). For the CSS-36, the overall and subscales scores had strong correlations with fear of COVID-19 (rs = 0.52 to 0.75, ps < 0.001) and smaller but significant correlations with depression (rs = 0.12 to 0.23, ps < 0.01), anxiety (rs = 0.21 to 0.31, ps < 0.001), stress (rs = 0.18 to 0.26, ps < 0.001), and the overall DASS-21 score (rs = 0.18 to 0.29, ps < 0.001). Similarly, the overall and subscale scores of the CSS-18 also showed strong correlations with fear of COVID-19 (rs = 0.50 to 0.75, ps < 0.001) and smaller but significant correlations with depression (rs = 0.10 to 0.20, ps < 0.05), anxiety (rs = 0.21 to 0.30, ps < 0.001), stress (rs = 0.17 to 0.23, ps < 0.001), and the overall DASS-21 score (rs = 0.18 to 0.27, ps < 0.001). In sum, the concurrent validity of the CSS-36 and the CSS-18 among Hong Kong undergraduate students was supported.
Internal consistency reliability
The reliability coefficients are summarized in Table 4. Regarding the CSS-36, the overall score (Cronbach's α = 0.97, McDonald's ω = 0.97) and all subscale scores (Cronbach's αs = 0.90 to 0.95, McDonald's ω = 0.90 to 0.95) yielded high reliability coefficients. Besides, the overall CSS-18 score (Cronbach's α = 0.94, McDonald's ω = 0.94) and all subscale scores (Cronbach's αs = 0.83 to 0.89, McDonald's ω = 0.84 to 0.90) also produced high reliability coefficients. Taken together, the CSS-36 and CSS-18 exhibited good internal consistency reliability among Hong Kong undergraduate students.
Discussion
This study attempts to validate the CSS-36 and the CSS-18 in Hong Kong. It was found that the six-factor model demonstrated the best fit. The factorial invariance across gender was established. Females showed higher levels of COVID-19-related stress in the domains of COVID xenophobia and COVID contamination. The CSS showed good internal consistency reliability and concurrent validity with fear of COVID-19 and negative emotional states. This study provided initial evidence for the psychometric properties of the traditional Chinese version of the CSS-36 and the CSS-18 in a sample of Hong Kong undergraduate students.
Taylor et al.'s (13) theoretical framework of COVID-19-related stress encompasses six domains, including fear of the danger of being infected, fear of the socioeconomic consequences of the pandemic, fear that foreigners is spreading the virus, fear of contacting contaminated objects, traumatic stress symptoms regarding the pandemic, and compulsive checking and reassurance seeking concerning the pandemic. Consistent with prior studies (5, 14–18), this study supported the six-factor model for both the CSS-36 and the CSS-18 in Hong Kong. Although Taylor et al. (13) proposed six domains of COVID-19-related stress, their study identified a five-factor solution, which was supported by some other studies (19, 20). One possible explanation is that Taylor et al. (13) used the exploratory factor analysis to identify a five-factor solution, but did not compare it with a six-factor model. Studies examining both models have consistently favored the six-factor model over the five-factor model (5, 14, 17, 21). Similarly, this study found that the six-factor model fitted the data better than did the five-factor model for both the CSS-36 and the CSS-18. These findings resonate with the stress and coping model (42, 43). In particular, the COVID-19 pandemic is a stressor that may affect people's reactions and behavior in various ways (9, 30). Reducing the factor structure may result in information loss and an oversimplification of the domains of COVID-19-related stress.
Moreover, this study established the gender invariance of the six-factor model for both the CSS-36 and the CSS-18. These findings indicate that the items have the same meanings for males and females in Hong Kong, allowing meaningful comparisons of the six domains of COVID-19-related stress across gender in the Hong Kong context. This study found higher COVID xenophobia and COVID contamination in females compared with males. This echoed past research findings that females tend to experience higher levels of stress and negative emotions during the pandemic (44). This might be due to the traditional gender role of women (45). Females are often assumed to be caregivers in the family (46–48), resulting in gender inequalities during the COVID-19 outbreak (49). Compared with males, females are more likely to engage in domestic tasks such as household sterilization, grocery shopping, and caregiving for sick family members, and these tasks might be more challenging during the pandemic (49). The reasons for the gender differences in COVID-19-related stress deserve further investigations. Interestingly, similar to prior research (44), this study did not find a gender difference in the socioeconomic consequences of the pandemic. These findings suggest that higher COVID-19-related stress among females may be domain specific.
This study found that the CSS-36 and the CSS-18 showed comparable levels of reliability and validity in Hong Kong. These findings strengthen the confidence of applying the brief version of the CSS to wider contexts. The CSS-18 allow for a quicker assessment of the COVID-19-related stress (28) without compromising the psychometric properties. Future research is recommended to validate the CSS-18 in other cultural contexts. More important, the CSS may serve as a useful tool for assessing stress related to post-COVID conditions [i.e., long COVID; (50)]. Given that the COVID-19 pandemic has persisted for several years, it remains uncertain whether or not COVID-19-related stress will translate to chronic stress (51). Further studies may adopt the CSS to assess stress related to post-COVID conditions.
The findings of the current study have important practical implications. This study showed that the six domains of COVID-19-related stress (30) are applicable to Hong Kong undergraduate students. In this light, interventions for improving students' wellbeing during the pandemic may target some domains of COVID-19-related stress. For instance, interventions that aims at reducing compulsive checking may be particularly effective in improving mental health during the pandemic. Future studies are needed to examine the effectiveness of those interventions, and the CSS can be used to evaluate the treatment efficacy.
Limitations and future research directions
There are several caveats in this study. First, this study used a cross-sectional design. Future longitudinal research is needed to examine additional psychometric properties of the of the CSS in Hong Kong, including test-retest reliability, longitudinal invariance, and predictive validity with later outcomes. Second, the current sample included undergraduate students in Hong Kong only. Further studies are required to verify the psychometric properties of the CSS in other age groups. Third, the study only used self-report measures to examine the validity of the CSS in Hong Kong. Future work may use neural or physiological measures of stress (e.g., salivary cortisol) to validate the CSS.
Conclusions
The COVID-19 pandemic has caused stress and dampened the mental health of people worldwide. A psychometrically sound tool for assessing COVID-19-related stress is crucial for understanding the detrimental impacts of the COVID-19 pandemic on mental health and evaluating the efficacy of stress reduction intervention programs during the pandemic. To address the research needs, this study sought to evaluate the psychometric properties of the traditional Chinese version of the CSS among Hong Kong undergraduate students. The present results supported the six-factor structure of the CSS. The gender invariance of the six-factor model was established. Adequate internal consistency and concurrent validity were also achieved. The brief version of the CSS might provide a useful tool for more efficient assessments. Besides, the CSS could be useful for assessing stress pertinent to post-COVID-19 syndrome. The implications of the CSS are documented in this article. Future research is suggested to further validate the traditional Chinese version of the CSS in other age groups. More important, the conceptual framework and the factor structure of the CSS could serve as a blueprint for measures of stress related to future pandemics.
Data availability statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Ethics statement
The studies involving human participants were reviewed and approved by Office of Research and Knowledge Transfer, Lingnan University. The patients/participants provided their written informed consent to participate in this study.
Author contributions
TN designed the study and performed the data analysis. TN, WC, and KW conducted the literature review and drafted and revised the manuscript. All authors approved the submitted version of the manuscript.
Funding
This work was supported by the Direct Grant from Lingnan University (Project No. 101172).
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpubh.2023.1149221/full#supplementary-material
References
1. Abdoli A, Falahi S, Kenarkoohi A. COVID-19-associated opportunistic infections: a snapshot on the current reports. Clin Exp Med. (2022) 22:327–46. doi: 10.1007/s10238-021-00751-7
2. Hamimes A, Aouissi HA, Ababsa M, Lounis M, Jayarajah U, Napoli C, et al. The effect of preventive measures and vaccination against SARS-CoV-2 on the infection risk, treatment, and hospitalization: a cross-sectional study of Algeria. Viruses. (2022) 14:2771. doi: 10.3390/v14122771
3. Lounis M, Aouissi HA, Abdelhadi S, Rais MA, Belkessa S, Bencherit D. Short-term adverse effects following booster dose of inactivated-virus vs adenoviral-vector COVID-19 vaccines in Algeria: a cross-sectional study of the general population. Vaccines. (2022) 10:1781. doi: 10.3390/vaccines10111781
4. Jin JM, Bai P, He W, Wu F, Liu XF, Han DM, et al. Gender differences in patients with COVID-19: focus on severity and mortality. Front Public Health. (2020) 8:152. doi: 10.3389/fpubh.2020.00152
5. Noe-Grijalva M, Polo-Ambrocio A, Gómez-Bedia K, Caycho-Rodríguez T. Spanish translation and validation of the COVID stress scales in peru. Front Psychol. (2022) 13:840302. doi: 10.3389/fpsyg.2022.840302
6. World Health Origanization. WHO Director-General's opening remarks at the media briefing on COVID-19 - 11 March 2020. (2020). Available online at: https://www.who.int/director-general/speeches/detail/who-director-general-s-opening-remarks-at-the-media-briefing-on-covid-19-11-march-2020 (accessed February 28, 2023).
7. Zeng Y, Ye B, Zhang Y, Yang Q. Family cohesion and stress consequences among Chinese college students during COVID-19 pandemic: a moderated mediation model. Front Public Health. (2021) 9:703899. doi: 10.3389/fpubh.2021.703899
8. Liu Z, Liu R, Zhang R, Liang L, Wang Y, Wei Y, et al. Latent class analysis of depression and anxiety among medical students during COVID-19 epidemic. BMC Psychiatry. (2021) 21:498. doi: 10.1186/s12888-021-03459-w
9. Taylor S. The psychology of pandemics. Annu Rev Clin Psychol. (2022) 18:581–609. doi: 10.1146/annurev-clinpsy-072720-020131
10. Yalçin I, Can N, Mançe Çalişir Ö, Yalçin S, Çolak B. Latent profile analysis of COVID-19 fear, depression, anxiety, stress, mindfulness, and resilience. Curr Psychol. (2022) 41:459–69. doi: 10.1007/s12144-021-01667-x
11. Xiong J, Lipsitz O, Nasri F, Lui LM, Gill H, Phan L, et al. Impact of COVID-19 pandemic on mental health in the general population: a systematic review. J Affect Disord. (2020) 277:55–64. doi: 10.1016/j.jad.2020.08.001
12. Blasco-Belled A, Tejada-Gallardo C, Fatsini-Prats M, Alsinet C. Mental health among the general population and healthcare workers during the COVID-19 pandemic: a meta-analysis of well-being and psychological distress prevalence. Curr Psychol. (2022). doi: 10.1007/s12144-022-02913-6. [Epub ahead of print].
13. Taylor S, Landry CA, Paluszek MM, Fergus TA, McKay D, Asmundson GJ. Development and initial validation of the COVID Stress Scales. J Anxiety Disord. (2020) 72:102232. doi: 10.1016/j.janxdis.2020.102232
14. Carlander A, Lekander M, Asmundson GJ, Taylor S, Olofsson Bagge R, Lindqvist Bagge AS. COVID-19 related distress in the Swedish population: validation of the Swedish version of the COVID Stress Scales (CSS). PLoS ONE. (2022) 17:e0263888. doi: 10.1371/journal.pone.0263888
15. Jungmann SM, Piefke M, Nin V, Asmundson GJ, Witthöft M. COVID-19 stress syndrome in the German general population: validation of a German version of the COVID stress scales. PLoS ONE. (2023) 18:e0279319. doi: 10.1371/journal.pone.0279319
16. Mahamid FA, Veronese G, Bdier D, Pancake R. Psychometric properties of the COVID stress scales (CSS) within Arabic language in a Palestinian context. Curr Psychol. (2021) 41:7431–40. doi: 10.1007/s12144-021-01794-5
17. Milic M, Dotlic J, Rachor GS, Asmundson GJ, Joksimovic B, Stevanovic J, et al. Validity and reliability of the Serbian COVID stress scales. PLoS ONE. (2021) 16:e0259062. doi: 10.1371/journal.pone.0259062
18. Xia L, Lian Q, Yang H, Wu D. The adaption of the Chinese version of the COVID Stress Scales as a screening instrument of stress: psychometric properties during the COVID-19 pandemic. Front Public Health. (2022) 10:962304. doi: 10.3389/fpubh.2022.962304
19. Abbady AS, El-Gilany AH, El-Dabee FA, Elsadek AM, ElWasify M, Elwasify M. Psychometric characteristics of the of COVID stress scales-Arabic version (CSS-Arabic) in Egyptian and Saudi university students. Middle East Curr Psychiatry. (2021) 28:14. doi: 10.1186/s43045-021-00095-8
20. Khosravani V, Asmundson GJ, Taylor S, Bastan FS, Ardestani SMS. The Persian COVID stress scales (Persian-CSS) and COVID-19-related stress reactions in patients with obsessive-compulsive and anxiety disorders. J Obsessive Compuls Relat Disord. (2021) 28:100615. doi: 10.1016/j.jocrd.2020.100615
21. Adamczyk K, Clark DA, Pradelok J. The polish COVID stress scales: considerations of psychometric functioning, measurement invariance, and validity. PLoS ONE. (2021) 16:e0260459. doi: 10.1371/journal.pone.0260459
22. Liu W, Watson R, Lou FL. The edinburgh feeding evaluation in dementia scale (EdFED): cross-cultural validation of the simplified Chinese version in mainland China. J Clin Nursing. (2014) 23:45–53. doi: 10.1111/j.1365-2702.2012.04250.x
23. Ye S, Ng TK, Lu EY, Ma Z. Chinese Proverb Scale: Development and validation of an indigenous measure of Chinese traditional values. Asian J Soc Psychol. (2018) 21:156–77. doi: 10.1111/ajsp.12217
24. Qiu G, Qiu Y, Zhu Z, Liu Z, Song Y, Hai Y, et al. Re-evaluation of reliability and validity of simplified Chinese version of SRS-22 patient questionnaire: a multicenter study of 333 cases. Spine. (2011) 36:E545–50. doi: 10.1097/BRS.0b013e3181e0485e
25. Ng TK, Ng SH, Ye S. Assimilation and contrast effects of culture priming among Hong Kong Chinese: the moderating roles of dual cultural selves. J Cross Cult Psychol. (2016) 47:540–57. doi: 10.1177/0022022116631826
26. Ng TK, Wang KWC, Chan W. Acculturation and cross-cultural adaptation: the moderating role of social support. Int J Intercult Relat. (2017) 59:19–30. doi: 10.1016/j.ijintrel.2017.04.012
27. Cheung GW, Rensvold RB. Evaluating goodness-of-fit indexes for testing measurement invariance. Struct Equ Model. (2002) 9:233–55. doi: 10.1207/S15328007SEM0902_5
28. Thibault T, Thompson K, Keough M, Krank M, Conrod P, Moore M, et al. Psychometric properties of a brief version of the COVID-19 Stress Scales (CSS-B) in young adult undergraduates. Stress Health. (2023) 39:154–61. doi: 10.1002/smi.3175
29. Yao L, Aleya L, Goldman E, Graff JC, Gu W. An alternative approach—combination of lockdown and open in fighting COVID-19 pandemics. Environ Sci Pollut Res. (2022) 29:82611–4. doi: 10.1007/s11356-022-23438-2
30. Taylor L. COVID-19: Hong Kong reports world's highest death rate as zero covid strategy fails. BMJ. (2022) 376:o707. doi: 10.1136/bmj.o707
31. Wang F, Zhang L, Ding L, Wang L, Deng Y. Fear of COVID-19 among college students: a systematic review and meta-analysis. Front Public Health. (2022) 10:846894. doi: 10.3389/fpubh.2022.846894
32. Camacho-Zuñiga C, Pego L, Escamilla J, Hosseini S. The impact of the COVID-19 pandemic on students' feelings at high school, undergraduate, and postgraduate levels. Heliyon. (2021) 7:e06465. doi: 10.1016/j.heliyon.2021.e06465
33. Zhang Y, Bao X, Yan J, Miao H, Guo C. Anxiety and depression in Chinese students during the COVID-19 pandemic: a meta-analysis. Front Public Health. (2021) 9:697642. doi: 10.3389/fpubh.2021.697642
34. Hambleton RK. The next generation of the ITC test translation and adaptation guidelines. Eur J Psychol Assess. (2001) 17:164–72. doi: 10.1027/1015-5759.17.3.164
35. Ahorsu DK, Lin CY, Imani V, Saffari M, Griffiths MD, Pakpour AH. The fear of COVID-19 scale: development and initial validation. Int J Ment Health Addict. (2020) 20:1537–45. doi: 10.1007/s11469-020-00270-8
36. Chi X, Chen S, Chen Y, Chen D, Yu Q, Guo T, et al. Psychometric evaluation of the fear of COVID-19 scale among Chinese population. Int J Ment Health Addict. (2022) 20:1273–88. doi: 10.1007/s11469-020-00441-7
37. Lovibond PF, Lovibond SH. The structure of negative emotional states: comparison of the depression anxiety stress scales (DASS) with the beck depression and anxiety inventories. Behav Res Ther. (1995) 33:335–43. doi: 10.1016/0005-7967(94)00075-U
38. Taouk M, Lovibond PF, Laube R. Psychometric properties of a Chinese version of the 21-Item Depression Anxiety Stress Scales (DASS21). Sydney, NSW: New South Wales Transcultural Mental Health Centre, Cumberland Hospital (2001).
39. Browne MW, Cudeck R. Alternative ways of assessing model fit. In Bollen, KA, Long JS, Editors. Testing structural equation models. Newbury Park, CA: Sage (1993). p. 136–162.
40. Hu LT, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct Equ Model. (1999) 6:1–55. doi: 10.1080/10705519909540118
42. Lazarus RS, Folkman S. Stress, Appraisal, and Coping. New York, NY: Springer Publishing Company (1984).
43. Wang H, Ng TK, Siu OL. How does psychological capital lead to better well-being for students? the roles of family support and problem-focused coping. Curr Psychol. (2022). doi: 10.1007/s12144-022-03339-w. [Epub ahead of print].
44. Alsharawy A, Spoon R, Smith A, Ball S. Gender differences in fear and risk perception during the COVID-19 pandemic. Front Psychol. (2021) 12:689467. doi: 10.3389/fpsyg.2021.689467
45. Ng TK, Lee TH, Yuen H, Chan W. Attitudes toward homosexuality and same-sex marriage: the roles of parental attitudes, traditional gender role values, and filial piety. Int J Environ Res Public Health. (2023) 20:2194. doi: 10.3390/ijerph20032194
46. Kwan SY, Lo BCY, Ng TK. Maladaptive emotion-focused coping and anxiety in children: The moderating role of authoritative parenting. Curr Psychol. (2022). doi: 10.1007/s12144-022-03312-7. [Epub ahead of print].
47. Schulz R, Beach SR, Czaja SJ, Martire LM, Monin JK. Family caregiving for older adults. Ann Rev Psychol. (2020) 71:635–59. doi: 10.1146/annurev-psych-010419-050754
48. Wong DFK, Ng TK, Zhuang XY. Caregiving burden and psychological distress in Chinese spousal caregivers: gender difference in the moderating role of positive aspects of caregiving. Aging Ment Health. (2019) 23:976–83. doi: 10.1080/13607863.2018.1474447
49. Shek DTL. COVID-19 and quality of life: twelve reflections. Appl Res Qual Life. (2021) 16:1–11. doi: 10.1007/s11482-020-09898-z
50. World Health Organization. Coronavirus Disease (COVID-19): Post-19 Condition. (2021). Available online at: https://www.who.int/news-room/questions-and-answers/item/coronavirus-disease-(covid-19)-post-covid-19-condition (accessed February 28, 2023).
Keywords: COVID-19, stress, Hong Kong, validation study, factor analysis
Citation: Ng TK, Chan W and Wang KWC (2023) Psychometric properties of the traditional Chinese version of the COVID Stress Scales in Hong Kong. Front. Public Health 11:1149221. doi: 10.3389/fpubh.2023.1149221
Received: 21 January 2023; Accepted: 06 March 2023;
Published: 24 March 2023.
Edited by:
Mohammadreza Shalbafan, Iran University of Medical Sciences, IranReviewed by:
Hani Amir Aouissi, Scientific and Technical Research Center on Arid Regions (CRSTRA), AlgeriaLu Xia, Second Xiangya Hospital, Central South University, China
Copyright © 2023 Ng, Chan and Wang. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Ting Kin Ng, bmd0aW5na2luJiN4MDAwNDA7Z21haWwuY29t