Wu-Yang Zhang1†
Yan-Jie Zhao2,3,4†Yao Zhang1†Fan He5†Hong-Qing Pan1
Teris Cheung6Gabor S. Ungvari7,8Shu-Ying Li1*
Yu-Tao Xiang2,3,4*- 1Department of Psychiatry, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, China
- 2Unit of Psychiatry, Institute of Translational Medicine, Faculty of Health Sciences, University of Macau, Macao, China
- 3Center for Cognition and Brain Sciences, University of Macau, Macao, China
- 4Institute of Advanced Studies in Humanities and Social Sciences, University of Macau, Macao, China
- 5The National Clinical Research Center for Mental Disorders, Beijing Key Laboratory of Mental Disorders Beijing Anding Hospital, The Advanced Innovation Center for Human Brain Protection, School of Mental Health, Capital Medical University, Beijing, China
- 6School of Nursing, Hong Kong Polytechnic University, Hong Kong, China
- 7Division of Psychiatry, School of Medicine, University of Western Australia/Graylands Hospital, Perth, WA, Australia
- 8Department of Psychiatry, University of Notre Dame Australia, Fremantle, WA, Australia
Background: Accurate and reliable self-report measurement tools examining depressive symptoms are scant in child psychiatry. This study assessed the psychometric properties of the Chinese Version of the Quick Inventory of Depressive Symptomatology-Self-Report (C-QIDS-SR) in depressed adolescents in China.
Methods: Adolescents with major depressive episodes or bipolar depressive episodes were assessed using the C-QIDS-SR. The structure validity of the C-QIDS-SR was estimated using principal component analysis with varimax rotation.
Results: A total of 246 depressed adolescents were included in the study. Cronbach's alpha was 0.77. The correlation coefficient between the baseline and endpoint assessments was 0.49 (p < 0.001), whereas, the correlation coefficient between the C-QIDS-SR and the Hamilton Rating Scale for Depression−17 items (HAMD-17) was 0.63 (p < 0.001). Principal component analysis with varimax rotation demonstrated the unidimensional structure of the C-QIDS-SR.
Conclusion: The C-QIDS-SR is a reliable and valid instrument with acceptable psychometric properties to measure depressive symptoms in adolescents.
Introduction
Depression is common in adolescents (1). The National Comorbidity Survey–Adolescent Supplement (NCS-A) found that the lifetime and 12-months prevalence estimates of major depression in adolescents in the US were 11.0 and 7.5%, respectively (2). Depression in adolescents is associated with a range of adverse outcomes, such as cognitive decline, impaired resilience and suicidal ideation (3, 4). In the past few decades, standardized measurement tools have been developed and adopted to measure depressive symptoms in clinical practice and research for both adult and adolescent patients, such as the Hamilton Rating Scale for Depression (HAMD) (5) and the Montgomery-Asberg Depression Rating Scale (MADRS) (6). However, these scales are time-consuming and have to be administered by clinicians or trained researchers (7). Therefore, user-friendly, accurate, and short measurement tools on self-assessment of depressive symptoms are warranted (8, 9). Several self-rating measures have been developed, such as the Patient Health Questionnaire-9 (PHQ-9) (10, 11), the Beck Depression Inventory (BDI) (12, 13), and the Self-Rating Depression Scale (SDS) (14, 15).
The 16-item Quick Inventory of Depressive Symptomatology-Self-Report (QIDS-SR) is a widely used instrument with satisfactory psychometric properties (16). The 16 items of the QIDS-SR were derived from the nine symptom criteria for major depressive disorder (MDD) in the Diagnostic and Statistical Manual of Mental Disorders, fourth edition (DSM-IV) (17). This scale assesses the severity of depressive symptoms in patients with MDD or bipolar disorder (BP) (18). The Chinese version of QIDS-SR was introduced in China in 2012 and it has proven to be a reliable and valid tool in adult patients with MDD (19) and other major psychiatric disorders and major medical conditions, such as schizophrenia (20), and hepatitis B virus (HBV)-related liver disease (21).
In 2015 there were around 271 million children and adolescents (<18 years old) in China; 85 million of them were adolescents (12–17 years) (22). It is estimated that 19.85% of Chinese children and adolescents suffer from depressive symptoms (23), which means that around 16.9 million adolescents require timely assessment and treatment. Yet, as far as we could ascertain, to date very few studies have examined the usefulness of standardized instruments in depressed adolescents, which gave the impetus to investigate the psychometric properties of the QIDS-SR in adolescents with MDD or BP.
Methods
Settings and Subjects
This study was conducted in Department of Child Psychiatry, the First Affiliated Hospital of Zhengzhou University, China. Patients who met the following inclusion criteria were consecutively invited to participate in the study: (1) adolescents aged between 12 and 17 years; (2) were diagnosed with major depressive episodes (MDE) or bipolar depressive episodes (depressed adolescents hereafter) according to the International Statistical Classification of Diseases and Related Health Problems, 10th revision (ICD-10) by a review of medical records; (3) scored a total of ≥7 in the Hamilton Rating Scale for Depression−17 items (HAMD-17); and (4) were able to understand the purpose and contents of the assessment. Patients with cognitive impairment or intellectual disability were excluded. The study protocol was approved by the Institutional Review Board (IRB) of the First Affiliated Hospital of Zhengzhou University. All participants provided oral informed consent whilst their legal guardians provided written informed consent prior to participation in the study.
Assessment Instrument
Basic demographics and clinical characteristics were collected using a form designed for this study. The Chinese version of the Quick Inventory of Depressive Symptomatology-Self-rating (C-QIDS-SR) was used to measure the severity of depressive symptoms during the past week. The C-QIDS-SR consists of 16 items, in nine domains: (1) sleep; (2) sad mood; (3) appetite/weight change; (4) concentration/decision making; (5) self-outlook; (6) thoughts of death or suicide; (7) involvement; (8) energy level; and (9) agitation/retardation (16, 19). The C-QIDS-SR total score ranges from 0 to 27, with higher scores indicating more severe depressive symptomatology.
The HAMD-17 was used to assess the severity of depressive symptoms in the past week. The Chinese version of the HAMD-17 has been validated in Chinese populations yielding good psychometric properties (5, 24). The HAMD-17 was applied to screen depressed adolescents and assess criterion-related validity in this study. Participants were interviewed by a child psychiatrist who received formal training in the administration of HAMD-17.
Statistical Analysis
Data were analyzed with the Statistical Analysis System, University Edition (SAS Institute Inc., Cary, North Carolina, U.S.). Internal consistent reliability was examined with the Cronbach's alpha coefficient: an alpha of 0.6 or higher was considered acceptable (20, 25). The associations between C-QIDS-SR total score and domain scores, and test-retest reliability were examined by the aid of Pearson's correlation coefficient. Criterion validity was assessed with Pearson's correlation coefficient between C-QIDS-SR and HAMD-17 total scores. The structure validity of the C-QIDS-SR in depressed adolescents was estimated by exploratory factor analysis. A principal component analysis (PCA) with varimax rotation was performed to extract the factors and obtain the most meaningful original factor structure of the C-QIDS-SR. If one factor explained 20% or more of total variance, the scale was considered to be unidimensional (20, 26, 27). Level of significance level was set at <0.05 (two-tailed).
Results
A total of 246 depressed adolescents were recruited in this study; 170 were diagnosed with MDE and the rest with bipolar depressive episode. The basic demographic and clinical characteristics of the sample are shown in Table 1.
Table 1. Basic demographics and clinical characteristics of the study sample.
A Cronbach's alpha of 0.77 indicated satisfactory internal consistency and homogeneity between C-QIDS-SR items. The item-total correlation coefficients in the five domains of sad mood, concentration/decision making, self-outlook, thoughts of death or suicide, energy level of the C-QIDS-SR were above 0.60, demonstrating acceptable item-total correlation. The item-total correlation coefficients were not affected if any of these domains were omitted (Table 2).
Table 2. QIDS rating at baseline in depressed Chinese adolescents (N = 246).
To examine the test-retest reliability, 91 participants, received the C-QIDS-SR assessment twice within 2 weeks. The Pearson's correlation coefficient between baseline and endpoint assessments was 0.49 (p < 0.001), showing moderate test-retest reliability. The correlation coefficient between the C-QIDS-SR and the HAMD-17 was 0.63 (p < 0.001), indicating an acceptable criterion validity.
Principal component analysis with varimax rotation was performed to examine the structure validity of the C-QIDS-SR. The first factor explained 36.47% of the total variance and being above 20% it signifies that the scale was unidimensional. Figure 1 shows the scree plot with the magnitude of eigenvalue as the function of factor extraction order.
Figure 1. Scree plot for the QIDS-SR at baseline.
Discussion
To the best of our knowledge, this was the first study that examined the psychometric properties of C-QIDS-SR in depressed adolescents. C-QIDS-SR was found to be a reliable and valid measurement tool in assessing the severity of depressive symptoms in depressed adolescents. All participants were able to complete this self-reported scale, indicating that the C-QIDS-SR may be an easy-to-use tool in child and adolescent psychiatry.
Internal consistency of the C-QIDS-SR in depressed adolescents (0.77) is similar to the figures found in adult patients with MDD (0.76) (19); either inpatients (0.83) (28), or patients with HBV-related liver diseases (0.796) (21), or depressed schizophrenia patients (0.73) (20). Item-total correlation showed that the “sleep” and “appetite/weight change” domains had the lowest correlation coefficients to the total score (0.44 and 0.51, respectively), which is similar to the findings in adult patients in China (20, 21, 28) and other countries (29). The “concentration/decision making,” “sad mood,” “self-outlook,” “thoughts of death or suicide,” and “energy level” domains had high item-total correlation coefficients (i.e., >0.6), replicating previous findings in adult patients with mood disorders (18).
The test-retest reliability of 0.49 shows acceptable correlation coefficient. The relatively low test-retest reliability might be associated with the fluctuations of depressive symptoms during the 2 weeks of data collection period. Criterion validity for C-QIDS-SR in depressed adolescents was established by comparing C-QIDS-SR with the HAMD-17; the correlation coefficient of 0.63 was higher when compared to studies conducted in adult patients using the HAMD-17 as the reference criterion (both r = 0.54) (19, 28). The exploratory factor analysis identified only one principal factor, demonstrating that C-QIDS-SR is a unidimensional scale. All nine domains were closely related to the independent factor, i.e., the overall severity of depression, which is similar to previous findings in China and in other countries (16, 18–21, 28).
Several methodological shortcomings of the study should be addressed. First, participants were only recruited from one major hospital, which limits the generalizability and overall representativeness of the findings. Second, the sample size of adolescents with bipolar depression was relatively small reflecting the actual clinical situation. Third, there were no healthy controls, therefore the discrimination criterion and cutoff value could not be determined. Fourth, the symptomatology of depression in adolescents is somewhat different from that in adults. For example, irritability and anger are more common in depressed adolescents than in adults. The QIDS-SR was originally developed for use in depressed adult populations, thus symptoms more characterized of depressed adolescents were not included in the QIDS-SR, which probably affected its sensitivity in adolescents. Finally, only the principal psychiatric diagnosis were recorded in the electronic medical record system, therefore the impact of comorbidities on the psychometric properties of C-QIDS-SR could not be explored.
In conclusion, C-QIDS-SR has proven to be a reliable, valid, and quick self-report instrument that accurately measured depressive symptoms in adolescents. The psychometric properties of the C-QIDS-SR were acceptable; thus this instrument could be used in both clinical and research settings.
Data Availability Statement
The original contributions presented in the study are included in the article/supplementary material, further inquiries can be directed to the corresponding author/s.
Ethics Statement
The studies involving human participants were reviewed and approved by Institutional Review Board (IRB) of the First Affiliated Hospital of Zhengzhou University. Written informed consent to participate in this study was provided by the participants' legal guardian/next of kin.
Author Contributions
FH, S-YL, and Y-TX: study design. W-YZ, Y-JZ, YZ, and H-QP: data collection, analysis, and interpretation. Y-JZ, TC, and Y-TX: drafting of the manuscript. GU: critical revision of the manuscript. All co-authors: approval of the final version for publication.
Funding
This study was supported by the National Science and Technology Major Project for investigational new drug (2018ZX09201-014), the Beijing Municipal Science & Technology Commission (No. Z181100001518005), and the University of Macau (MYRG2019-00066-FHS).
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
1. Xu DD, Rao WW, Cao XL, Wen SY, Che WI, Ng CH, et al. Prevalence of major depressive disorder in children and adolescents in China: a systematic review and meta-analysis. J Affect Disord. (2018) 241:592–8. doi: 10.1016/j.jad.2018.07.083
2. Avenevoli S, Swendsen J, He JP, Burstein M, Merikangas KR. Major depression in the national comorbidity survey-adolescent supplement: prevalence, correlates, and treatment. J Am Acad Child Adolesc Psychiatry. (2015) 54:37–44.e32. doi: 10.1016/j.jaac.2014.10.010
3. Cheung VHM, Chan CY, Au RKC. The influence of resilience and coping strategies on suicidal ideation among Chinese undergraduate freshmen in Hong Kong. Asia Pac Psychiatry. (2019) 11:e12339. doi: 10.1111/appy.12339
4. Lei W, Liu K, Li N, Liang X, Xiang B, Huang C, et al. Validation of the Chinese version General Causality Orientation Scale-Clinical Population and causality orientations assessing in major depressions. Asia Pac Psychiatry. (2019) 11:e12348. doi: 10.1111/appy.12348
5. Hamilton M. A rating scale for depression. J Neurol Neurosurg Psychiatry. (1960) 23:56–62. doi: 10.1136/jnnp.23.1.56
6. Montgomery SA, Asberg M. A new depression scale designed to be sensitive to change. Br J Psychiatry. (1979) 134:382–9. doi: 10.1192/bjp.134.4.382
7. Zimmerman M, McGlinchey JB. Why don't psychiatrists use scales to measure outcome when treating depressed patients? J Clin Psychiatry. (2008) 69:1916–9. doi: 10.4088/JCP.v69n1209
8. Anosike C, Isah A, Igboeli NU. Development and validation of a questionnaire for evaluating knowledge of risk factors for teen depression among health care trainees of a Nigerian University. Asia Pac Psychiatry. (2020) 12:e12391. doi: 10.1111/appy.12391
9. Kendrick T, El-Gohary M, Stuart B, Gilbody S, Churchill R, Aiken L, et al. Routine use of patient reported outcome measures (PROMs) for improving treatment of common mental health disorders in adults. Cochrane Database Syst Rev. (2016) 7:Cd011119. doi: 10.1002/14651858.CD011119.pub2
10. Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med. (2001) 16:606–13. doi: 10.1046/j.1525-1497.2001.016009606.x
11. Leung DYP, Mak YW, Leung SF, Chiang VCL, Loke AY. Measurement invariances of the PHQ-9 across gender and age groups in Chinese adolescents. Asia Pac Psychiatry. (2020) 12:e12381. doi: 10.1111/appy.12381
12. Salkind MR. Beck depression inventory in general practice. J R Coll Gen Pract. (1969) 18:267–71.
13. Schwab J, Bialow M, Clemmons R, Martin P, Holzer C. The Beck depression inventory with medical inpatients. Acta Psychiatr Scand. (1967) 43:255–66. doi: 10.1111/j.1600-0447.1967.tb05762.x
14. Zung WW. A self-rating depression scale. Arch Gen Psychiatry. (1965) 12:63–70. doi: 10.1001/archpsyc.1965.01720310065008
15. Zung WW, Richards CB, Short MJ. Self-rating depression scale in an outpatient clinic. Further validation of the SDS. Arch Gen Psychiatry. (1965) 13:508–15. doi: 10.1001/archpsyc.1965.01730060026004
16. Rush AJ, Trivedi MH, Ibrahim HM, Carmody TJ, Arnow B, Klein DN, et al. The 16-Item Quick Inventory of Depressive Symptomatology (QIDS), clinician rating (QIDS-C), and self-report (QIDS-SR): a psychometric evaluation in patients with chronic major depression. Biol Psychiatry. (2003) 54:573–83. doi: 10.1016/S0006-3223(02)01866-8
17. American Psychiatric Association (1994). Diagnostic and Statistical Manual of Mental Disorders, 4th Edn. Washington, DC: American Psychiatric Association.
18. Trivedi MH, Rush AJ, Ibrahim HM, Carmody TJ, Biggs MM, Suppes T, et al. The Inventory of Depressive Symptomatology, Clinician Rating (IDS-C) and Self-Report (IDS-SR), and the Quick Inventory of Depressive Symptomatology, Clinician Rating (QIDS-C) and Self-Report (QIDS-SR) in public sector patients with mood disorders: a psychometric evaluation. Psychol Med. (2004) 34:73–82. doi: 10.1017/S0033291703001107
19. Liu J, Xiang Y-T, Wang G, Zhu X-Z, Ungvari GS, Kilbourne AM, et al. Psychometric properties of the Chinese versions of the Quick Inventory of Depressive Symptomatology—Clinician Rating (C-QIDS-C) and Self-Report (C-QIDS-SR). J Affect Disord. (2013) 147:421–4. doi: 10.1016/j.jad.2012.08.035
20. Ma X-R, Hou C-L, Zang Y, Jia F-J, Lin Y-Q, Li Y, et al. Could the Quick Inventory of Depressive Symptomatology-Self-Report (QIDS-SR) be used in depressed schizophrenia patients? J Affect Disord. (2015) 172:191–4. doi: 10.1016/j.jad.2014.09.051
21. Liu M, Wang Y, Zhao J, Zheng S, Ungvari GS, Ng CH, et al. The psychometric properties of the Quick Inventory of Depressive Symptomatology-Self-Report (QIDS-SR) in patients with HBV-related liver disease. Shanghai Arch Psychiatry. (2017) 29:15–20. doi: 10.11919/j.issn.1002-0829.216076
22. National Bureau of Statistics of China, United Nations International Children's Emergency Fund, United Nations Population Fund. Population Status of Children in China in 2015: Facts and Figures. (2017). Available online at: https://www.unicef.cn/en/reports/population-status-children-china-2015 (accessed April 2024, 2020).
23. Rao WW, Xu DD, Cao XL, Wen SY, Che WI, Ng CH, et al. Prevalence of depressive symptoms in children and adolescents in China: a meta-analysis of observational studies. Psychiatry Res. (2019) 272:790–6. doi: 10.1016/j.psychres.2018.12.133
24. Zhao JP, Zheng YP. The reliability and validity of Hamilton Rating Scale for Depression (in Chinese). J Chinese Mental Health. (1992) 6:214–6.
25. Ursachi G, Horodnic IA, Zait A. How reliable are measurement scales? External factors with indirect influence on reliability. Estimators Proc Econ Finance. (2015) 20:679–86. doi: 10.1016/S2212-5671(15)00123-9
26. Atkeson LR, Alvarez RM. The Oxford Handbook of Polling and Survey Methods. Oxford: Oxford University Press (2018). doi: 10.1093/oxfordhb/9780190213299.013.34
27. Reckase MD. Unifactor latent trait models applied to multifactor tests: results and implications. J Educ Statist. (1979) 4:207–30. doi: 10.3102/10769986004003207
28. Feng Y, Huang W, Tian TF, Wang G, Hu C, Chiu HF, et al. The psychometric properties of the Quick Inventory of Depressive Symptomatology-Self-Report (QIDS-SR) and the Patient Health Questionnaire-9 (PHQ-9) in depressed inpatients in China. Psychiatry Res. (2016) 243:92–6. doi: 10.1016/j.psychres.2016.06.021
29. Rush AJ, Bernstein IH, Trivedi MH, Carmody TJ, Wisniewski S, Mundt JC, et al. An evaluation of the quick inventory of depressive symptomatology and the hamilton rating scale for depression: a sequenced treatment alternatives to relieve depression trial report. Biol Psychiatry. (2006) 59:493–501. doi: 10.1016/j.biopsych.2005.08.022
Keywords: depression, reliability, validity, C-QIDS-SR, adolescents
Citation: Zhang W-Y, Zhao Y-J, Zhang Y, He F, Pan H-Q, Cheung T, Ungvari GS, Li S-Y and Xiang Y-T (2020) Psychometric Properties of the Quick Inventory of Depressive Symptomatology-Self-Report (QIDS-SR) in Depressed Adolescents. Front. Psychiatry 11:598609. doi: 10.3389/fpsyt.2020.598609
Received: 25 August 2020; Accepted: 05 November 2020;
Published: 09 December 2020.
Edited by:
Jing Sun, Griffith University, AustraliaReviewed by:
Bao-Liang Zhong, China University of Geosciences Wuhan, ChinaJihui Zhang, The Chinese University of Hong Kong, China
Copyright © 2020 Zhang, Zhao, Zhang, He, Pan, Cheung, Ungvari, Li and Xiang. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Yu-Tao Xiang, xyutly@gmail.com; Shu-Ying Li, liShu-Ying6112@126.com
†These authors have contributed equally to this work