Skip to main content

METHODS article

Front. Psychol., 24 April 2023
Sec. Positive Psychology
This article is part of the Research Topic Relationship between Subjective Well-being and Mental Disorders Across the Lifespan View all 8 articles

Reliability and validity of the positive mental health literacy scale in Chinese adolescents

\r\nZhanfang Liu,Zhanfang Liu1,2Fangru YuanFangru Yuan3Jin Zhao,Jin Zhao4,1Jianzheng Du*Jianzheng Du1*
  • 1School of Education, Guangzhou University, Guangzhou, China
  • 2Xiangnan Preschool Education College, Chenzhou, China
  • 3The First High School of Chenzhou (North Campus), Chenzhou, China
  • 4School of Education Science, Liaocheng University, Liaocheng, China

Background and aim: Mental health literacy (MHL) is not only the necessary knowledge and ability to promote mental health, but also an important determinant of mental health. Traditionally, the MHL Scale focuses on measuring knowledge and beliefs about mental disorders. In China, there are very few scales for assessing positive MHL. The present study aimed to evaluate the reliability and validity of a Chinese version of the Positive MHL Scale (MHPK-10) in Chinese adolescents.

Methods: Chinese adolescents (n = 1,247) completed the MHPK-10 online. The validation included the translation and cultural adaptation of the MHPK-10 original version into Chinese and assessment of its psychometric properties: reliability—test–retest and internal consistency, construct validity and criterion validity.

Results: Participant’s mean score on the revised positive MHL scale was 3.75 (SD = 0.69) which was a unidimensional scale. The correlation coefficients between each item and the total score were between 0.639 and 0.753. Scale item loadings ranged between 0.635 and 0.760 based on confirmatory factor analysis. Cronbach’s α coefficient of the scale was 0.869, and the test–retest intraclass correlation coefficient was 0.721 (p < 0.01). Criterion validity was assessed by comparing results of the revised MHPK-10 against those of other validated scales and resulting correlations ranged between 0.342 and 0.615.

Conclusion: The revised Chinese version of the MHPK-10 has sound reliability and validity and can be used to measure Chinese adolescents’ positive MHL.

1. Introduction

Around one-third of people worldwide develop a mental disorder at some point in their life (Steel et al., 2014), and the onset of many mental disorders occurs in childhood or adolescence (Carvalho et al., 2022). Mental disorders seriously affect adolescents’ mental health, wellbeing, academic performance and social relations (Campbell et al., 2022) but very few seek professional help (Seo et al., 2022) while others postpone obtaining support (Jorm, 2012). Yet, delaying treatment makes treatment more difficult (de Diego-Adeliño et al., 2010). Patients are often reluctant to seek help because they are not aware that they have a mental disorder (poor disease recognition ability) or are concerned about stigma (Jorm, 2012). Negative public perceptions of mental health issues and professional treatment are manifestations of poor mental health literacy (MHL) (Daehn et al., 2022).

Mental health literacy is considered to be an important factor in promoting an individual’s mental health and may be beneficial to individual and public mental health (Kutcher et al., 2015; Wei et al., 2015; Ming and Chen, 2020). MHL was originally proposed by Jorm et al. (1997) based on health literacy, which refers to “knowledge and beliefs about mental disorders which aid their recognition, management or prevention”. This definition is often considered the “gold standard” for MHL (Spiker and Hammer, 2019). Research on MHL has further refined the definition, to include four components: “(1) understanding how to obtain and maintain good mental health, (2) understanding mental disorders and their treatments, (3) decreasing stigma related to mental disorders, and (4) enhancing help-seeking efficacy (knowing when, where, and how to obtain good mental healthcare and developing competencies needed for self-care)” (Kutcher et al., 2016).

The proposal of MHL has promoted the development of MHL evaluation tools (Jorm, 2015), and Jorm’s “vignettes interview” (Jorm et al., 1997), Connor’s Mental Health Literacy Scale (MHLS) (O’Connor and Casey, 2015) are examples of typical assessment tools (Jiang et al., 2020). However, all measure the mental illness component of MHL only, and not the mental health component. Based on the basic psychological needs theory (BPNT), Bjørnsen et al. (2017) developed the Mental Health-Promoting Knowledge Scale (MHPK-10) to evaluate positive MHL. The emergence of MHPK-10 is an improvement of MHL assessment tools and has been considered to have a positive impact on mental health promotion activities and assessment (Bjørnsen et al., 2017). Pote and Fulcher (2021) evaluated many current MHL scales and believed that the psychological properties of MHPK-10 were sound, and suggested that other researchers use it. At present, revised versions of MHPK-10 have appeared in Portuguese (Guimarães et al., 2022) and Turkish (Özpulat et al., 2022).

Until now, China does not have a scale for evaluating positive MHL. Because MHPK-10 is a tool for evaluating “how to obtain and maintain good mental health” in MHL, can be completed quickly (there are only 10 questions), is easy to understand (Guimarães et al., 2022) and each item can be translated into practice (Bjørnsen et al., 2017), we have chosen to revise the MHPK-10 into Chinese. The problems to be addressed in this study were: (1) To create a culturally appropriate adaptation of MHPK-10 for a Chinese audience. (2) Evaluate the reliability and validity of a Chinese version of the MHPK-10 in Chinese adolescents, and (3) Explain the dimension values compared to the English version (MHPK-10).

2. Materials and methods

2.1. Participants

2.1.1. Sample 1

Over a 2-week period in October 2022, a cross sectional classroom survey was conducted at a junior college in Hunan Province, China. The online questionnaire was prepared using Sojump1 software, and the researchers asked subjects to scan a two-dimensional code (see Figure 1) and complete it. A total of 1,382 questionnaires were collected, and questionnaires were deemed invalid if the response time was very short (less than 300 s) or if a participant had answered all items in the same way (or adopted a very regular pattern of responses) throughout indicating that he/she had not read the items or not considered each item carefully (Wu et al., 2020). Finally, 1,247 valid questionnaires were retained, yielding a response rate of 90.23%. The valid questionnaire included 297 male and 950 female; the age ranged from 15 to 22 years, with an average of 17.82 ± 1.61 years. The data of sample 1 were randomly divided into two groups. The data of group 1 (n = 609) were used for item analysis and exploratory factor analysis; Group 2’s data (n = 638) were used for confirmatory factor analysis, internal consistency and criterion-related validity analysis.

FIGURE 1
www.frontiersin.org

Figure 1. The two-dimensional code.

2.1.2. Sample 2

After an interval of about 2 weeks, 103 participants were randomly selected from sample 1 and asked to complete the MHPK-10 a second time to assess its test–retest reliability. After matching by student number and eliminating repeated questionnaires (some people completed the questionnaire more than once), 96 valid questionnaires were matched, including 19 male and 77 female, aged between 16 and 21 years, with an average age of 18.47 ± 1.81 years.

2.2. Instruments

2.2.1. Chinese version of positive mental health literacy scale (MHPK-10-C)

The MHPK-10 has 10 items and one dimension. Each item has six answer options and uses a five-point Likert scale where 1 = completely wrong, and 5 = completely correct and “don’t know” (0 when scoring). The final scale score is obtained by averaging the scores of the 10 questions with higher scores indicating higher positive MHL (Bjørnsen et al., 2017).

The MHPK-10 Chinese revision process was as follows: (1) The authorization of the original author was obtained, (2) Three psychologists (2 male, 1 female) established a translation team to translate all items of MHPK-10 individually. (3) Items 8 and 10 were found difficult to understand in the translation process, so we sought the help of the original author and created the first Chinese version of MHPK-10 after receiving feedback. The original author’s feedback was: “Item 8 concerns being able to set limits for yourself, e.g., deciding if you want to drink alcohol based on your own will, or limiting one’s own behavior to what one finds ok. Item 10 concerns the feeling of being able to handle school, and experiencing to some extent that one masters school and schoolwork.” (4) 7 students (3 boys and 4 girls, aged between 16 and 18) were recruited to test the comprehensibility and fluency of each item of the first Chinese version of MHPK-10, and each item was presented individually. (5) After receiving feedback, the translation team revised the first edition of MHPK-10-C to form the second edition. (6) Two English college teachers (both female) back-translated the second Chinese version into English. The original English version, the second Chinese version and the translated English version were back-translated into English, and revised repeatedly, finally forming MHPK-10-C.

2.2.2. Additional measures

The MHPK-10 is an assessment of individual’s positive MHL, and MHL is closely related to mental health. Therefore, we chose positive psychology, MHL and mental health scales to perform a preliminary analysis of criterion validity, as follows:

The short version of the Warwick Edinburgh Mental Wellbeing Scale (SWEMWBS), includes seven items that are responded to using a five-point Likert scale where 1 = none of the time, and 5 = all of the time. Higher scores reflect higher subjective wellbeing (Ringdal et al., 2018; Zhao et al., 2019). In this study, Cronbach’s α was 0.882.

The Mental Health Literacy Questionnaire (MHLQ) developed by Wu et al. (2020) assesses six factors including knowledge of mental health, knowledge of mental illness, attitudes and habits of maintaining and promoting one’s own mental health, attitudes and habits of coping with one’s own mental illness, attitudes and habits of maintaining and promoting others’ mental health, and attitudes and habits of coping with others’ mental illness. The MHLQ is comprised of 60 questions: questions 1 to 30 are scored with either a 0 or 1 (YES = 1, NO = 0, DONT KNOW = 0), and questions 31–60 are scored using a five-point Likert scale, which are converted into 0 and 1 (ratings of 4 and above were re-coded as 1 for positively worded items) points when calculating the total score. The maximum total score is 60, with higher scores indicating better MHL. The internal consistency reliability of the six dimensions ranged from 0.640 to 0.706, and the test–retest reliability of the total score was 0.720 at an interval of 3 weeks. The convergent validity of MHLQ and MHLS was 0.740.

The General Wellbeing Scale (GWBS) (Xiong and Xu, 2009), which has only one question, “How happy are you in general?,” uses a seven-point Likert scale (1 = very unhappy, 7 = very happy) with higher scores reflecting greater happiness.

The Life Satisfaction Scale (LSS; Yao et al., 1995; He, 2021), has only one question: “How satisfied are you with your life?” and is answered using a seven-point Likert scale (1 = very dissatisfied, 7 = very satisfied), with higher scores indicating better life satisfaction.

Self-rated health was assessed by asking participants one question: “How is your current health?” The higher the score, the higher the level of mental health, and was answered using a five-point Likert scale (1 = very poor, 2 = poor, 3 = neither poor or good, 4 = good 5 = excellent). This item has been previously found to be satisfactory for use among adolescents (Breidablik et al., 2008).

The Depression Anxiety Stress Scale includes 21 items, and is responded to using a four-point Likert scale (1 = did not apply to me at all, 4 = applied to me very much or most of the time), with higher scores reflecting lower levels of mental health (DASS) (Gomez et al., 2014; Lu et al., 2020). In this study, Cronbach’s α was 0.919.

The Loneliness scale has only one item, “Do you ever feel lonely?,” which is answered using a five-point Likert scale (1 = never or almost never, 2 = rarely, 3 = sometimes, 4 = regularly, and 5 = almost all the time). Higher scores indicate higher levels of loneliness (Bjørnsen et al., 2019).

2.3. Statistical analyses

Exploratory analysis and factor reliability analysis were performed using SPSS 20.0 (IBM Corp. Released 2011. IBM SPSS Statistics for Windows, Version 20.0. Armonk, NY, USA: IBM Corp.), and confirmatory factor analysis was performed using Amos 23.0. In the analysis, the independent sample t-test was used to evaluate item discrimination, and Pearson’s correlation coefficient was used to determine the correlation between variables (correlation between each item and total score, criterion-related validity, test–retest reliability). Statistical significance was accepted as p < 0.05.

2.4. Ethics statement

The study was approved by the Ethics Committee of the School of Education at Guangzhou University (IRB number: GZHU2020010).

3. Results

3.1. Item analysis

Group 1’s MHPK-10-C responses were classified into two groups. The extreme group method was used to classify them into a high-scoring and a low-scoring group. Those scoring within the highest 24% of scores became the high group (n = 147, Total MHPK-10-C ≥ 43), while those scoring within the bottom 27% became the low group (n = 164, Total MHPK-10-C ≤ 33). Results of the independent sample t-test showed that there were significant differences in MHPK-10-C scores between the high-scoring group and low-scoring group (p < 0.01). The correlation coefficients between each item and the total score were between 0.639 and 0.753 (see Table 1).

TABLE 1
www.frontiersin.org

Table 1. MHPK-10-C#: item means, standard deviations, total correlations, communality, and factor loadings (n = 609).

3.2. Structure validity analysis

3.2.1. Exploratory factor analysis

Exploratory factor analysis (EFA) was conducted to examine the structure of MHPK-10-C using group 1’s data (n = 609). The Kaiser-Meyer-Olkin (KMO) value was 0.928, and the result of Bartlett’s spherical test was significant (χ2 = 2199.048, df = 45, p < 0.01), indicating that the data were suitable for exploratory factor analysis. EFA was performed using the maximum variance rotation method. Based on an eigenvalue greater than 1, one factor with an eigenvalue greater than 1 was extracted, and the cumulative variance contribution rate was 48.38%. According to the standard of commonalities greater than 0.300 and factor loadings greater than 0.400 (Zhou et al., 2022), all items were retained (see Table 1).

3.2.2. Confirmatory factor analysis

Confirmatory factor analysis was performed to examine the factor structure of MHPK-10-C using group 2’s data (n = 638). An analysis of the P-P and Q-Q diagrams showed the data conformed to the standard normal distribution. The factor model, based on the results of the EFA is shown in Table 2. This table shows that confirmatory factor analysis results are within acceptable limits for the MHPK-10-C.

TABLE 2
www.frontiersin.org

Table 2. The measurement model and good fit values (n = 638).

3.3. Criterion-related validity analysis

This study used SWEMWBS, MHLQ, GWBS, LSS, Self-rated health, DASS and the Loneliness Scale to assess the criterion-related validity of MHPK-10-C. The results are shown in Table 3.

TABLE 3
www.frontiersin.org

Table 3. Correlations between scales (n = 638).

3.4. Reliability analysis

Cronbach’s alpha coefficient of the MHPK-10-C scale (n = 638) was 0.869; the intraclass correlation coefficient for the test–retest score was 0.721 (p < 0.01), and the test–retest reliability of each item was between 0.327 and 0.708 (see Table 4).

TABLE 4
www.frontiersin.org

Table 4. Test–retest results–MHPK-10-C (n = 96).

4. Discussion

4.1. Analysis of psychometric properties

After item analysis, it was found that the decision value of MHPK-10-C item’s extreme group comparison was greater than 3.000, and the correlation between items and the total score was more than 0.400 (see Table 1), indicating that each item was well differentiated. One potential limitation was the possibility of MHPK-10 having a ceiling effect (Mean = 4.51, SD = 0.54, Minimum = 0, Maximum = 5) as “The ceiling effect may cause difficulties in establishing the discriminant validity of the scale” (Bjørnsen et al., 2017). However, this effect was not apparent in the present study which is evident by the sample’s mean scores on the instrument (Mean = 3.75, SD = 0.70 Minimum = 0, Maximum = 5).

The results of exploratory factor analysis showed that 10 items in the MHPK-10-C were consistent with the original scale, and one factor was extracted. The commonality of all items was greater than 0.300, the load was greater than 0.400, and the cumulative variance contribution difference was greater than 40.00% (see Table 1). The results of confirmatory factor analysis showed that the one factor model fitted well, with GFI, CFI, NFI, and TLI higher than 0.900, and RMSEA and SRMR less than 0.080 (see Table 2), indicating that the model fitted well on the whole (Zhonglin et al., 2018).

Positive MHL is an important part of MHL (Kutcher et al., 2016). When evaluating the criterion validity of the MHPK-10-C, we believe that positive mental health (SWEMWBS, GWBS, LSS) and MHL (MHLQ) should be included. In addition, MHL is considered to be an important factor in promoting an individual’s mental health (Kutcher et al., 2015; Ming and Chen, 2020), and Bjørnsen found that MHL is closely related to mental health (Bjørnsen et al., 2017). Therefore, a neutral mental health scale (Self-rated health) or illness mental health scale (DAP, Loneliness) may also be selected. The results showed that the total score of MHPK-10-C was significantly positively correlated with SWEMWBS, MHLQ, GWBS, LSS, and Self-rated health, and significantly negatively correlated with the DASS and loneliness scales (see Table 3). Table 3 shows that MHPK-10-C is closely related to positive psychology, MHL and individual mental health, which is consistent with the findings of Bjørnsen et al. (2019) and Guimarães et al. (2022).

In terms of reliability, the Cronbach’s α of the MHPK-10-C was 0.869. A Cronbach’s alpha coefficient of 0.80 ≤ α ≤ 1.00 reflects high reliability (Özpulat et al., 2022) and Cronbach’s alpha of the original scale was 0.84 (Bjørnsen et al., 2017). Similarly,α was 0.79 for the Portuguese version (Guimarães et al., 2022) and 0.871 for the Turkish version (Özpulat et al., 2022).

The test–retest reliability was 0.721, and 0.74 for the original scale (Bjørnsen et al., 2017). Similarly, the test–retest reliability of each item of the revised Chinese version was between 0.327 and 0.708 (see Table 4), while that of the Portuguese version was between 0.28 and 0.79 (Guimarães et al., 2022). The test–retest reliability of individual items was relatively low, possibly because item responses may have been affected by an individuals’ situation at the time and can fluctuate. Nevertheless, the total test–retest reliability reached 0.721, which is acceptable (the critical value was 0.70) (Bjørnsen et al., 2017). In general, MHPK-10-C has sound reliability.

4.2. MHPK-10-C of Chinese teenagers

The results of this survey show that the average MHPK-10 score of Chinese teenagers was 3.74, while the scores of Norwegian, Portuguese and Turkish teenagers are 4.518 (Bjørnsen et al., 2017), 4.280 (Guimarães et al., 2022) and 2.900 (Özpulat et al., 2022), respectively. There are several possible reasons for the different scores. First, MHL is affected by a country’s economic performance. Norway and Portugal are both developed countries, while China and Türkiye are both developing countries and studies have shown that levels of MHL are higher in developed countries than in developing countries (Dang et al., 2018). Second, MHL is affected by the availability of local mental health resources. Ozpulat believes that the lower MHPK-10 scores of adolescents in Türkiye than those of adolescents in Norway may be because most adolescents in Türkiye do not receive mental health education or training. Alternatively, this may be related to an insufficient provision of local mental health resources in Türkiye (Özpulat et al., 2022). Like Türkiye, the mental health resources available to Chinese adolescents also need to be increased.

4.3. Strengths and limitations

The main advantages of this study were a sufficiently large sample size and a high response rate. The study has confirmed that MHPK-10-C has sound psychometric properties in terms of discrimination, reliability, and validity. In particular, in terms of differentiation, both the original scale (Bjørnsen et al., 2017) and the Portuguese version (Guimarães et al., 2022) were concerned about the scale having a ceiling effect which was not apparent in the present study. Our results also indicated that the positive MHL of Chinese adolescents should be enhanced. Fortunately, all entries in MHPK-10 are considered to be translatable into practice (Bjørnsen et al., 2017), which is likely to have a positive impact on the education of positive MHL.

Of course, there are also some limitations to this study. First, the subjects who participated in the study were from one junior college in Hunan Province, China, and most were women (76.18% of the total number). Therefore, our results may not be generalizable to other populations. Second, in order to facilitate the acquisition of responses by minimizing response time (Wu et al., 2020), the survey was conducted online (no paper survey), which may affect the quality of the survey results. However, some studies show that online surveys are influenced less by social expectations than face-to-face paper surveys (Velten et al., 2018).

The study authors believe that in order to address the deficiencies of the current research, follow-up research can be improved by: first, the survey should be expanded to include participants from different regions, and different ages (not only limited to teenagers). The second is to adopt a combination of online surveys and paper questionnaires.

5. Conclusion

The purpose of this study was to revise the MHPK-10 and analyze its psychometric characteristics. The study found that the MHPK-10-C has sound reliability and validity within the context of Chinese culture and can be used to measure positive MHL in Chinese adolescents. Compared to the ceiling effect of MHPK-10, MHPK-10-C has a better discrimination, which indirectly indicates that the level of positive MHL of Chinese adolescents is lower than that of adolescents from developed countries such as Norway and Portugal.

Data availability statement

The original contributions presented in this study are included in the article/supplementary material, further inquiries can be directed to the corresponding author.

Ethics statement

This study was approved by the Ethics Committee of the School of Education at Guangzhou University (IRB number: GZHU2020010). Written informed consent to participate in this study was provided by the participants’ legal guardian/next of kin.

Author contributions

ZL and JD contributed to conception and design of the study. FY organized the database. JZ performed the statistical analysis. ZL wrote the first draft of the manuscript. ZL, FY, JZ, and JD wrote sections of the manuscript. All authors contributed to manuscript revision, read, and approved the submitted version.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Footnotes

  1. ^ https://www.wjx.cn/

References

Bjørnsen, H. N., Eilertsen, M., Ringdal, R., Espnes, G., and Moksnes, U. (2017). Positive mental health literacy: Development and validation of a measure among Norwegian adolescents. BMC Public Health 17:717. doi: 10.1186/s12889-017-4733-6

PubMed Abstract | CrossRef Full Text | Google Scholar

Bjørnsen, H. N., Espnes, G., Eilertsen, M., Ringdal, R., and Moksnes, U. (2019). The relationship between positive mental health literacy and mental well-being among adolescents: Implications for school health services. J. Sch. Nurs. 35, 107–116. doi: 10.1177/1059840517732125

PubMed Abstract | CrossRef Full Text | Google Scholar

Breidablik, H., Meland, E., and Lydersen, S. (2008). Self-Rated health during adolescence: Stability and predictors of change (young-HUNT study, Norway). Eur. J. Public Health 19, 73–78. doi: 10.1093/eurpub/ckn111

PubMed Abstract | CrossRef Full Text | Google Scholar

Campbell, F., Blank, L., Cantrell, A., Baxter, S., Blackmore, C., Dixon, J., et al. (2022). Factors that influence mental health of university and college students in the UK: A systematic review. BMC Public Health 22:1778. doi: 10.1186/s12889-022-13943-x

PubMed Abstract | CrossRef Full Text | Google Scholar

Carvalho, D., Sequeira, C., Querido, A., Tomás, C., Morgado, T., Valentim, O., et al. (2022). Positive mental health literacy: A concept analysis. Front. Psychol. 13:877611. doi: 10.3389/fpsyg.2022.877611

PubMed Abstract | CrossRef Full Text | Google Scholar

Daehn, D., Rudolf, S., Pawils, S., and Renneberg, B. (2022). Perinatal mental health literacy: Knowledge, attitudes, and help-seeking among perinatal women and the public—a systematic review. BMC Pregnancy Childbirth 22:574. doi: 10.1186/s12884-022-04865-y

PubMed Abstract | CrossRef Full Text | Google Scholar

Dang, H., Weiss, B., Trung, L., and Ho, H. (2018). Mental health literacy and intervention program adaptation in the internationalization of school psychology for Vietnam. Psychol. Sch. 55, 941–954. doi: 10.1002/pits.22156

PubMed Abstract | CrossRef Full Text | Google Scholar

de Diego-Adeliño, J., Portella, M., Puigdemont, D., Pérez-Egea, R., Alvarez, E., and Pérez, V. (2010). A short duration of untreated illness (DUI) improves response outcomes in first-depressive episodes. J. Affect. Disord. 120, 221–225. doi: 10.1016/j.jad.2009.03.012

PubMed Abstract | CrossRef Full Text | Google Scholar

Gomez, R., Summers, M., Summers, A., Wolf, A., and Summers, J. J. (2014). Depression anxiety stress scales-21: Factor structure and test-retest invariance, and temporal stability and uniqueness of latent factors in older adults. J. Psychopathol. Behav. Assess. 36, 308–317. doi: 10.1007/s10862-013-9391-0

CrossRef Full Text | Google Scholar

Guimarães, A. C., Trigueiro, M. J., Coelho, T., Maia, I., de Almeida, R. S., Simões-Silva, V., et al. (2022). Validation of the mental health promoting knowledge scale (mhpk-10) for the Portuguese population. RevSALUS Rev. Científica Rede Acad. Ciências Saúde Lusofonia 4:1. doi: 10.51126/revsalus.v4i1.184

CrossRef Full Text | Google Scholar

He, Y. (2021). Investigation on mental health literacy and mental health status of residents in Hubei province after the COVID-19 and group counseling studies. Wuhan: Huazhong Normal University. doi: 10.27159/d.cnki.ghzsu.2021.000680

CrossRef Full Text | Google Scholar

Jiang, G., Zhao, C., Wei, H., Yu, L., Li, D., Lin, X., et al. (2020). Mental health literacy: Connotation, measurement and new framework. J. Psychol. Sci. 43, 232–238. doi: 10.16719/j.cnki.1671-6981.20200132

CrossRef Full Text | Google Scholar

Jorm, A. (2012). Mental health literacy: Empowering the community to take action for better mental health. Am. Psychol. 67, 231–243. doi: 10.1037/a0025957

PubMed Abstract | CrossRef Full Text | Google Scholar

Jorm, A. (2015). Why we need the concept of mental health literacy. Health Commun. 30, 1166–1168. doi: 10.1080/10410236.2015.1037423

PubMed Abstract | CrossRef Full Text | Google Scholar

Jorm, A., Korten, A., Jacomb, P., Christensen, H., Rodgers, B., and Pollitt, P. (1997). “Mental health literacy”: A survey of the public’s ability to recognise mental disorders and their beliefs about the effectiveness of treatment. Med. J. Aust. 166, 182–186. doi: 10.5694/j.1326-5377.1997.tb140071.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Kutcher, S., Bagnell, A., and Wei, Y. (2015). Mental health literacy in secondary schools: A Canadian approach. Child Adolesc. Psychiatr. Clin. N. Am. 24, 233–244. doi: 10.1016/j.chc.2014.11.007

PubMed Abstract | CrossRef Full Text | Google Scholar

Kutcher, S., Wei, Y., Costa, S., Gusmão, R., Skokauskas, N., and Sourander, A. (2016). Enhancing mental health literacy in young people. Eur. Child Adolesc. Psychiatry 25, 567–569. doi: 10.1007/s00787-016-0867-9

PubMed Abstract | CrossRef Full Text | Google Scholar

Lu, S., Duan, X., and Qiu, M. (2020). Longitudinal measurement invariance of the Chinese versions of DASS-21 in college students. Chin. J. Clin. Psychol. 28, 950–953. doi: 10.16128/j.cnki.1005-3611.2020.05.019

CrossRef Full Text | Google Scholar

Ming, Z. J., and Chen, Z. Y. (2020). Mental health literacy: Concept, measurement, intervention and effect. Adv. Psychol. Sci. 28, 1–12. doi: 10.3724/SP.J.1042.2020.00001

CrossRef Full Text | Google Scholar

O’Connor, M., and Casey, L. (2015). The mental health literacy scale (MHLS): A new scale-based measure of mental health literacy. Psychiatry Res. 229, 511–516. doi: 10.1016/j.psychres.2015.05.064

PubMed Abstract | CrossRef Full Text | Google Scholar

Özpulat, F., Öztaş, D., and Günaydin, N. (2022). Reliability and validity of the positive mental health literacy scale in Turkish adolescents. Alpha Psychiatry 23, 76–81. doi: 10.5152/alphapsychiatry.2022.21165

PubMed Abstract | CrossRef Full Text | Google Scholar

Pote, H., and Fulcher, E. (2021). Psychometric properties of global mental health literacy measures. Ment. Health Rev. 1:26.

Google Scholar

Ringdal, R., Bradley Eilertsen, M., Bjørnsen, H., Espnes, G., and Moksnes, U. (2018). Validation of two versions of the Warwick-Edinburgh mental well-being scale among Norwegian adolescents. Scand. J. Public Health 46, 718–725. doi: 10.1177/1403494817735391

PubMed Abstract | CrossRef Full Text | Google Scholar

Seo, Y., Choi, B., Kim, M., and Lim, M. (2022). Exploring psychopathological and cognitive factors associated with help-seeking intentions among Korean high school students: A cross-sectional study. Medicine 101:e29502. doi: 10.1097/MD.0000000000029502

PubMed Abstract | CrossRef Full Text | Google Scholar

Spiker, D., and Hammer, J. (2019). Mental health literacy as theory: Current challenges and future directions. J. Ment. Health 28, 238–242. doi: 10.1080/09638237.2018.1437613

PubMed Abstract | CrossRef Full Text | Google Scholar

Steel, Z., Marnane, C., Iranpour, C., Chey, T., Jackson, J., Patel, V., et al. (2014). The global prevalence of common mental disorders: A systematic review and meta-analysis 1980–2013. Int. J. Epidemiol. 43, 476–493. doi: 10.1093/ije/dyu038

PubMed Abstract | CrossRef Full Text | Google Scholar

Velten, J., Bieda, A., Scholten, S., Wannemüller, A., and Margraf, J. (2018). Lifestyle choices and mental health: A longitudinal survey with German and Chinese students. BMC Public Health 18:632. doi: 10.1186/s12889-018-5526-2

PubMed Abstract | CrossRef Full Text | Google Scholar

Wei, Y., McGrath, P., Hayden, J., and Kutcher, S. (2015). Mental health literacy measures evaluating knowledge, attitudes and help-seeking: A scoping review. BMC Psychiatry 15:291. doi: 10.1186/s12888-015-0681-9

PubMed Abstract | CrossRef Full Text | Google Scholar

Wu, J., Xu, Z., and Yanqing, L. (2020). The development of the mental health literacy questionnaire. Beijing: ChinaXiv.

Google Scholar

Xiong, C., and Xu, Y. (2009). Reliability and validity of the stisfaction with life scale for Chinese demos. China J. Health Psychol. 17, 948–949. doi: 10.13342/j.cnki.cjhp.2009.08.026

CrossRef Full Text | Google Scholar

Yao, C., Nailing, H., and Qi, S. (1995). Analysis on subjective well-being and related factors of elderly college students. Chin. Ment. Health J. 6, 256–257.

Google Scholar

Zhao, B. H., Guo, J. Q., Zhang, X., and Pan, Y. L. (2019). Reliability and validity of warwick-edinburgh mental well-being scale (WEMWBS) in middle-school students. Chin. J. Clin. Psych. 27, 286–289. doi: 10.16128/j.cnki.1005-3611.2019.02.015

CrossRef Full Text | Google Scholar

Zhonglin, W., Binbin, H., and Dandan, T. (2018). Preliminary work for modeling questionnaire data. J. Psychol. Sci. 41, 204–210. doi: 10.16719/j.cnki.1671-6981.20180130

CrossRef Full Text | Google Scholar

Zhou, L., Shanyin, L., and Fang, G. (2022). Revision the Chinese version of the awe experience scale. Chin. J. Clin. Psych. 30, 1138–1142+1148. doi: 10.16128/j.cnki.1005-3611.2022.05.026

CrossRef Full Text | Google Scholar

Keywords: mental health literacy, measure, health promotion, reliability and validity, adolescent

Citation: Liu Z, Yuan F, Zhao J and Du J (2023) Reliability and validity of the positive mental health literacy scale in Chinese adolescents. Front. Psychol. 14:1150293. doi: 10.3389/fpsyg.2023.1150293

Received: 24 January 2023; Accepted: 29 March 2023;
Published: 24 April 2023.

Edited by:

Natalia Martín-María, Universidad Autónoma de Madrid, Spain

Reviewed by:

Carlos Sequeira, University of Porto, Portugal
Tam Pham, Can Tho University of Medicine and Pharmacy, Vietnam
Ah Yusuf, Airlangga University, Indonesia

Copyright © 2023 Liu, Yuan, Zhao and Du. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Jianzheng Du, dujzh@126.com

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.