Skip to main content

ORIGINAL RESEARCH article

Front. Psychol., 01 February 2023
Sec. Quantitative Psychology and Measurement

A psychometric evaluation of Chinese chronic hepatitis B virus infection-related stigma scale using classical test theory and item response theory

Sirui ZhongSirui Zhong1Yuxiao ZhouYuxiao Zhou1Wuerken ZhumajiangWuerken Zhumajiang2Lifen FengLifen Feng3Jing GuJing Gu1Xiao Lin
Xiao Lin1*Yuantao Hao
Yuantao Hao4*
  • 1School of Public Health, Sun Yat-sen University, Guangzhou, China
  • 2Department of Disease Control and Prevention, Putian Municipal Health Commission, Putian, China
  • 3Guangdong Health Commission Affairs Center (External Health Cooperation Service Center of Guangdong Province), Guangzhou, China
  • 4Peking University Center for Public Health and Epidemic Preparedness and Response, Beijing, China

Purpose: To validate the hepatitis B virus infection-related stigma scale (HBVISS) using Classical Test Theory and Item Response Theory in a sample of Chinese chronic HBV carriers.

Methods: Feasibility, internal consistency reliability, split-half reliability and construct validity were evaluated using a cross-sectional validation study (n = 1,058) in Classical Test Theory. Content validity was assessed by COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) criteria. The Item Response Theory (IRT) model parameters were estimated using Samejima’s graded response model, after which item response category characteristic curves were drawn. Item information, test information, and IRT-based marginal reliability were calculated. Measurement invariance was assessed using differential item functioning (DIF). SPSS and R software were used for the analysis.

Results: The response rate reached 96.4% and the scale was completed in an average time of 5 min. Content validity of HBVISS was sufficient (+) and the quality of the evidence was high according to COSMIN criteria. Confirmatory factor analysis showed acceptable goodness-of-fit (χ2/df = 5.40, standardized root mean square residual = 0.057, root mean square error of approximation = 0.064, goodness-of-fit index = 0.902, comparative fit index = 0.925, incremental fit index = 0.926, and Tucker-Lewis index = 0.912). Cronbach’s α fell in the range of 0.79–0.89 for each dimension and 0.93 for the total scale. Split-half reliability was 0.96. IRT discrimination parameters were estimated to range between 0.959 and 2.333, and the threshold parameters were in the range-3.767 to 3.894. The average score for test information was 12.75 (information >10) when the theta level reached between-4 and + 4. The IRT-based marginal reliability was 0.95 for the total scale and fell in the range of 0.83–0.91 for each dimension. No measurement invariance was detected (d-R2 < 0.02).

Conclusion: HBVISS exhibited good feasibility, reliability, validity, and item quality, making it suitable for assessing chronic Hepatitis B virus infection-related stigma.

1. Introduction

Hepatitis B virus (HBV) infection is a significant global public health problem. In 2019, the World Health Organization estimated a global prevalence of HBV infection in the general population of 3.8%, amounting to approximately 296 million people living with chronic hepatitis B virus infection (WHO, 2021). HBV causes high mortality rates due to complications such as cirrhosis, hepatic decompensation, and hepatocellular carcinoma. Despite remarkable changes in the healthcare and hepatitis vaccination programs recently rolled out in China, the country still bears the highest disease burden in the world, with over one-third of the world’s HBV infections and deaths occurring in China (Chen et al., 2018). This heavy infection burden is accompanied by the stigma associated with chronic HBV infection (Wallace et al., 2017; Mokaya et al., 2018; Le et al., 2019; Zhu et al., 2019; Smith-Palmer et al., 2020). In China, evidence of stigma that marginalizes chronic HBV carriers from diverse social aspects is conclusive (Liu, 2016; Wallace et al., 2017; Han et al., 2018). Separation, manifested as social exclusion, is the most common form of stigma, followed by status loss and discrimination (Jin et al., 2021). System reviews have also shown that HBV-related stigma is a barrier to healthcare for HBV infection including prevention, diagnosis, and treatment strategies, and has potential negative impacts on mental health and well-being (Ellard and Wallace, 2013; Vedio et al., 2017; Mokaya et al., 2018). HBV-related stigma is mostly driven by fear of contagion due to a lack of knowledge of transmission routes (Lee et al., 2016; Jin et al., 2021) as well as negative preconception that those who become infected with HBV in adults were attributed to substance misuse and sexual promiscuity (Smith-Palmer et al., 2020). Despite a much greater global prevalence and longer course of disease (Bartenschlager et al., 2018), studies on conceptualizing HBV stigma are much lesser than HCV, which can be theorized as identity, embodiment, institutionalization, and structuration (Harris et al., 2021). Moreover, HBV-related stigma has been less administrated than HIV, which may partly attribute to a lack of political prioritization around HBV compared with the substantial public health interventions on HIV (Smith-Palmer et al., 2020).

Development and validation of comprehensive and objective measurement of the stigma related to chronic HBV infection is a prerequisite for implementing appropriate interventions to eliminate and reduce stigma. However, studies on measuring HBV-related stigma in China are limited. Most previously purposed HBV-related stigma measurements in China are based solely on perception or knowledge scales that quantifies broad negative emotions in the general population toward HBV-positive individuals and few studies have focused on measuring stigma from the perspective of chronic HBV infection patients (Jin et al., 2021). To fill this gap, the hepatitis B virus infection-related stigma scale (HBVISS) has been developed through the standard scale-development procedures by our research group (Lifen et al., 2011) and initially validated in a 151 sample using Classical Test Theory (CTT) analysis in 2012 (Lifen et al., 2012). Our HBVISS is a self-reported scale designed to assess the stigma that hepatitis B-infected patients perceive in their everyday lives. In the process of scale development, it took into account not only the opinions of doctors and experts but also the consideration of patients and their families, making it more in line with the actual feelings of patients. Although the scale has shown good psychometric properties in the preliminary validation (Lifen et al., 2012), the scale still needs to be verified comprehensively and scientifically via a larger representative sample for better application in real-world study. CTT is a traditional quantitative approach to testing the reliability and validity of a scale based on the observed score, while Item Response Theory (IRT) attempts to explain the connection between observed item responses on scales and subjects’ latent traits based on item characteristic curves (Cappelleri et al., 2014). Moreover, IRT provides a unique advantage of sample independence of estimated parameters, which would enhance the extrapolation of the analysis results (DeVellis, 2006; Thomas, 2019). Therefore, a combination of CTT and IRT analysis allows us to have a deeper understanding of the psychometric properties of HBVISS.

Scale validation is a crucial step before its general application. However, the evidence to support the psychometric properties of identified HBV-related stigma instruments is very limited currently (Smith-Palmer et al., 2020). This article aims to further validate the psychometric properties of our HBVISS by implementing the CTT and IRT analysis, in order to quantitatively examine its suitability for the assessment of chronic HBV infection-related stigma, with the ultimate goal to better measure HBV-related stigma in China.

2. Materials and methods

2.1. Instruments

Hepatitis B virus infection-related stigma scale consists of 23 items, which can be concluded in 5 dimensions including received stigma, negative self-perception, perceived stigma, disease secrecy and secondary stigma. A 5-point Likert scale was used as the item response format. The options of all items were 1 = strongly disagree, 2 = disagree, 3 = neutral, 4 = agree, and 5 = strongly agree, with higher scores indicating stronger levels of chronic HBV infection-related stigma. The construct and content of HBVISS are shown in Table 1.

TABLE 1
www.frontiersin.org

Table 1. The dimensions and items of hepatitis B virus infection-related stigma scale.

2.2. Participants

One thousand ninety-seven participants were recruited in two first-class general hospitals in Guangdong Province, China --The Third Affiliated Hospital of Sun Yat-sen University and the Eighth People’s Hospital of Guangzhou. A convenience sampling method was used. Participants from both the outpatient and inpatient departments of these hospitals were recruited if they met all of the following inclusion criteria:

1. People with chronic HBV infection, including asymptomatic chronic HBV carriers and patients with chronic hepatitis B (CHB) and/or hepatitis B-induced liver cirrhosis. Participants must have had a diagnosed chronic HBV infection for 1 year or longer by doctors, following the guidelines for the prevention and treatment of CHB (2010 version) (Chinese Society of Hepatology and Chinese Society of Infectious Diseases Chinese Medical Association, 2011).

2. People aged 18–60 years who were able to read, write, and communicate with basic understanding capabilities.

3. People with the ability to complete the survey on their own or with the help of investigators.

4. People who volunteered for participation and were willing to sign an informed consent form.

The exclusion criteria were as follows:

1. People with liver cancer, pulmonary or neurological diseases, or co-infection with other hepatitis viruses or HIV.

2. People with disabilities, past or present chronic infectious diseases, or mental disorders.

3. People who had been critically ill.

2.3. Data collection

Participants were asked to independently complete a questionnaire composed of two parts, one of which was an assessment of self-reported socio-demographic information on gender, age, residence, education, marital status, diagnosis, per capita annual disposable income, course of illness, and treatment status; the other part was HBVISS. In HBVISS, the sum of all answers to items within a given dimension represented the dimension score, which along with the total score, was transformed into a 0–100 scale to allow better interpretation and comparison.

2.4. Statistical analysis

2.4.1. Feasibility and descriptive statistics

The scale feasibility was determined by the response rate and average time to complete the scale. The mean, standard deviation (SD), skewness, kurtosis, missing number and rate, and percentage of responses at the floor and ceiling of each item were described. Generally, a highest score/lowest score ratio of >25% indicated the presence of a ceiling/floor effect (Raat et al., 2007). The average total score and dimension scores were also calculated.

2.4.2. COnsensus-based standards for the selection of health measurement INstruments analysis for content validity

COSMIN (COnsensus-based Standards for the selection of health Measurement INstruments), which includes a consensus-based methodology for rating the content validity of PROMs (Patient-Reported Outcome Measures) (Terwee et al., 2018a), was used. The COSMIN methodology for evaluating the content validity of PROMs consists of three steps (Terwee et al., 2018b). Firstly, we used qualitative measurement to score each step of the scale development. Secondly, we evaluated the content validity by asking patients and professionals about the relevance, comprehensiveness, and comprehensibility of the PROM. Thirdly, we evaluated the content validity of the PROM, based on the quality and results of the available studies and the PROM itself, using the scoring system (see details in www.cosmin.nl). Data acquisition and score assignments were conducted by two graduate students majoring in Medical Statistics at Sun Yat-sen University.

2.4.3. Classical test theory analysis

The scale’s internal consistency reliability was assessed by calculating Cronbach’s α α coefficient, and generally, α > 0.70 is acceptable (Charter, 2003). Split-half reliability was assessed by calculating the correlation of two halves of the scale, which were split based on odd-numbered and even-numbered items (Uloku, 2022). The construct validity of the theoretical 5-factor model was assessed by confirmatory factor analysis (CFA). The standardized path diagram was drawn to depict the relationship between the factors and items. The model fit was examined using the ratio χ2/degree of freedom (χ2/df), root mean square error of approximation (RMSEA), standardized root mean square residual (SRMR), goodness-of-fit index (GFI), comparative fit index (CFI), incremental fit index (IFI), and Tucker-Lewis index (TLI). A χ2/df ratio ≤ 5.00 demonstrated an acceptable model fit (Gil-Monte et al., 2010). The fit was considered to be adequate when the RMSEA and SRMR were ≤ 0.08, and the GFI, CFI, IFI, and TLI were ≥ 0.90 (Hu and Bentler, 1999).

2.4.4. Item response theory analysis

We first tested the two basic assumptions of IRT: unidimensionality and local independence. We used exploratory factor analysis (EFA) to test the unidimensionality. It would be considered a convincing indicator of unidimensionality if the ratio of the eigenvalues of the first and second unrotated EFA components was greater than 3:1 (Ye et al., 2018). Local independence was examined by the residual correlation matrix produced by the single factor CFA, and items with residual correlations <0.20 were deemed to be acceptable (Reeve et al., 2007).

Upon satisfaction of the two assumptions, we fitted Samejima’s two-parameter graded response model (Samejima, 1997), which is specifically an extension of the 2-Parameter Logistic Model for ordered polytomous items (Hambleton et al., 2010). According to Samejima’s theory, the distinguishing power of a multilevel item remains the same, but the threshold parameters increase as the score increases (Embretson and Reise, 2000). Therefore, we obtained one discrimination parameter (a) and four threshold parameters (bi) for each item. Larger values of discrimination parameters implied that the related items were more capable of identifying individuals at different trait levels, and threshold parameters should monotonically increase with the category (Kamudoni et al., 2018). Item response category characteristic curves were drawn. Response categories function optimally when each category has a distinct peak on the category probability curve, and the peaks are dispersed across all levels of the latent trait (Hendriks et al., 2012; Kamudoni et al., 2018).

In IRT, precision is conceptualized as information of each item. The more information obtained by the item for a given trait level, the more precise and reliable the prediction (Chiesi et al., 2018). The item information varies with the latent trait level being measured. We drew item information curves and test information curves, to show the amount of information on each item of five dimensions and the cumulative information of the scale given the various latent trait, respectively. IRT-based marginal reliability was also evaluated. The marginal reliability, an IRT-based analog to α, is an average of the reliability over different trait levels and accurately characterizes the measurement precision. As shown by a previous study, marginal reliability of 0.623 is generally acceptable (Zakria et al., 2019).

In addition, we evaluated differential item functioning (DIF) to explore whether people from different groups with equal abilities had unequal item response probabilities. The presence, magnitude, and impact of DIF concerning gender (male and female), age (18–35 and 36–60 years old), case source (hospitalized, outpatient), residence (urban and rural area), marital status (married and unmarried), education (junior middle school and below, senior high school and above), occupation (manual worker, mental worker, unemployed), income (average monthly family income < ¥1,499, ¥1,500–3,499, and > ¥3,500), and diagnosis (asymptomatic HBV carriers, CHB patients, and hepatitis B-induced cirrhosis patients) were evaluated using ordinal logistic regression models (Crane et al., 2006). A ≤ 0.02 change in McFadden’s pseudo R2 between the models was used as a criterion for the absence of DIF (Choi et al., 2011).

2.4.5. Computation tools

The collected data were analyzed using SPSS/Win 26.0 (IBM Corp., Armonk, NY, United States). CFA was analyzed using SPSS Amos 26. IRT analyzes were performed in the RStudio environment for R (version 4.1.2). The R package ltm (version 1.2–0), mirt (version 1.36.1) and lordif (version 0.3–3) were used.

2.4.6. Ethics approval and consent to participate

All procedures performed in studies were approved by the Ethics Committee of School of Public Health, Sun Yat-sen University. Informed consent was obtained from all individual participants included in the study.

3. Results

3.1. Basic characteristics of the participants

One thousand fifty-eight participants were finally included in the study. Table 2 lists a descriptive analysis of the participants’ demographic characteristics. Most of the participants (81.0%) were male. Nearly half were from urban areas, and the other half were from rural areas. Most of the participants were married, employed, and had at least a senior high school diploma (Table 2).

TABLE 2
www.frontiersin.org

Table 2. Participants’ demographic and disease characteristics (n = 1,058).

3.2. Feasibility and descriptive statistics

We distributed 1,097 questionnaires at the study site and 1,058 of them were returned; the response rate was 96.4%. The questionnaire was completed in an average time of 5 min. The means of item scores ranged from 2.17 to 3.62, the standard deviation ranged from 0.83 to 1.20, the skewness coefficient was-0.77–0.86, and item kurtosis was-0.99–1.23. The range of percentages of response at the floor (score = 1) was 3.02–33.27% and that at the ceiling (score = 5) was 1.52–17.11% (Table 3). The average total score of HBVISS was 45.62, and the average dimension scores ranged from 31.84 to 59.92 (range 0–100), with the highest score for disease secrecy and the lowest score for secondary stigma (Table 4).

TABLE 3
www.frontiersin.org

Table 3. Descriptive statistics of hepatitis B virus infection-related stigma scale (HBVISS) items (n = 1,058).

TABLE 4
www.frontiersin.org

Table 4. Scale descriptive statistics and reliability assessment.

3.3. Classical test theory analyzes and COSMIN results

3.3.1. Validity

According to the scoring standards of COSMIN and the actual scale development process, we finally concluded that the overall content validity of HBVISS was sufficient (+) and the quality of the evidence was high. The result of the final step is presented in Appendix 1. The CFA exhibited adequate fit (χ2/df = 5.40, SRMR = 0.057, RMSEA = 0.064, GFI = 0.902, CFI = 0.925, IFI = 0.926, and TLI were = 0.912) and strong item factor loadings [ranging from 0.52 to 0.85, all >0.5 and most >0.7 (Figure 1)] (Korn et al., 2021), implying that HBVISS had acceptable construct validity.

FIGURE 1
www.frontiersin.org

Figure 1. Standardized path diagram of confirmatory factor model.

3.3.2. Reliability

Cronbach’s α coefficient was 0.79–0.89 for each dimension and 0.93 for the total scale, which was above the threshold of 0.70 (Table 4). The correlation of the two halves of the scale was 0.96, showing great split-half reliability.

3.4. Item response theory analyzes results

3.4.1. Unidimensionality and local independence

The ratio of the eigenvalues of the first and second unrotated EFA components was 4.32, confirming the unidimensionality of HBVISS. The residual correlation matrix produced by a single factor CFA showed that out of 253 unique item pairs, only 10 pairs (4.0%) had a residual correlation of ≥0.20, thereby fulfilling the requirement of local independence.

3.4.2. Discrimination and threshold parameters

Table 5 shows the values of the discrimination (a) and threshold parameters (b1, b2, b3, and b4) for the 23 items in HBVISS. The estimated IRT discrimination parameters ranged from 0.959 to 2.333 and the threshold parameters ranged from-3.767 to 3.894. All item discrimination values were > 0.9, indicating moderate to very high discriminatory power (Baker, 1985). The threshold parameters were also evenly spaced, indicating that the item categories were appropriately separated in terms of latent trait measurement.

TABLE 5
www.frontiersin.org

Table 5. Estimated item response theory (IRT) parameters of hepatitis B virus infection-related stigma scale (HBVISS) (n = 1,058).

3.4.3. Item response category characteristic curves

Item response category characteristic curves depicted the relationship between the level of the patients’ perception of HBV-related stigma (i.e., the latent trait) and the probability of selecting the specific option for each item in the scale (Hendriks et al., 2012). The curves for all 23 items were shown in Figure 2, where the curves 1–5 in each plot corresponded to the five options (strongly disagree, disagree, neutral, agree, and strongly agree) of each item, respectively. Take item R3 as an example, patients with perceived HBV-related stigma (latent trait) levels below −2.1 were more likely to respond 1 (strongly disagree), while the patients with perceived HBV-related stigma levels between −2.1 and 0 were most likely to respond 2 (disagree). The curves of five options for all items showed the same character in-4 to 4 --curves 1 and 5 were monotonically decreasing and increasing respectively, and curves 2–4 were symmetrically distributed, with no overlap, indicating reasonable option settings and ideal measurement performance of all items (Figure 2).

FIGURE 2
www.frontiersin.org

Figure 2. Item response category characteristic curves of all items in hepatitis B virus infection-related stigma scale (HBVISS).

3.4.4. Information curve and IRT-based marginal reliability

Item information curves (Figure 3) showed that the items of “Perceived stigma” (P11-P15) possessed the highest information among the five dimensions, indicating the importance of the response of this specific dimension in terms of the measurement of perceived stigma level. Moreover, test information curves (Figure 4) showed that the 23 items altogether provided an abundant amount of information for measuring perceived stigma level ranging −2 ~ 2. Figure 4 also showed that when the stigma level equaled to 0, the test (or scale) information was the highest, highlighting the precision of the estimated results. The average test information that we calculated reached 12.75, proving that our scale could provide reliable results (information >10.0). The IRT-based marginal reliability was 0.95 for the total scale and 0.83–0.91 for the dimensions (Table 6).

FIGURE 3
www.frontiersin.org

Figure 3. Item information curves of five dimensions of hepatitis B virus infection-related stigma scale (HBVISS).

FIGURE 4
www.frontiersin.org

Figure 4. Test information curve of hepatitis B virus infection-related stigma scale (HBVISS).

TABLE 6
www.frontiersin.org

Table 6. Marginal reliability of each dimension and total scale.

3.4.5. Differential item functioning

We did not detect DIF for gender, age, case source, residence, marital status, education, occupation, income, and diagnosis. The McFadden’s pseudo R2 value for change (d-R2) was <0.02 for all items, which means that the results of each item are not affected by the covariates. In terms of the DIF magnitude, the two highest values were detected when analyzing the age DIF for item R1 [I once suffered from unfair treatment because of the hepatitis B infection (rejected from admission, work, dating, marriage, sex, etc.)] (d-R2 = 0.019) and income DIF for the item D17 (“I do not want to tell others about my hepatitis B infection.”) (d-R2 = 0.016). However, the DIF magnitude was lower than the threshold d-R2 effect size of 0.02, indicating a negligible impact.

4. Discussion

To the best of our knowledge, this HBVISS is the first scale measuring HBV-related stigma from the perspective of patients in the local cultural context. This study validated the psychometric properties of HBVISS in a combination of CTT and IRT methods. Compared with the preliminary study on validity and reliability of the scale, our study not only had a larger sample size but also used more comprehensive analysis methods. Therefore, it is of great significance to the general application of HBVISS and may help collection of evidence for the advances of policies reducing the stigma against HBV infection.

As the results have shown, CTT analysis enabled us to have an overall grasp of the reliability and validity of HBVISS, while IRT showed us the characteristic of each item. The estimation of parameters and the calculation of information were also instrumental for the future development of computerized adaptive testing, so as to allow the medical care providers efficiently screen out the HBV-infected patients who perceived high levels of stigma and provide tailored nursing for their psychological health. In addition, comparisons of the item parameters and the exploration of the underlying reasons could direct us to develop the short form of scale. For example, item R2 had the lowest discriminative power among the 23 items. We think the possible reasons are as follows. On the one hand, as a review concluded, both individuals and their family members are prone to conceal the fact of HBV infection for the fear of discrimination from society (Lee et al., 2016). On the contrary, patients’ family members may also seek medical advice from others to support the patients. Hence, if an overall short form of HBVISS is to be constructed, item 2 may be removed from the short scale with minor accuracy compromise and remaining integrity of the measurement.

Different from other developed scales that focus on the views of the public toward HBV patients (Cotler et al., 2012; Shi et al., 2013), our scale is more intrinsic to patients’ inner feelings. Currently, HBVISS has been used in a few clinical research to investigate HBV patients’ perception of the stigma, so as to explore its mutual effect on social support, self-management behavior, and narrative nursing (Huang et al., 2021; Wang and Li, 2021a,b). To some extent, HBVISS would be of great significance to improving patients’ quality of life (QOL). Although QOL is still a subjective and vague concept, it is generally accepted that the individual is the most suitable judge of one’s own QOL (Hacker, 2010). In other words, physicians’ beliefs about the subjective states of their patients may be imprecise and inaccurate (Dorian and Brijmohan, 2020). Therefore, with our validated five-dimensional measurement tool, it is possible to quantitatively estimate the importance of specific interventions for patients’ QOL improvement and compare the effectiveness of different interventions from the self-assessed perspective of patients.

Several study limitations should be noted. Firstly, although we measured reliability using several different methods, the test–retest reliability of HBVISS was not evaluated. Secondly, this scale was developed in the Chinese cultural context and has been validated in Chinese. To be applied in diverse populations and different countries, further back-translation, culture adaptation, and pretesting are needed according to the guidelines (Beaton et al., 2000; Sousa and Rojjanasrirat, 2011). However, the strengths of the current study can still be noted. First, a large sample size of 1,058 patients completed the scale, making the results more reliable. Second, we used not only CTT but also IRT method to depict a precise characterization of the psychometric properties of each item, providing strong evidences for item validation and practical references for future application and interpretation of HBVISS. Last but not least, we provide evidence to support the psychometric properties of our scale, which is very limited among current HBV-related stigma instruments (Smith-Palmer et al., 2020).

5. Conclusion

Hepatitis B virus infection-related stigma scale is a 23-item instrument that can be used to measure chronic HBV infection-related stigma in China. Our analysis showed good feasibility, reliability, validity, and item quality (discrimination, threshold, information, and measurement invariance). Our results indicate that HBVISS is an appropriate tool for the assessment of chronic HBV infection-related stigma in the Chinese context.

Data availability statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics statement

The studies involving human participants were reviewed and approved by the Ethics Committee of School of Public Health, Sun Yat-sen University. The patients/participants provided their written informed consent to participate in this study.

Author contributions

SZ: conceptualization, formal analysis, investigation, methodology, validation, visualization, and writing–original draft. YZ and WZ: formal analysis and methodology. LF: data collection. JG: survey arrangement. XL: conceptualization, funding acquisition, methodology, and project administration. YH: conceptualization, funding acquisition, methodology, and project administration. All authors contributed to the article and approved the submitted version.

Funding

This study was supported by National Science and Technology Major Project of China, Grant Number 2018ZX10715004 and Guangdong Basic and Applied Basic Research Foundation, Grant Numbers 2020A1515011294, 2020A1515110230, 2021A1515011765, and 2021A1515011591. The sponsor of the study had no role in study design, data collection, data analysis, data interpretation, or writing of the manuscript.

Acknowledgments

YH gratefully acknowledges the support of K. C. Wong Education Foundation. We also wish to thank all the participants included in the study, the staff who have been involved in the data collection, and all the experts involved in the study.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Abbreviations

HBVISS, Hepatitis B Virus Infection-related Stigma Scale; CTT, Classical Test Theory; IRT, Item Response Theory; COSMIN, COnsensus-based Standards for the selection of health Measurement INstruments; PROMs, Patient-Reported Outcome Measures; DIF, differential item functioning; HBV, Hepatitis B virus; CHB, Chronic Hepatitis B; SD, Standard Deviation; CFA, confirmatory factor analysis; EFA, exploratory factor analysis; RMSEA, root mean square error of approximation; SRMR, standardized root mean square residual; GFI, goodness-of-fit index; CFI, comparative fit index; IFI, incremental fit index; TLI, Tucker-Lewis index; QOL, quality of life.

References

Baker, F. B. (1985). The Basics of Item Response Theory. Portsmouth: Heinemann.

Google Scholar

Bartenschlager, R., Baumert, T. F., Bukh, J., Houghton, M., Lemon, S. M., Lindenbach, B. D., et al. (2018). Critical challenges and emerging opportunities in hepatitis C virus research in an era of potent antiviral therapy: considerations for scientists and funding agencies. Virus Res. 248, 53–62. doi: 10.1016/j.virusres.2018.02.016

CrossRef Full Text | Google Scholar

Beaton, D. E., Bombardier, C., Guillemin, F., and Ferraz, M. B. (2000). Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila Pa 1976) 25, 3186–3191. doi: 10.1097/00007632-200012150-00014

CrossRef Full Text | Google Scholar

Cappelleri, J. C., Jason Lundy, J., and Hays, R. D. (2014). Overview of classical test theory and item response theory for the quantitative assessment of items in developing patient-reported outcomes measures. Clin. Ther. 36, 648–662. doi: 10.1016/j.clinthera.2014.04.006

PubMed Abstract | CrossRef Full Text | Google Scholar

Charter, R. A. (2003). A breakdown of reliability coefficients by test type and reliability method, and the clinical implications of low reliability. J. Gen. Psychol. 130, 290–304. doi: 10.1080/00221300309601160

PubMed Abstract | CrossRef Full Text | Google Scholar

Chen, S., Li, J., Wang, D., Fung, H., Wong, L. Y., and Zhao, L. (2018). The hepatitis B epidemic in China should receive more attention. Lancet 391:1572. doi: 10.1016/S0140-6736(18)30499-9

PubMed Abstract | CrossRef Full Text | Google Scholar

Chiesi, F., Morsanyi, K., Donati, M. A., and Primi, C. (2018). Applying item response theory to develop a shortened version of the need for cognition scale. Adv. Cogn. Psychol. 14, 75–86. doi: 10.5709/acp-0240-z

PubMed Abstract | CrossRef Full Text | Google Scholar

Chinese Society of Hepatology and Chinese Society of Infectious Diseases Chinese Medical Association (2011). The guideline of prevention and treatment for chronic hepatitis B (2010 version). Zhonghua Gan Zang Bing Za Zhi 19, 13–24. doi: 10.3760/cma.j.issn.1007-3418.2011.01.007

CrossRef Full Text | Google Scholar

Choi, S. W., Gibbons, L. E., and Crane, P. K. (2011). Lordif: an R package for detecting differential item functioning using iterative hybrid ordinal logistic regression/item response theory and Monte Carlo simulations. J. Stat. Softw. 39, 1–30. doi: 10.18637/jss.v039.i08

CrossRef Full Text | Google Scholar

Cotler, S. J., Cotler, S., Xie, H., Luc, B. J., Layden, T. J., and Wong, S. S. (2012). Characterizing hepatitis B stigma in Chinese immigrants. J. Viral Hepat. 19, 147–152. doi: 10.1111/j.1365-2893.2011.01462.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Crane, P. K., Gibbons, L. E., Jolley, L., and Van Belle, G. (2006). Differential item functioning analysis with ordinal logistic regression techniques: DIFdetect and difwithpar. Med. Care 44, S115–S123. doi: 10.1097/01.mlr.0000245183.28384.ed

CrossRef Full Text | Google Scholar

DeVellis, R. F. (2006). Classical test theory. Med. Care 44, S50–S59. doi: 10.1097/01.mlr.0000245426.10853.30

CrossRef Full Text | Google Scholar

Dorian, P., and Brijmohan, H. A. (2020). The role of quality of life indices in patient-centred management of arrhythmia. Can. J. Cardiol. 36, 1022–1031. doi: 10.1016/j.cjca.2020.03.014

PubMed Abstract | CrossRef Full Text | Google Scholar

Ellard, J., and Wallace, J. (2013). Stigma, Discrimination and Hepatitis B: A Review of Current Research ARCSHS Monograph Series 93. Melbourne: Australian Research Centre in Sex, Health and Society, La Trobe University.

Google Scholar

Embretson, S. E., and Reise, S. P. (2000). Item response Theory for Psychologists. Mahwah, NJ: Lawrence Erlbaum Associates Publishers.

Google Scholar

Gil-Monte, P. R., Carlotto, M. S., and Mara, S. C. A. (2010). Validation of the Brazilian version of the 'Spanish burnout Inventory' in teachers. Rev. Saude Publica 44, 140–147. doi: 10.1590/s0034-89102010000100015

CrossRef Full Text | Google Scholar

Hacker, E. D. (2010). Technology and quality of life outcomes. Semin. Oncol. Nurs. 26, 47–58. doi: 10.1016/j.soncn.2009.11.007

PubMed Abstract | CrossRef Full Text | Google Scholar

Hambleton, R. K., Van Der Linden, W. J., and Wells, C. S. (2010). “IRT models for the analysis of polytomously scored data: brief and selected history of model building advances” in Handbook of Polytomous Item Response Theory Models. eds. M. Nering and R. Ostini (Abingdon-on-Thames: Routledge Academic)

Google Scholar

Han, B., Yuan, Q., Shi, Y., Hou, J., Shang, J., Han, Y., et al. (2018). The experience of discrimination of individuals living with chronic hepatitis B in four provinces of China. PLoS One 13:e0195455. doi: 10.1371/journal.pone.0195455

CrossRef Full Text | Google Scholar

Harris, M., Guy, D., Picchio, C. A., White, T. M., Rhodes, T., and Lazarus, J. V. (2021). Conceptualising hepatitis C stigma: a thematic synthesis of qualitative research. Int. J. Drug Policy 96:103320. doi: 10.1016/j.drugpo.2021.103320

CrossRef Full Text | Google Scholar

Hendriks, J., Fyfe, S., Styles, I., Skinner, S. R., and Merriman, G. (2012). Scale construction utilising the Rasch unidimensional measurement model: a measurement of adolescent attitudes towards abortion. Australas Med J 5, 251–261. doi: 10.4066/AMJ.2012.952

CrossRef Full Text | Google Scholar

Hu, L. T., and Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct. Equ. Model. 6, 1–55. doi: 10.1080/10705519909540118

CrossRef Full Text | Google Scholar

Huang, H., Li, Y., Zhang, C., Wang, N., and Sun, Y. (2021). Mediating effect of social support between stigma and self-management among patients with chronic hepatitis B. J. Qilu Nurs. 27, 10–13.

Google Scholar

Jin, D., Treloar, C., and Brener, L. (2021). Hepatitis B virus related stigma among Chinese living in mainland China: a scoping review. Psychol. Health Med. 27, 1760–1773. doi: 10.1080/13548506.2021.1944651

CrossRef Full Text | Google Scholar

Kamudoni, P., Johns, N. P., and Salek, S. (2018). Living with Chronic Disease: Measuring Important Patient-Reported Outcomes. Singapore: Springer Singapore.

Google Scholar

Korn, A. R., Appel, J., Hammond, R. A., Hennessy, E., Masse, L. C., Must, A., et al. (2021). Validation and refinement of the stakeholder-driven community diffusion survey for childhood obesity prevention. Implement. Sci. 16:91. doi: 10.1186/s13012-021-01158-4

PubMed Abstract | CrossRef Full Text | Google Scholar

Le, T. V., Vu, T., Mai, H. T., Nguyen, L. H., Truong, N. T., Hoang, C. L., et al. (2019). Social determinants of stigma and discrimination in Vietnamese patients with chronic hepatitis B. Int. J. Environ. Res. Public Health 16:398. doi: 10.3390/ijerph16030398

CrossRef Full Text | Google Scholar

Lee, H., Fawcett, J., Kim, D., and Yang, J. H. (2016). Correlates of hepatitis B virus-related stigmatization experienced by Asians: a scoping review of literature. Asia Pac. J. Oncol. Nurs. 3, 324–334. doi: 10.4103/2347-5625.195896

PubMed Abstract | CrossRef Full Text | Google Scholar

Lifen, F., Junqiang, X., Xia, Z., Jingzhi, H., Weilin, G., Jing, G., et al. (2012). Preliminary study on validity and reliability of the chronic HBV-infections related stigma scale. Chin. J. Behav. Med. Brain Sci. 4, 370–372. doi: 10.3760/cma.j.issn.1674-6554.2012.04.028

CrossRef Full Text | Google Scholar

Lifen, F., Junqiang, X., Xia, Z., Jingzhi, H., Weilin, G., and Yuantao, H. (2011). Development Strategy of Stigma and Discrimination Scale for Chronic Hepatitis B Virus Infection, In 2011 China Health Statistics Annual Conference.

Google Scholar

Liu, K. (2016). Hepatitis B infection in China: the stigma behind the stigmata. Liver Int. 36, 1582–1584. doi: 10.1111/liv.13189

CrossRef Full Text | Google Scholar

Mokaya, J., Mcnaughton, A. L., Burbridge, L., Maponga, T., O'hara, G., Andersson, M., et al. (2018). A blind spot? Confronting the stigma of hepatitis B virus (HBV) infection - a systematic review. Wellcome Open Res. 3:29. doi: 10.12688/wellcomeopenres.14273.2

CrossRef Full Text | Google Scholar

Raat, H., Landgraf, J. M., Oostenbrink, R., Moll, H. A., and Essink-Bot, M. (2007). Reliability and validity of the infant and toddler quality of life questionnaire (ITQOL) in a general population and respiratory disease sample. Qual. Life Res. Int. J. Qual. Life Asp. Treat. Care Rehab. 16, 445–460. doi: 10.1007/s11136-006-9134-8

PubMed Abstract | CrossRef Full Text | Google Scholar

Reeve, B. B., Hays, R. D., Bjorner, J. B., Cook, K. F., Crane, P. K., Teresi, J. A., et al. (2007). Psychometric evaluation and calibration of health-related quality of life item banks: plans for the patient-reported outcomes measurement information system (PROMIS). Med. Care 45, S22–S31. doi: 10.1097/01.mlr.0000250483.85507.04

CrossRef Full Text | Google Scholar

Samejima, F. (1997). Graded response model, W. J. Lindenvan der and R. K. Hambleton Handbook of Modern Item Response Theory. Berlin: Springer.

Google Scholar

Shi, J., Chyun, D. A., Sun, Z., and Zhou, L. (2013). Assessing the stigma toward chronic carriers of hepatitis B virus. J. Appl. Soc. Psychol. 43, E46–E55. doi: 10.1111/jasp.12040

CrossRef Full Text | Google Scholar

Smith-Palmer, J., Cerri, K., Sbarigia, U., Chan, E., Pollock, R. F., Valentine, W. J., et al. (2020). Impact of stigma on people living with chronic hepatitis B. Patient Relat. Outcome Meas. 11, 95–107. doi: 10.2147/PROM.S226936

CrossRef Full Text | Google Scholar

Sousa, V., and Rojjanasrirat, W. (2011). Translation, adaptation and validation of instruments or scales for use in cross-cultural health care research: a clear and user-friendly guideline. J. Eval. Clin. Pract. 17, 268–274. doi: 10.1111/j.1365-2753.2010.01434.x

CrossRef Full Text | Google Scholar

Terwee, C. B., Prinsen, C. A. C., Chiarotto, A., Westerman, M. J., Patrick, D. L., Alonso, J., et al. (2018a). COSMIN methodology for evaluating the content validity of patient-reported outcome measures: a Delphi study. Qual. Life Res. Int. J. Qual. Life Asp. Treat. Care Rehab. 27, 1159–1170. doi: 10.1007/s11136-018-1829-0

PubMed Abstract | CrossRef Full Text | Google Scholar

Terwee, C. B., Prinsen, C., Chiarotto, A., De vet, H., Bouter, L. M., Alonso, J., et al. (2018b). “COSMIN methodology for assessing the content validity of PROMs–user manual,” Amsterdam: VU University Medical Center.

Google Scholar

Thomas, M. L. (2019). Advances in applications of item response theory to clinical assessment. Psychol. Assess. 31, 1442–1455. doi: 10.1037/pas0000597

PubMed Abstract | CrossRef Full Text | Google Scholar

Uloku, O. P. (2022). Split-Half Method of Estimating Reliability Index: A Comparison of The Odd-even and First-and Second-half Ways of Splitting Test Items. OSSAI, Peter Agbadobi Uloku (Ph.D).

Google Scholar

Vedio, A., Liu, E., Lee, A., and Salway, S. (2017). Improving access to health care for chronic hepatitis B among migrant Chinese populations: a systematic mixed methods review of barriers and enablers. J. Viral Hepat. 24, 526–540. doi: 10.1111/jvh.12673

PubMed Abstract | CrossRef Full Text | Google Scholar

Wallace, J., Pitts, M., Liu, C., Lin, V., Hajarizadeh, B., Richmond, J., et al. (2017). More than a virus: a qualitative study of the social implications of hepatitis B infection in China. Int. J. Equity Health 16:137. doi: 10.1186/s12939-017-0637-4

PubMed Abstract | CrossRef Full Text | Google Scholar

Wang, H., and Li, P. (2021a). Study on the effect of narrative nursing on clinical treatment and quality of life of patients with chronic hepatitis B. Chin. Foreign Med. Res. 19, 99–103. doi: 10.14033/j.cnki.cfmr.2021.29.031

CrossRef Full Text | Google Scholar

Wang, H., and Li, P. (2021b). Investigation of stigma in patients with chronic hepatitis B and analysis of its influencing factors. J. Chin. Prescription Drug 19, 186–188. doi: 10.3969/j.issn.1671-945X.2021.08.086

CrossRef Full Text | Google Scholar

WHO. (2021). Global Progress Report on HIV, Viral Hepatitis and Sexually Transmitted Infections. Geneva, Switzerland: World Health Organization.

Google Scholar

Ye, Z. J., Liang, M. Z., Zhang, H. W., Li, P. F., Ouyang, X. R., Yu, Y. L., et al. (2018). Psychometric properties of the Chinese version of resilience scale specific to cancer: an item response theory analysis. Qual. Life Res. 27, 1635–1645. doi: 10.1007/s11136-018-1835-2

PubMed Abstract | CrossRef Full Text | Google Scholar

Zakria, N. M., Tengku Ismail, T. A., Wan Mansor, W. N. A., and Sulaiman, Z. (2019). Validation of infant and young child feeding questionnaire for the assessment of knowledge, attitudes and practices among child care providers: the IYCF-CCPQ. Int. J. Environ. Res. Public Health 16:2147. doi: 10.3390/ijerph16122147

PubMed Abstract | CrossRef Full Text | Google Scholar

Zhu, L., Kong, J., Zheng, Y., Song, M., Cheng, X., Zhang, L., et al. (2019). Development and initial validation of the chronic hepatitis B quality of life instrument (CHBQOL) among Chinese patients. Qual. Life Res. 28, 3071–3081. doi: 10.1007/s11136-019-02240-7

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: chronic hepatitis B virus infection, stigma, classical test theory, item response theory, validation

Citation: Zhong S, Zhou Y, Zhumajiang W, Feng L, Gu J, Lin X and Hao Y (2023) A psychometric evaluation of Chinese chronic hepatitis B virus infection-related stigma scale using classical test theory and item response theory. Front. Psychol. 14:1035071. doi: 10.3389/fpsyg.2023.1035071

Received: 02 September 2022; Accepted: 16 January 2023;
Published: 01 February 2023.

Edited by:

Sören Kliem, Ernst-Abbe-Hochschule Jena, Germany

Reviewed by:

Naser Kamyari, Abadan University of Medical Sciences, Iran
Güray Can, Abant Izzet Baysal University, Türkiye
Robert G. Gish, Loma Linda University, United States
Qin Ning, Huazhong University of Science and Technology, China

Copyright © 2023 Zhong, Zhou, Zhumajiang, Feng, Gu, Lin and Hao. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Xiao Lin, ✉ linx87@mail.sysu.edu.cn; Yuantao Hao, ✉ haoyt@bjmu.edu.cn

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.