Skip to main content

ORIGINAL RESEARCH article

Front. Public Health, 22 December 2022
Sec. Family Medicine and Primary Care
This article is part of the Research Topic New Trends in Type 2 Diabetes Diagnosis and Management in Primary Care View all 14 articles

Using standardized patients to assess the quality of type 2 diabetes care among primary care providers and the health system: Evidence from rural areas of western China

\nYuju WuYuju Wu1Ruixue YeRuixue Ye1Chang SunChang Sun1Sha MengSha Meng2Zhengjie CaiZhengjie Cai1Linhua LiLinhua Li1Sean SylviaSean Sylvia3Huan Zhou
&#x;Huan Zhou1*Lucy PappasLucy Pappas4Scott RozelleScott Rozelle4
  • 1West China School of Public Health and West China Fourth Hospital, Sichuan University, Chengdu, Sichuan, China
  • 2Department of Operation Management, West China Hospital, Sichuan University, Chengdu, Sichuan, China
  • 3Department of Health Policy and Management, Gillings School of Global Public Health, University of North Carolina at Chapel Hill, Chapel Hill, NC, United States
  • 4Freeman Spogli Institute for International Studies, Stanford University, Stanford, CA, United States

Background: Improving type 2 diabetes (T2D) care is key to managing and reducing disease burden due to the growing prevalence of diabetes worldwide, but research on this topic, specifically from rural areas, is limited. This study uses standardized patients (SPs) to assess T2D care quality among primary care providers to access the healthcare system in rural China.

Methods: Using multi-stage random sampling, health facilities, providers, and households were selected. SPs were used to evaluate providers' T2D care quality and a questionnaire survey was used to collect patient sorting behaviors from households. Logistic regression was used to explore factors correlated with T2D care quality. Provider referral and treatment rates were combined with patient sorting behaviors to assess the overall quality of T2D management by rural China's healthcare system.

Results: A total of 126 providers, 106 facilities, and 750 households were enrolled into this study. During SP interactions, 20% of rural providers followed the national guidelines for T2D consultation, 32.5% gave correct treatment, and 54.7% provided lifestyle suggestions. Multi-variable regression results showed that providers who had earned practicing certificates (β = 1.56, 95% CI: 0.44, 2.69) and saw more patients (β = 0.77, 95%: 0.25, 1.28) were more likely to use a higher number of recommended questions and perform better examinations, whereas providers who participated in online training were less likely to practice these behaviors (β = −1.03, 95%: −1.95, −0.11). The number of recommended questions and examination (NRQE) was the only significant correlated factor with correct treatment (marginal effect = 0.05, 95%: 0.01, 0.08). Throughout the rural healthcare system, 23.7% of T2D patients were treated correctly.

Conclusion: The quality of T2D care in rural western China, especially throughout the consultation and treatment process during a patient's first visit, is poor. Online training may not improve T2D care quality and low patient volume was likely to indicate poor care quality. Further research is needed to explore interventions for improving T2D care quality in rural China's healthcare system.

Introduction

Diabetes is a leading cause of mortality and reduced life expectancy around the world. From 1990 to 2017, the global prevalence of diabetes increased more than 129% from 211 to 476 million, and the number of global deaths due to diabetes increased more than 125% from 0.61 million deaths to 1.37 million (1). Type 2 diabetes (T2D), the most common type of diabetes, accounts for ~90% of all diabetes cases internationally (2). In response to the major disease burden diabetes presents, organizations worldwide have set forth measures for decreasing diabetes' prevalence. For example, the United Nations Sustainable Development Goals (SDG) included the aim to reduce premature mortality from non-communicable diseases (NCDs), including diabetes, by one-third by 2030 (3). Similarly, the World Health Organization's (WHO) Global Action Plan for the Prevention and Control of NCDs has proposed a series of measures for the surveillance, prevention, and control of diabetes and its complications, as well as specific measures for diagnosing and treating T2D (4).

In 2019, China reported having the largest number of adults with diabetes in the world (116.4 million) and predicted that this number would increase to 147.2 million by 2045 (5). In order to decrease the prevalence and reduce the complications associated with diabetes, China implemented a comprehensive healthcare policy and has established 265 national demonstration areas where short-term pilot programs aim to promote better healthcare practices as well as better detection methods for controlling the prevalence of chronic diseases (6). Additionally, China has further developed healthcare system integration throughout the country to promote the flow of healthcare resources to primary care facilities for long term health programming (7).

Healthcare systems play a foundational role in dealing with the increasingly high prevalence of non-communicable diseases (8), including diabetes. In China, the rural healthcare system is comprised of three tiers of healthcare providers: village clinics (VC), township health centers (THC), and county hospitals (CH). Under China's guidelines for diabetes management within the rural healthcare system, primary care providers from VCs and THCs take primary responsibility in diagnosing patients during their initial visits and treating the diagnosed patients. First-time patients are recommended to visit a VC or THC, and to then visit a CH if their health issues remain unresolved (9). As a result of these healthcare system developments, diabetes prevention and treatment services in China have been gradually transferred from city hospitals to local primary care providers, which has improved diabetes patients' access to diagnosis and treatment (10).

Despite patients' improved accessibility to diabetes healthcare services, the complex phenotypes and multiple needs of individuals with diabetes requires high quality diabetes care and a healthcare system designed to reduce the burden of this NCD (11). However, previous studies on the quality of diabetes care (that analyzed the counseling and examination process quality, the treatment quality, and subsequent health outcomes) have identified suboptimal performance during initial case diagnosis, evidenced by, for example, a lack of essential examinations (12, 13). Furthermore, for T2D in particular, there is little known about the differences in healthcare system quality in regards to a patient's choice of healthcare facility for their first visit (i.e., whether a patient chooses to first visit a VC or a THC). This is particularly relevant given the gaps in T2D care quality between the different tiers of providers. Combined with the increasing burden on primary care providers for managing T2D, understanding the quality of T2D care and how it may vary by a patient's visiting behavior among China's three-tier rural healthcare system is vital to identifying areas for improvement.

One of the fundamental problems with assessing the quality of T2D care is the methodological limitations of previous studies; for example, studies that had used electronic medical records or questionnaire survey data on patient care outcomes often found the method to lead to incomplete and inaccurate results (14). Instead, the standardized patients (SPs) method has become considered as the “gold standard” for evaluating the quality of clinical practice (15). SPs are individuals recruited from local communities and trained to present consistent disease cases to healthcare providers. There are three distinct advantages to assessing clinical practice with SPs compared to other commonly used methods (15, 16). First, because providers are unaware they are being assessed during SP interactions, clinician behavior remains unbiased, compared to the direct observation method which has been found to introduce Hawthorne effects to a provider's observed behaviors (16, 17). SPs can also reduce or eliminate recall bias compared to the method of surveying actual patients after a visit. Second, SPs can measure “real” clinical practice as opposed to only measuring clinical knowledge (which is commonly examined using clinical vignettes or a questionnaire survey, leading to providers being aware of being assessed). Third, because the SP approach examines complete interactions between providers and mock patients, the referral process between the different tiers of healthcare facilities may be observed in practice; these observations may then be used to evaluate the quality of the overall healthcare system. The SP approach has been used in China and internationally to investigate how diseases such as diarrhea, unstable angina, and tuberculosis are treated (1820). However, to our knowledge, few studies have used SPs to evaluate the quality of T2D care, especially in rural China where the prevalence of diabetes increases by 2.5% points annually (21).

In order to fill this identified gap in the literature, the present study has three objectives. First, we use SPs to assess the quality of T2D care among primary healthcare providers in rural China. Second, we explore the correlates of the quality of T2D care and seek to provide policy or healthcare reform implications for improving the quality of T2D care in rural China. Third, we combine patients' facility sorting behaviors and provider-level quality analyses of T2D to determine the ability of China's rural healthcare system for effectively managing diabetes.

Materials and methods

Setting and sampling

The facilities and healthcare providers sampled for this study were selected from rural areas in one prefecture of Sichuan Province in western China. The sample was chosen using a four-stage random sampling procedure. First, five counties were randomly selected from the prefecture. Second, 50 townships were randomly selected from these five sample counties. Third, the sample was then evenly divided with 10 townships chosen from each county. Fourth, one village was randomly selected from each sample township. In total, 50 villages from the sample townships were enrolled into the study. All providers of general and internal medicine who were on duty on our survey day from the sample facilities within the sample villages were surveyed. From this sampling process, a total of 126 providers were included in the study (see Figure 1).

FIGURE 1
www.frontiersin.org

Figure 1. STROBE flowchart. Standardized patients were randomly assigned to facilities and within each facility, standardized patients visited the provider following normal procedures for walk-in patients. Fifteen households were randomly selected from the resident roster of each sample village, totaling 750 households.

Data collection

Provider survey

Structured questionnaires were administered to collect provider information. Trained investigators interviewed providers to obtain information regarding their age, gender, medical education, qualifications, medical experience, income, and undergraduate major.

Household survey

Residential-level demographics—including household socio-demographic characteristics, whether a member of the household had been diagnosed with diabetes, and the facility-sorting behavior of the household members (i.e., whether they choose to first visit a VC or a THC)—were collected by trained investigators through face-to-face interviews. The choice of which facility a patient visits first is important in evaluating the quality of China's rural healthcare system in diagnosing and treating T2D, as this choice determines how the patient will be diagnosed and initially treated, which subsequent facilities they will visit through referrals, and the efficacy of the treatment process as a whole. Therefore, all households were asked which facility a member would choose to visit first when they experienced symptoms related to diabetes, such as eating more, drinking more, and unexplained weight loss.

Standardized patients

Provider quality was assessed through their interactions with incognito SPs. T2D is a disease that qualifies for being assessed by the SP methodology as (1) there are no obvious physiological symptoms of T2D and (2) there is low risk that SPs will be exposed to invasive procedures or tests during an initial examination. Thus, using SP interactions, we assessed providers' process quality and the accuracy of their diagnosis and treatment. The standards of quality assessment we used were taken from Chinese clinical guidelines (22), which are presented in Appendix Text 1.

SPs were recruited from local communities and selected through interviews with our research team to confirm that their demographic characteristics matched the standardized T2D case profile. All selected SPs were trained in a classroom setting for 1 week by a team of researchers and consulting medical professionals in order to present consistent T2D cases. Classroom training focused on preparing SPs to represent the T2D case to providers in a consistent and unsuspicious manner. Medical professionals discussed the symptoms of T2D to be portrayed by SPs and the typical behavior and presentation of real patients afflicted with the diseases. Following classroom instruction, the SPs went through extensive field rehearsals in rural areas with clinicians who volunteered to assist with the study.

All SPs followed a standardized case script which was developed by our research team in conjunction with diabetes specialists. To adapt the case script to the local context, local diabetes prevention and management authorities were also included in the consultations. The details of the case script can be found in Appendix Text 2. To prevent invasive testing on an SP, such as a Fasting Plasma Glucose test, every SP carried a prepared blood glucose test report form with them for their visit. If a provider asked them to take an invasive examination, the SP would present the test report to them.

SP visits

SPs visited the target providers in late August 2019. One SP visited one provider in each sample facility. Each SP was randomly assigned to a provider to reduce the potential for any differences in individual SP presentations and to reduce bias comparisons across providers. Upon entering each clinic, the SP was seen by any provider who was available at the time. In other words, SPs made no attempt to be seen by specific providers.

We used three methods to collect data on SP-provider interactions. First, SPs wore a concealed recording device. This allowed the research team to accurately evaluate interactions without relying on the SP's ability to recall details. Second, SPs were administered a case-specific “debriefing survey” upon exiting clinics. This survey covered the SP's interaction with the provider, the SP's own impressions of the provider, and any additional observations made by the SP that they thought were relevant but not captured on the audio recording. Finally, to collect information on any drugs dispensed, SPs were directed to purchase all medications prescribed to them by the provider.

Statistical analysis

We calculated the means or proportions across all interactions for each of our primary outcomes: (1) the SP-provider consultation process as determined by the number of recommended questions and examinations (henceforth referred to as NRQE) asked and conducted by the provider; (2) the correct diagnosis as determined by the accuracy and completeness of the provider's diagnosis; and (3) the correct treatment as determined by the overall accuracy of the provider's prescribed treatment. All outcome variables were evaluated according to China's national clinical guidelines (22). To assess the correlates of these variables, we used ordinary least squares (OLS) regression for the NRQE variable (continuous variable) and logistic regression for the correct diagnosis and correct treatment variables (binary variables). For each outcome, we assessed correlations with a fixed set of facility-level and provider-level characteristics hypothesized to be related to T2D care quality.

We simulated system-level results by combining patient sorting behavior data with provider competence data from VCs and THCs to build a T2D management chain that represented the entire rural healthcare system. We used the patient sorting behavior data collected by the household survey to determine which facility a patient would visit first; we then used T2D treatment and referral data at the facility level to determine whether a patient would be treated correctly at that facility or to where the patient would be referred for further treatment. For instance, if a patient initially visited a VC, we used the correct treatment data and referral data at the VC tier (and, subsequently, the THC level) to calculate the probability of diabetes being correctly managed within the rural healthcare system. All analyses were conducted using STATA 14.0 (StataCorp, College Station, TX, USA).

Results

Provider characteristics

Table 1 shows the characteristics of all sampled providers. Out of the total 126 providers who were enrolled into our study, 36.5% (46/126) were from VCs, 24.6% (31/126) were from CHs, and the remainder were from THCs (38.8% or 49/126). VC providers had a lower education level than providers from THCs and CHs (P < 0.001). Moreover, VC providers had fewer practicing certificates; only 23.9% of VC providers held a practicing certificate, which was a significantly smaller proportion than providers working in THCs and CHs (91.8 and 96.8%, P < 0.001), respectively. During their undergraduate studies, 56.5% of VC majored in western medicine, compared to 79.6 and 77.4% of providers from THCs and CHs, respectively (P < 0.05). There were also significant income gaps between providers in the three tiers. The income of THC providers was twice the income of VC providers, and the income of CH providers was three times the income of VC providers (P < 0.001). Finally, 80.6% of CH providers had participated in online training, which was a significantly higher proportion than that of THC and VC providers (P = 0.005).

TABLE 1
www.frontiersin.org

Table 1. Providers characteristics across three tiers of China's rural healthcare system.

Quality of SP-provider interaction process, diagnosis, and treatment

Results on the quality of T2D care among providers in the rural healthcare system are reported in Table 2. On average, providers used six of the 31 recommended questions and examinations (20%); no significant differences were found among the three tiers of providers (all P-values more than 0.05). The providers asked an average of 3.3 recommended questions out of the 19 questions required by the national clinical standards for diagnosing T2D, and performed 2.8 of the 13 required examinations. The correct diagnosis rate was more than 90% among providers from THCs and CHs, whereas only 69.6% of VC providers made correct diagnoses (P < 0.01). Overall, the correct treatment rate was generally below 40% and did not differ significantly among providers from the three tiers of facilities; however, when it came to prescribing the appropriate drugs, providers from VCs prescribed fewer correct drugs (41.4%) and more harmful drugs (23.9%) to patients than providers from both THCs (78.6 and 4.1%) and CHs (83.3 and 0%; all P < 0.05). Regarding non-pharmaceutical treatment plans, about 50% of all providers gave lifestyle suggestions to their patients, and no significant differences were found between providers in all three tiers (all P-values > 0.05). Regarding rates of referral, 37% of patients were referred from VCs to higher-tier facilities, whereas only 3.2% of patients were referred from CHs to other facilities (P < 0.05).

TABLE 2
www.frontiersin.org

Table 2. Quality of type 2 diabetes care among providers from China's rural healthcare system.

Turning to the frequency of diagnostic questions asked and examinations performed during SP-provider interactions (Figures 2, 3), more than half of the providers asked the recommended question of whether patients experienced “dry mouth and thirst.” Additional recommended questions were about the patient's history of diabetes, if they had previously received blood sugar testing, their age, and any weight changes they experienced in recent months; however, <50% of all providers asked these specific questions to the SPs. Moreover, <20% of all providers asked whether the patient had a family history of diabetes. Nearly all providers conducted capillary blood-postprandial blood glucose tests. Other essential exams were conducted infrequently. About 40% of all providers conducted FPG (Fasting Plasma Glucose) and HbA1c (hemoglobin A1c) tests. Few clinicians (around 5%) conducted the OGTT (Oral Glucose Tolerance Test), a golden standard for T2D diagnosis. Furthermore, although also considered essential for diagnosing T2D, no THC providers conducted the BMI exam, and very few providers (<5%) from VCs and CHs measured the weight and height of the SPs.

FIGURE 2
www.frontiersin.org

Figure 2. Recommended questions used during standardized patient-provider interactions. Source: Author's survey. CH, County Hospital; THC, Township Health Center; VC, Village Clinic; *Essential questions.

FIGURE 3
www.frontiersin.org

Figure 3. Recommended examinations used during standardized patient-provider interactions. Source: Author's survey. CH, County Hospital; THC, Township Health Center; VC, Village Clinic; *Essential examinations.

Correlates of T2D care quality

Figure 4 presents the results of the multivariate analysis assessing the correlates for provider process quality. Older providers used 1.14 fewer NRQE than younger providers, while providers with practicing certificates used 1.56 more NRQE than those without practicing certificates. Providers who had more patient visits in the past 2 weeks conducted 0.77 more NRQE. However, providers who had higher incomes addressed 0.35 fewer NRQE than those with lower incomes. Furthermore, providers who participated in online training in the past year conducted 1.03 fewer NRQE than those who did not participate in online training.

FIGURE 4
www.frontiersin.org

Figure 4. Associated factors for correct treatment of type 2 diabetes among rural clinicians. Source: Author's survey. NRQE, number of recommended questions and examinations; CH, County Hospital; THC, Township Health Center.

Appendix Figure 1 shows the correlates for correct diagnosis among providers. More NRQE addressed during SP-provider interactions was correlated with a higher probability of correct diagnosis by the provider. Similar to the correlates of process quality mentioned above, holding a provider's certificate was positively correlated with a provider's correct diagnosis rate, whereas a provider's income was negatively correlated with their correct diagnosis rate. Regarding the rate of correct treatment (Appendix Figure 2), NRQE was the only significant correlate: Providers who conducted 1 additional NRQE were 5% points more likely to offer correct treatment.

Quality of the healthcare system in managing T2D

To examine the system-level quality of T2D care, we combined provider T2D care quality, referral rates, and patient sorting behavior to generate a model that displayed the treatment of diabetes at each facility and any subsequent patient referral to higher-level facilities under the rural healthcare system (Figure 5). From our collected data on patient sorting behavior, we found that 39% of T2D patients first visited a VC, while 32% first visited a THC, and 29% went directly to a CH. Using the data from Table 2, we attributed correct treatment rates of 28.3% for VCs, 36.7% for THCs, and 32.3% for CHs. Among the patients whose symptoms were not treated at a VC, 15.2% were given a referral to a THC, and 21.7% were referred to a CH directly. Among the 15.2% of patients who transferred to a THC from a VC, 2.2% were subsequently referred to a CH. For patients who visited a THC initially, 14.3% were referred to a CH. Using this model, we were able to calculate the probability that an average rural diabetes patient will receive the correct treatment under the rural healthcare system; this probability came out at 23.7%. Detailed information on the calculation can be found in Appendix Table 2.

FIGURE 5
www.frontiersin.org

Figure 5. Quality of the rural healthcare system assessed through its ability to correctly treat type 2 diabetes. Source: Author's survey. VC, Village Clinic; THC, Township Health Center; CH, County Hospital.

Discussion

To the best of our knowledge, this is the first study to evaluate the quality of T2D care using the SP method in rural China. Overall, findings from this study indicate poor healthcare quality among rural healthcare providers in China. Regarding the quality of the diagnostic process, on average, less than a third of the recommended diagnostic examinations and questions for T2D were used during the interactions between SPs and providers. Most rural providers correctly diagnosed T2D; however, there existed large gaps in the correct diagnosis rate between providers in VCs (who correctly diagnosed 69.6% of SP cases) and providers in THCs and CHs (who gave correct diagnoses in almost 100% of cases). Additionally, despite these differences in correct diagnosis rates, the differences between the providers' treatment plans were small. Moreover, a provider's age, their income, whether they had a practicing certificate, their patient volume, and their level of training were all correlated with their diagnostic process quality, while the diagnostic process quality was the main significant correlate for the quality of diagnosis and treatment of T2D. Finally, when we assessed the overall quality of the rural healthcare system, we identified that the quality of correct treatment prescribed for a T2D patient was <30%.

Due to different quality assessment methods and quality indicators used, our results cannot be directly compared with the results of other studies. For example, one study from rural Uganda used both medical records and patient interview methods to evaluate the quality of the healthcare system, the process of case management (medical examinations in medical records), and patients' health outcomes (13). Another study from Italy employed a continuous Q-score to evaluate the quality of healthcare (23). Although we cannot compare our results directly to these studies, we note that two studies from China and Switzerland, using different indicators for quality of care, found overall low quality in the case management process of T2D, which is consistent with our results (24, 25). In addition, using SPs in this study allowed us to record all patient-provider interactions as well as to observe real diagnostic questions asked by providers. Our study found that two essential questions for diagnosing diabetes, specifically questions regarding weight changes and if there was a family history of diabetes, were not frequently asked by providers during the SP interactions, especially by providers from VCs and THCs. We believe that this finding may be helpful when designing interventions for improving the process quality of diagnosing and treating T2D for providers in China's rural healthcare system.

Surprisingly, we found that both process and treatment quality had no statistical difference among the three levels of providers, which was not consistent with previous research. The reason for this may be 2-fold. First, the national policy of “strengthening primary healthcare” with core responsibilities in preventing and managing chronic diseases might have improved the quality of primary healthcare for providers from VCs and THCs (26). Second, we used the SP method to assess the provider's actual clinical behaviors of T2D care instead of assessing their clinical knowledge, which was the measure most frequently used by previous research (13, 27). Additionally, although a knowledge gap may exist between providers from different tiers, clinical behaviors may not change when clinical knowledge increases (28). Therefore, the knowledge-to-real practice gap may be an important reason behind the non-significant difference observed among the three levels of providers, and should be taken into consideration in further quality improvement research.

Our results also showed that providers who had earned a practicing certificate were the ones most strongly correlated with providing better diagnosis process quality, which is consistent with results from previous diabetes healthcare research (29) and from healthcare quality evaluations done in rural China (19). However, some discrepancies with the existing research exist. In one notable example, contrary to findings from Hong Kong primary care settings, where higher patient volume was found to hamper the quality of diabetes care (30), our study's results indicated that higher patient volume was positively correlated with diagnosis process quality. This finding is consistent with evidence from a worldwide systematic review and meta-analysis (31). We believe that a potential reason for this discrepancy may be due to the fact that in Hong Kong, clinics with lower patient volume often have better continuity of care, and thus offer better care for patients with diabetes (30, 32). However, in our study, patient volume was evaluated on the provider level, not on the institutional level. Additionally, prior research has indicated that local providers are more likely to be visited by rural residents in China for primary care than doctors in large hospitals (33). Due to this, we believe that providers with higher volumes of diabetes patients (resulting from higher patient volume in general) are more likely to diagnose and treat diabetes effectively, as they are more likely to develop experience-based expertise for the diseases they frequently see and treat (34). This finding thus leads us to make the suggestion that quality-control measures, such as disease-specific clinical training, should be provided to and emphasized for rural clinicians experiencing less patient volume.

Regarding negatively-correlated factors, a provider's age was negatively associated with the NRQE used during interactions, which is in agreement with results from past studies (35). We also found that providers who participated in online training were less likely to conduct more NRQE. This is an interesting finding as, in the era of the COVID-19 pandemic, online training has become more widely accepted (36). Despite the growing acceptance of online training, however, our study provides support that more conscious efforts should be made for improving online training programs given to healthcare providers in rural China. We also believe that more research is needed to examine the effects of online training on T2D care quality.

In addition to analyzing the quality of T2D care on an individual healthcare provider level, we also evaluated the quality of T2D treatment among the whole rural healthcare system. Only 38.9% of T2D patients were treated correctly through the rural healthcare system, which is lower than the rate found in previous research assessing rural China's healthcare system's ability to manage tuberculosis (20). Additionally, T2D treatment quality across all tiers was generally low. Even treatment at the CH level, which has always been considered the highest tier of the rural healthcare system, was of lower quality than the treatment provided at THCs, the second-tier healthcare facility that connects VCs and CHs. In light of this finding, we believe that although the policy of “strengthening primary healthcare” reinforced by the Healthy China 2030 Plan announced in 2016 might have improved the quality of primary healthcare in rural areas to a certain extent (37), considering the random patient sorting behavior observed in this study, health policy should not only focus on the quality of primary healthcare, but also focus on an integrated, cooperative primary healthcare system, which fully supports health providers to improve performance (38). A team-based clinical practice intervention (i.e., integrating CHs, THCs, and VCs) and more T2D-specific treatment training for the three tiers of providers may be better ways for improving quality of T2D care and managing T2D in China's rural areas. Finally, our system-level evaluation presented a novel perspective of T2D treatment quality, which we believe could provide ex-ante estimates of the healthcare system for other non-communicable or communicable diseases.

Limitations

Because our research is a part of the project of “Evaluating the Quality of Primary Care for the Early Diagnosis and Treatment of Non-Communicable Diseases in China's Rural Health System,” we did not employ a specific sample size calculation. Due to this study's sample size, even though we could identify the quality of care from rural providers and the rural healthcare system in China overall, we were limited to exploring a narrow range of potential contributing factors. Additionally, because the standardized script used was developed for and used by SP volunteers to present the same background and symptoms to providers, this study was unable to measure real patient characteristics. Finally, during SP interactions, all providers' clinical behaviors were assessed in a condition with unknown patients. However, we admit that this method may be limited in an acquaintance society where providers, such as village providers, live in the same rural community as patients and are thus very familiar with their patients.

Conclusion

The quality of T2D care is poor in the rural areas of western China, especially when it came to the quality of the diagnostic process and treatment of T2D during a patient's first visit. Online training may not help to improve clinicians' quality of care for T2D. Moreover, a provider with lower patient volume may indicate that the provider will provide lower-quality care. Further research is needed to explore the causal relation. In addition, our research identified low quality of T2D care observed across the entire rural healthcare system. Finally, our research provided evidence that the rural healthcare system in western China is unable to effectively manage T2D, which may exacerbate the disease burden of T2D and lead to the development of more serious health problems when T2D is improperly treated. Further research is needed to explore potential interventions aiming at improving the T2D quality of the rural healthcare system in China and in other low-income countries.

Data availability statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics statement

The studies involving human participants were reviewed and approved by Medical Research Ethics Committee of Sichuan University, China (Registration No. K2019021). The patients/participants provided their written informed consent to participate in this study.

Author contributions

HZ, SS, and SR: conceptualization. YW and RY: formal analysis. HZ and SS: funding acquisition. YW, HZ, CS, SM, ZC, LL, and SS: methodology. YW, HZ, and SR: writing—original draft. YW, RY, CS, SM, ZC, LL, SS, LP, HZ, and SR: writing—review and editing. All authors contributed to the development of the manuscript.

Funding

The authors were supported by the China Medical Board (Grant Number: CMB-18-297) and Sichuan Province Medical Association (Grant Number: S18009).

Acknowledgments

The authors would like to acknowledge the China Medical Board and Sichuan Province Medical Association. We also thank the investigators for their hard work and dedication.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpubh.2022.1081239/full#supplementary-material

Abbreviations

T2D, type 2 diabetes; VC, village clinic; THC, township health center; CH, county hospital; SP, Standardized Patient; NCD, non-communicable disease; LMIC, low- and middle-income country; NRQE, number of recommended and essential questions and examinations; OLS, ordinary least squares; FPG, fasting plasma glucose; HbA1c, hemoglobin A1ce; OGTT, oral glucose tolerance test.

References

1. Lin X, Xu Y, Pan X, Xu J, Ding Y, Sun X, et al. Global, regional, and national burden and trend of diabetes in 195 countries and territories: An analysis from 1990 to 2025. Sci Rep. (2020) 10:14790. doi: 10.1038/s41598-020-71908-9

PubMed Abstract | CrossRef Full Text | Google Scholar

2. WHO. Diabetes. (2021). Available online at: https://www.who.int/news-room/fact-sheets/detail/diabetes (accessed May 7, 2021).

3. United Nations. SDG 3: Good Health Well-being. (2021). Available online at: https://in.one.un.org/page/sustainable-development-goals/sdg-3-2/ (accessed September 9, 2021).

Google Scholar

4. WHO. Global Report on Diabetes. (2022). Available online at: https://www.who.int/publications-detail-redirect/9789241565257 (accessed September 7, 2022).

Google Scholar

5. Statista. Diabetes in China - Statistics and Facts. (2021). Available online at: https://www.statista.com/topics/6556/diabetes-in-china/ (accessed September 9, 2021).

6. Yuan B, Balabanova D, Gao J, Tang S, Guo Y. Strengthening public health services to achieve universal health coverage in China. Br Med J. (2019) 365:12358. doi: 10.1136/bmj.l2358

PubMed Abstract | CrossRef Full Text | Google Scholar

7. State Council SC. Promoting Hierarchical Medical System. (2015). Available online at: http://www.gov.cn/zhengce/content/2015-09/11/content_10158.htm (accessed September 9, 2015).

Google Scholar

8. Zhang Y, Tang W, Zhang Y, Liu L, Zhang L. Effects of integrated chronic care models on hypertension outcomes and spending: A multi-town clustered randomized trial in China. BMC Public Health. (2017) 17:244. doi: 10.1186/s12889-017-4141-y

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Chinese Elderly Type 2 Diabetes Prevention and Treatment of Clinical Guidelines Writing Group Geriatric Geriatric Endocrinology and Metabolism Branch of Chinese Geriatric Society Geriatric Geriatric Endocrinology and Metabolism Branch of Chinese Geriatric Health Care Society Geriatric Geriatric Professional Committee of Beijing Medical Award Foundation National Clinical Medical Research Center for Geriatric Diseases (PLA General Hospital). Clinical guidelines for prevention and treatment of type 2 diabetes mellitus in the elderly in China (2022 edition). Zhonghua Nei Ke Za Zhi. (2022) 61:12–50. doi: 10.3760/cma.j.cn112138-20211027-00751

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Luo Z, Fabre G, Rodwin VG. Meeting the challenge of diabetes in China. Int J Health Policy Manag. (2020) 9:47–52. doi: 10.15171/ijhpm.2019.80

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Chan JCN, Lim LL, Wareham NJ, Shaw JE, Orchard TJ, Zhang P, et al. The Lancet Commission on diabetes: Using data to transform diabetes care and patient lives. Lancet. (2020) 396:2019–82. doi: 10.1016/S0140-6736(20)32374-6

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Adeleye JO, Kuti MA. Process and outcome measures of quality of care at the diabetes outpatient clinic, University College Hospital, Ibadan. Niger J Clin Pract. (2017) 20:221–5. doi: 10.4103/1119-3077.187310

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Birabwa C, Bwambale MF, Waiswa P, Mayega RW. Quality and barriers of outpatient diabetes care in rural health facilities in Uganda - A mixed methods study. BMC Health Serv Res. (2019) 19:706. doi: 10.1186/s12913-019-4535-x

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Majeed A, Car J, Sheikh A. Accuracy and completeness of electronic patient records in primary care. Fam Pract. (2008) 25:213–4. doi: 10.1093/fampra/cmn047

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Kwan A, Daniels B, Bergkvist S, Das V, Pai M, Das J. Use of standardised patients for healthcare quality research in low- and middle-income countries. BMJ Glob Health. (2019) 4:e001669. doi: 10.1136/bmjgh-2019-001669

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Peabody JW, Luck J, Glassman P, Dresselhaus TR, Lee M. Comparison of vignettes, standardized patients, and chart abstraction: A prospective validation study of 3 methods for measuring quality. J Am Med Assoc. (2000) 283:1715. doi: 10.1001/jama.283.13.1715

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Leonard KL, Masatu MC. Using the Hawthorne effect to examine the gap between a doctor's best possible practice and actual performance. SSRN Electr J. (2008) 2008:1134158. doi: 10.2139/ssrn.1134158

CrossRef Full Text | Google Scholar

18. Das J, Holla A, Das V, Mohanan M, Tabak D, Chan B. In urban and rural India, a standardized patient study showed low levels of provider training and huge quality gaps. Health Aff. (2012) 31:2774–84. doi: 10.1377/hlthaff.2011.1356

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Sylvia S, Shi Y, Xue H, Tian X, Wang H, Liu Q, et al. Survey using incognito standardized patients shows poor quality care in China's rural clinics. Health Policy Plan. (2015) 30:322–33. doi: 10.1093/heapol/czu014

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Sylvia S, Xue H, Zhou C, Shi Y, Yi H, Zhou H, et al. Tuberculosis detection and the challenges of integrated care in rural China: A cross-sectional standardized patient study. PLoS Med. (2017) 14:e1002405. doi: 10.1596/29325

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Li Y, Teng D, Shi X, Qin G, Qin Y, Quan H, et al. Prevalence of diabetes recorded in mainland China using 2018 diagnostic criteria from the American Diabetes Association: National cross sectional study. Br Med J. (2020) 369:m997. doi: 10.1136/bmj.m997

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Jia W, Weng J, Zhu D, Ji L, Lu J, Zhou Z, et al. Standards of medical care for type 2 diabetes in China 2019. Diabetes Metab Res Rev. (2019) 35:e3158. doi: 10.1002/dmrr.3158

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Ceriello A, Rossi MC, De Cosmo S, Lucisano G, Pontremoli R, Fioretto P, et al. Overall quality of care predicts the variability of key risk factors for complications in type 2 diabetes: An observational, longitudinal retrospective study. Diabetes Care. (2019) 42:514–9. doi: 10.2337/dc18-1471

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Wong CKH, Fung CSC, Yu EYT, Wan EYF, Chan AKC, Lam CLK. Temporal trends in quality of primary care for patients with type 2 diabetes mellitus: A population-based retrospective cohort study after implementation of a quality improvement initiative. Diabetes Metab Res Rev. (2018) 34:2953. doi: 10.1002/dmrr.2952

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Zuercher E, Diatta ID, Burnand B, Peytremann-Bridevaux I. Health literacy and quality of care of patients with diabetes: A cross-sectional analysis. Prim Care Diabetes. (2017) 11:233–40. doi: 10.1016/j.pcd.2017.02.003

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Li X, Krumholz HM, Yip W, Cheng KK, Maeseneer JD, Meng Q, et al. Quality of primary health care in China: Challenges and recommendations. Lancet. (2020) 395:1802–12. doi: 10.1016/S0140-6736(20)30122-7

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Abolfotouh MA, Soliman LA, Abolfotouh SM, Raafat M. Knowledge and practice of PHC physicians toward the detection and management of hypertension and other CVD risk factors in Egypt. Int J Hypertens. (2011) 2011:983869. doi: 10.4061/2011/983869

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Meng S, Wang Q, Wu Y, Xue H, Li L, Ye R, et al. The know-do gap in quality of health for chronic non-communicable diseases in rural China. Front Public Health. (2022) 10:953881. doi: 10.3389/fpubh.2022.953881

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Meier R, Valeri F, Senn O, Rosemann T, Chmiel C. Quality performance and associated factors in Swiss diabetes care - A cross-sectional study. PLoS ONE. (2020) 15:e0232686. doi: 10.1371/journal.pone.0232686

PubMed Abstract | CrossRef Full Text | Google Scholar

30. Wong CKH, Fung CSC, Kung K, Wan EYF, Yu EYT, Chan AKC, et al. Quality of care and volume for patients with diabetes mellitus in the primary care setting: A population based retrospective cohort study. Diabetes Res Clin Pract. (2016) 120:171–81. doi: 10.1016/j.diabres.2016.07.029

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Riordan F, McHugh SM, O'Donovan C, Mtshede MN, Kearney PM. The role of physician and practice characteristics in the quality of diabetes management in primary care: Systematic review and meta-analysis. J Gen Intern Med. (2020) 35:1836–48. doi: 10.1007/s11606-020-05676-7

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Nutting PA, Dickinson WP, Dickinson LM, Nelson CC, King DK, Crabtree BF, et al. Use of chronic care model elements is associated with higher-quality care for diabetes. Ann Fam Med. (2007) 5:14–20. doi: 10.1370/afm.610

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Liu Y, Zhong L, Yuan S, van de Klundert J. Why patients prefer high-level healthcare facilities: A qualitative study using focus groups in rural and urban China. Br Med J Glob Health. (2018) 3:e000854. doi: 10.1136/bmjgh-2018-000854

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Cheung A, Stukel TA, Alter DA, Glazier RH, Ling V, Wang X, et al. Primary care physician volume and quality of diabetes care. Ann Intern Med. (2017) 166:240–7. doi: 10.7326/M16-1056

PubMed Abstract | CrossRef Full Text | Google Scholar

35. LeBlanc ES, Rosales AG, Kachroo S, Mukherjee J, Funk KL, Nichols GA. Do patient or provider characteristics impact management of diabetes? Am J Manag Care. (2015) 21:597–606. Available online at: https://www.ajmc.com/view/do-patient-or-provider-characteristics-impact-management-of-diabetes

PubMed Abstract | Google Scholar

36. Li W, Gillies R, He M, Wu C, Liu S, Gong Z, et al. Barriers and facilitators to online medical and nursing education during the COVID-19 pandemic: Perspectives from international students from low- and middle-income countries and their teaching staff. Hum Resour Health. (2021) 19:64. doi: 10.1186/s12960-021-00609-9

PubMed Abstract | CrossRef Full Text | Google Scholar

37. CPC Central Committee, State, Council. The Outline of the Healthy China 2030 Strategy. (2021). Available online at: http://www.gov.cn/zhengce/2016-10/25/content_5124174.htm (accessed September 9, 2021).

Google Scholar

38. Li X, Lu J, Hu S, Cheng K, De Maeseneer J, Meng Q, et al. The primary health-care system in China. Lancet. (2017) 390:2584–94. doi: 10.1016/S0140-6736(17)33109-4

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: quality of type 2 diabetes care, standardized patients, healthcare system, rural China, primary care

Citation: Wu Y, Ye R, Sun C, Meng S, Cai Z, Li L, Sylvia S, Zhou H, Pappas L and Rozelle S (2022) Using standardized patients to assess the quality of type 2 diabetes care among primary care providers and the health system: Evidence from rural areas of western China. Front. Public Health 10:1081239. doi: 10.3389/fpubh.2022.1081239

Received: 27 October 2022; Accepted: 08 December 2022;
Published: 22 December 2022.

Edited by:

Aleksandra Klisic, Primary Health Care Center Podgorica, Montenegro

Reviewed by:

Zhuo Chen, University of Georgia, United States
Chaowei Fu, Fudan University, China
Shasha Yuan, Chinese Academy of Medical Sciences and Peking Union Medical College, China

Copyright © 2022 Wu, Ye, Sun, Meng, Cai, Li, Sylvia, Zhou, Pappas and Rozelle. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Huan Zhou, yes zhouhuan@scu.edu.cn

ORCID: Huan Zhou orcid.org/0000-0002-6709-5134

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.