- 1College of Science, Zhejiang University of Science and Technology, Hangzhou, China
- 2Operation and Management Office, Fujian Provincial Hospital, Fuzhou, China
- 3The Third Department of Critical Care Medicine, Shengli Clinical Medical College of Fujian Medical University, Fujian Provincial Hospital, Fujian Provincial Center for Critical Care Medicine, Fujian Provincial Key Laboratory of Critical Care Medicine, Fuzhou, China
Objective: The present study aimed to evaluate the operational efficiency of public hospitals in Fujian Province and the factors responsible for the inefficiency of these hospitals and provide relevant suggestions for health policymakers in allocating service resources.
Method: In the first stage of the research, the variables affecting the efficiency of hospitals were extracted by qualitative and quantitative methods, including literature optimization, gray related analysis and gray clustering evaluation. In the second stage, the data envelopment analysis (DEA) method was used to evaluate the operational efficiency of 49 hospitals of different levels and types selected by sampling in 2020. Finally, a Tobit regression model with introduced institutional factors and background factors was established to study the main influencing factors of hospital inefficiency.
Results: In the first stage, 10 input variables and 10 output variables necessary from the mangers' point of view were identified to test efficiency. In the second stage, the average comprehensive TE, PTE, and SE of 49 sample hospitals was 0.802, 0.888, and 0.902, respectively. 22.45% of these hospitals met the effective criteria, i.e., the overall effective rate was 22.45%. The low SE value of the hospital was the main reason hindering the improvement of the comprehensive efficiency value. The overall effective rate of secondary public hospitals (30.77%) was higher than that of tertiary public hospitals (19.44%), and the overall effective rate of public specialized hospitals (30%) was higher than that of general public hospitals (18.92%). Based on the third stage results, the bed occupancy rate (BOR) and the proportion of beds (POB) were major factors affecting the operation efficiency of grade III hospitals (p < 0.01). However, the operating efficiency of grade II hospitals was significantly affected by POB and regional per capita GDP(GDPPC) (p < 0.05). Moreover, the impact of BOR and GDPPC was positive, and POB was negatively correlated with hospital operation efficiency.
Conclusions: The study results indicated that the overall operation efficiency of public hospitals in Fujian Province is low. This study revealed that intervention should be strengthened from a policy and management perspective to improve the operation efficiency of public hospitals.
1. Introduction
Since the launch of medical reform, the Chinese government has increased its investment in medical and health services and implemented a series of effective reform measures. However, the issue of “high expense and difficulties in medical care” is persistent. In 2013, Hu et al. (1) reported inefficiencies in the allocation of health resources and service delivery in China. The contradiction caused by the uneven distribution of medical resources has become a potential threat to social stability.
As the main body of China's medical service system, the reform of public hospitals is a major part of the reform of China's medical and health system. The development of public hospitals plays a critical role in continuously improving the fairness and accessibility of basic medical and health services, preventing and controlling major epidemics such as COVID-19, and ensuring the safety and health of the public (2). In 2021, China's policy to promote the high-quality development of public hospitals improved hospital efficiency and saved costs to reduce the burden of patients seeking medical treatment. The efficiency of public hospitals directly affects the level of medical supply.
In order to further rationally allocate and utilize medical resources and improve medical efficiency, Fujian Province issued the Public Hospital Quality Information Disclosure Plan, which requires the secondary and tertiary public hospitals to disclose medical resource allocation, medical expenses and other indicators to the public quarterly to increase the transparency of medical services and promote further improvement of medical services (3). This plan provides a reference for other cities to promote hospital reform. Public hospitals in China are divided into three levels according to the number of beds. Grade I hospitals have beds <100, secondary hospitals have beds between 100 and 500, and tertiary hospitals have beds >500 (4). The service scope of different levels of hospitals is different. Comparing the operation efficiency of public hospitals at different levels can promote the improvement and perfection of public hospitals and provide basis for promoting the high-quality development of public hospitals.
Globally, the measurement of hospital efficiency has been achieved through various technologies. Aigner and Chu (5) were among the first researchers to estimate the production frontier using ordinary least squares analysis. However, this model was criticized soon because the entire distance between the production frontier and each individual observation was attributed to low efficiency. Initially, Cobb Douglas production function was widely used because it was simple to analyze and could interpret estimated input coefficients as partial elasticity (6). However, it has been criticized for the imposition of the elasticity of input substitution equal to 1 and the forced implementation of fixed-scale economy (7). A more flexible specification is the Translog production function, which allows variable scale efficiency and variable elasticity of substitution. However, the introduction of a large number of additional parameters may lead to a large loss of multicollinearity and degrees of freedom (8). Aigner et al. (9) proposed a stochastic frontier model, which adds an additional random variable Vi to the inefficiency variable ui. This takes into account the influence of measurement errors and other stochastic elements. The disadvantage is that it depends on strong distribution assumptions to distinguish whether the residual error in the regression is caused by noise or technical efficiency. Charnes et al. (10) proposed a non-parametric method DEAwhich measures efficiency with efficiency frontier, and obtains efficiency frontier with the help of linear programming model (11). The biggest advantage of DEA method is that it does not need to specify the production function. In addition, it can consider multiple inputs and outputs at the same time (12). Currently, DEA is the most analytical method for evaluating the medical performance in healthcare-related fields (13).
Recent studies have measured and studied the medical efficiency in practical applications from different dimensions. First, research from the national dimension focuses on measuring the efficiency of different countries (14, 15). For example, Aydin, A. identified the efficiency of health care services in OECD countries (16, 17). Top, M. et al. measured the healthcare system efficiency of 36 African countries (18). Second, some scholars study the efficiency in different regions of one country (19–21). For example, Mazon assessed the technical efficiency of municipalities of the State of Santa Catarina in public health expenditures and its relationship with health management conditions (22). Ngobeni assessed and compared the technical efficiency of the nine South African provinces in the provision of healthcare (23). In addition, some scholars study the efficiency of hospitals with different characteristics (24, 25), such as teaching and non-teaching hospitals in the United States (26), general hospitals, specialized hospitals, and Multi-specialized hospitals in southwest of Iran (27). In the case of China, Gong et al. evaluated the overall and two substage efficiencies of China's healthcare system in each of its province (28). Du analyzed the association between quality and efficiency from each group of the national, east, central and west (29). Jing et al. (30) evaluated the technical efficiency of public and private hospitals in Beijing, China. After the reform of China's medical system, the public sector have been concerned about the efficiency of primary health services (31–34), while ignoring the services of hospitals above the second level.
In the data envelopment analysis method, the quality of indicators selected has a serious impact on the research results. In the current research, most of the indicators are selected using qualitative methods (35, 36), such as the Delphi method (37). Some scholars use quantitative methods to select indicators, such as principal component analysis (PCA) (38) and efficiency contribution measurement (ECM) (39). Qualitative methods are highly subjective and need to be used in combination with quantitative methods to ensure the objectivity of indicators.
In the research of medical system, most of them use traditional or improved DEA, such as Lari and Sefiddashti (40). Some scholars combine DEA model with other methods, such as Malmquist index (41). Most of these methods are used to measure the change of efficiency value. This paper focuses on exploring the mechanism of hospital operating efficiency, finding the determinants of low efficiency value, and providing a basis for improving hospital operating efficiency. Therefore, this paper combines Tobit regression model with traditional DEA model to find the influencing factors and differences of hospital efficiency at different levels.
Considering the current research, the purpose and innovation of this paper are as follows. First of all, the scientific efficiency evaluation index system is constructed by combining the gray correlation and gray clustering methods with the literature optimization method. Secondly, the two-stage DEA model is used to measure the operation efficiency of different levels of hospitals, and explore the influencing factors and differences of the efficiency of different levels of hospitals, so as to provide reference for deepening the quality development of public hospitals.
2. Materials and methods
In this study, a two-stage efficiency analysis was performed in cross-sectional data. In the first stage, DEA was used to estimate the efficiency scores of public hospitals in Fujian Province. In the second stage, Tobit regression analysis was used to identify the factors related to the efficiency of public hospitals. While the DEAP 2.1 program was used in the analysis of the efficiency scores of public hospitals, the Stata 16 program was used for the Tobit regression analysis.
2.1. Data source
This study selected public hospitals in Fujian Province as objects. Due to a large number of undisclosed samples of data, grade I hospitals were not included in this study. At the end of 2020, there were 229 public hospitals above level two in Fujian Province. Considering the requirements of data availability and sample size of the study, we selected 49 sample hospitals from 8 cities in Fujian Province by stratified sampling, of which the sample has the same structure as the population.
The indicator data were obtained from the statistical data of public hospital information disclosure indicators, the annual hospital department final account information published on the official websites of municipal governments, and health commissions in Fujian Province in 2020.
2.2. Methods
2.2.1. Literature optimization method
First, the input and output indicators used frequently in previous studies were listed. Ozcan et al. (42) developed three categories of hospital input indicators, including capital investment, labor, and operating expenses. The output indicators were divided into two categories, including medical service operation and economic benefit. The database of alternative indicators was established based on the availability of data (Table 1).
2.2.2. Gray relational analysis and gray clustering evaluation
Since the operation of the health system was affected by various uncertainties, such as technical level and policy changes, it can be regarded as a gray system. Gray correlation analysis is an active branch of gray system theory that can compensate for the shortcomings caused by systematic analysis using mathematical-statistical methods. Gray correlation analysis does not require a specific size and regulation of the sample. Moreover, no inconsistency was detected between the quantitative and analysis results. Thus, gray correlation analysis can be used to select representative indicators.
In the database of alternative indicators, the evaluation indicators Y5, Y6, and Y7 were reverse indicators. The larger the indicators, the more detrimental they are to the efficient operation of the hospital, which was opposite to other indicators. Data envelopment analysis requires that the output and input indicators be coordinated. Thus, according to the needs of the model, the reciprocal method was applied to make Y5, Y6, and Y7 forward (Equation 1).
wherein, xij is the forward indicator, yij is the reverse indicator.
Dyson et al. (43) emphasized that the number of input and output indicators should be streamlined, and the number of DMUs should be greater than twice the sum of the number of input and output indicators to ensure the effectiveness and stability of the model. Due to a large number of evaluation indicators, this study preliminarily screened the indicators by the coefficient of variation and the average value of the gray correlation degree of each evaluation index with other indicators of the same category. Supposedly, a category had m evaluation indicators and n evaluation objects, and the forward data matrix of the original data was expressed as (xij)n×m. In order to compare the indicators of different dimensions, this study used the initialization operator to handle the data of each index using the dimensionless method (Equation 2).
in which d was the initialization operator. The normalized data matrix was expressed as (zij)n×m.
One evaluation index was recorded as the reference series Z0. The gray relational degree between the remaining evaluation indicators and the reference series was calculated as follows (Equation 3); the above operation was repeated n times.
wherein ξ was the identification coefficient. The smaller the ξ, the higher the identification. ξ ∈ [0, 1], if ξ ≤ 0.5463, identification was the best at ξ = 0.5.
Finally, the coefficient of variation and the mean value of the gray correlation degree of each evaluation index with other indicators of the same category was calculated, wherein the mean value of the gray correlation degree was εi = γ(Z0, Zi)/(m − 1),i = 1, 2, ..., m. The larger the εi, the more typical the indicator, the larger the coefficient of variation (CV), and the higher the sensitivity of the indicator.
In order to meet the principle of indicator refinement, this study used the gray clustering method to cluster the evaluation indicators and avoid selecting duplicate indicators. Finally, the gray relational degree, the coefficient of variation, and the clustering results were comprehensively considered to determine the selected evaluation indicators.
2.2.3. Two-stage data envelopment analysis
Data envelopment analysis evaluated multiple inputs and outputs of the same type of decision making units (DMUs) simultaneously, and the operational efficiency of hospitals can be expressed as the weighted sum of hospital outputs to the weighted sum of hospital inputs (Equation 4).
The classical models widely used were mainly CCR and BBC. The CCR model proposed by Charnes et al. (10) assumes constant returns to scale (CRS) of production technology. However, the BCC model proposed by Banker et al. (44) speculated increasing returns to scale (IRS) of production technology to achieve technical efficiency without effects of size; it is also known as PTE.
The input and output data corresponding to n decision units were as follows:
Of which,
The CCR model was as follows:
was the constant vector of n × 1, which was the position weight that calculated the efficiency of the DMUs; s− was the slack variable; s+ was the remaining variable. The optimal solution of the model represented the efficiency value with θ* of (0, 1].
The BCC model added convexity constraints based on the CCR model, which represented assumption of variable returns to scale, and its linear programming was as follows:
The optimal solutions to the linear programming problems are described below:
(1) If θ0 = 1 and s− = 0, s+ = 0, the decision unit DMUj0 was efficient for DEA. In this case, the production activities of the decision-making unit were scale-efficient and technically efficient.
(2) If θ0 = 1, and s− + s+ > 0, the decision unit DMUj0 was slightly efficient for DEA. In this case, the production activities of the decision-making unit were not scale-efficient and technically efficient at the same time.
(3) If θ0 < 1, the decision unit j0 was not efficient for DEA. In this case, the production activities of the decision-making unit were not scale-efficient and technically efficient.
The scale return status of each DMU in the variable returns to scale (BBC) model could be judged by the constant returns to scale (CCR) model. The evaluated DMU was as follows:
(1) ∑ λ* < 1, indicating that the DMU was in the IRS;
(2) ∑ λ* = 1, indicating that the DMU was in the CRS;
(3) ∑ λ* > 1, indicating that the DMU was in the DRS.
Since the BCC model always envelopes the data more rigorously than the CCR model (input-oriented), inefficient hospitals had shorter distances to the boundary in the BCC than the CCR model (43). Herein, the CCR model was used to measure the comprehensive TE, and the BCC model was used to measure PTE and scale efficiency (SE), wherein SE reflected the inefficient parts resulting from the given scale of operation, measured by the ratio of CRS TE scores to VRS TE scores (Equation 5).
DEA model has two types: input-oriented and output-oriented. The output-oriented DEA model aimed to maximize the output using a specific amount of input, while the input-oriented DEA model focused on minimizing the input while ensuring a certain amount of output. Nonetheless, the input-oriented DEA model was suitable for this study because health system managers were more inclined to adjust the resources to achieve optimal hospital performance than to improve the delivery of care under existing medical conditions. In the present study, the DEA-CCR model was used to evaluate the comprehensive technical efficiency of public hospitals of different levels (secondary and tertiary) and different types (comprehensive and specialized) in Fujian Province, and the comprehensive efficiency was resolved using the DEA-BCC model to obtain PTE.
One of the limitations of the DEA model was that the achieved efficiency value was relative to a correlation between sequences. Therefore, the estimated efficiency score of one decision-making unit was not independent of other decision-making units. To address this limitation, Tobit regression was used in the second stage to explore the factors influencing the operation efficiency of the public hospital. The basic model was as follows:
of which, xi was the explanatory variable; yi was the predicted variable; βi was the unknown parameter; σ2 was the estimated parameter.
In the production process, the role of exogenous or environmental factors must also be considered. These factors are not controlled by the organization providing medical care, but may affect the production process of medical care (45).
3. Results
3.1. Selection of input and output indicators
In order to ensure the credibility and objectivity of data indicators, the combination of qualitative and quantitative methods was adopted for indicator selection.
The combination of the gray rational degree and CV (Table 2) method excluded the indicators X4 (medical care ratio), Y3 (bed utilization rate), Y4 (number of bed turnovers), Y5 (average hospital stay), and Y6 (average cost of outpatient (emergency) visits) according to the principle that the mean gray rational degree was >0.75 and the coefficient of variation was >0.6.
The gray clustering showed that X1, X5, and X6 were clustered into one group, X7 and X9 were clustered into one type, Y2, Y12, and Y13 could be clustered together, and Y3 and Y14 were clustered in a group. Subsequently, only one indicator of one type was selected. Dyson et al. (43) demonstrated that absolute data should not be mixed with relative data, otherwise the results may be severely distorted. Thus, X4 and Y3, as the only relative data of the input indicators and output indicators, respectively, should be eliminated. The selected input indicators and output indicators were finally determined (Table 3).
The scatterplot matrix showed a high correlation between input indicators and output indicators (Figure 1), which met the data homobosity requirements of the DEA model. Among these, row variables represent input indicators and column variables represent output indicators.
Figure 1. Scatterplot matrix of input and output indicators. NOP-PAE represents the number of physicians, nurses, beds, personnel expenditure, and public management expenditure. OV-TI represents the number of outpatient visits, the average cost of hospitalization, drug revenue, and total income.
3.2. Selection of Tobit regression influencing factors
In order to study the factors affecting the operational efficiency of public hospitals in Fujian Province, we considered institutional factors (i.e., factors that can be controlled through hospital management) and background factors (i.e., factors beyond the control of hospital management) and identified six regression variables to assess their impact on hospital performance, according to Orsini et al. (35) (Table 4).
In order to avoid possible heteroscedasticity in the data, the bed occupancy rate, the average length of stay, the proportion of beds, the GDP per capita, and the proportion of government subsidies in hospital income were logarithmized.
Based on definition, the DEA score was between 0 and 1, and some data focused on the boundary value of 1. Thus, DMU with a value of 1 should be reviewed (46). According to the study by Zere (47), the DEA efficiency score was converted into an inefficiency score by the following formula, assuming 0 as the review point:
Therefore, the efficient decision unit had a score of 0, and the inefficient decision unit had a score >0.
The Tobit regression model was represented as follows:
wherein, Inefficiency indicated the inefficiency score; BOR indicated bed occupancy rate; ALOS indicated average length of stay; SIZE indicated hospital bed size;POB indicated proportion of beds, which suggested the number of public hospital beds as a percentage of the total number of beds in all public hospitals; GDPPC indicated region GDP per capita;PGSH indicated the proportion of government subsidies in hospital revenue; ε was the random error. The flow chart of two-stage data envelopment analysis is shown in Figure 2.
3.3. Efficiency evaluation of public hospitals
Among the 49 sample hospitals, 36 were grade III and 13 were grade II hospitals; 37 were general and 12 were specialized hospitals. The DEA-BCC model was used to calculate the scores of comprehensive TE, PTE, and SE of 49 public hospitals in Fujian Province; and the mean values were 0.802, 0.887, and 0.903, respectively (Table 5). The distribution of efficiency values is shown in Table 6.
Among the 49 public hospitals, 11 had a PTE of 1 and SE of 1; hence, the overall hospital effective rate was 22.45%, i.e., 22.45% of the hospitals were both technically effective and scale-effective, indicating that they were at the production frontier of all public hospitals in Fujian Province. Among these 4 were grade II hospitals, accounting for 30.77% of the total number of 13 grade II hospitals, and 7 were grade III hospitals, accounting for 19.44% of the total number of 36 grade III hospitals. There were 4/12 (33%) specialized hospitals and 7/37 (18.92%) general hospitals. Together, the overall efficiency of secondary public hospitals in Fujian Province was higher than that of tertiary public hospitals, while the overall efficiency of specialized hospitals was higher than that of general hospitals.
In order to analyze the efficiency distribution of public hospitals in Fujian Province, the efficiency distribution of each hospital could be located in the cartesian coordinate system by taking the DEA PTE as the horizontal axis and the SE as the vertical axis (Figure 3). Since DEA comprehensive TE was the product of PTE and SE, the comprehensive TE from the bottom left to the upper right was consistently improved in the coordinate system in the figure. Also, the PTE and SE of the hospital with the coordinates (1,1) were 1, which marked it as an effective hospital. Hospitals with other points were classified as inefficient. Mehrtak et al. (48) divided the comprehensive TE value into three levels: inefficient, slightly inefficient, and efficient. Figure 3 shows that among the grade II hospitals, the comprehensive TE of two hospitals was <0.6, the comprehensive TE of five hospitals was between 0.6 and 0.8, and the comprehensive TE of six hospitals was >0.8, viz, 15.38% of grade II hospitals were inefficient, 38.46% of hospitals were slightly efficient, and 46.15% of hospitals were efficient. Among the grade III hospitals, 11.11% were inefficient, 38.89% were slightly inefficient, and 50% were efficient. Moreover, the SE of grade II hospitals was equivalent to PTE, while the PTE of grade III hospitals was significantly higher than the SE. Typically, the comprehensive TE of grade II public hospitals in Fujian Province was higher than that of grade III public hospitals.
Figure 3. DEA efficiency distribution of hospitals at different grades. The point at the bottom left of curve L1 represents the comprehensive TE of the hospital at <0.6. The point on curve L1 represents the comprehensive TE of the hospital as 0.6. The point between curves L1 and L2 represents the comprehensive TE of the hospital between 0.6 and 0.8, and the point on the upper right of curve L2 represents the comprehensive TE of the hospital >0.8. The point above line L3 represents SE greater than PTE. The point on line L3 represents the SE was equal to PTE, and the point below line L3 represents SE lower than PTE.
Heterogeneity was detected in operational efficiency due to varied environments of different levels and types of hospitals. Previous studies did not consider the differences among hospitals with different levels and types, reducing the applicability of the results. The present study analyzed grade II and grade III hospitals, general and specialized hospitals, respectively (Table 7). The average PTE and SE of general hospitals were higher than those of specialized hospitals, indicating that the scale and technical management of grade II general hospitals were better than that of grade II specialized hospitals. Among grade III hospitals, the average PTE of general hospitals was higher than that of specialized hospitals, while the average SE was lower than that of specialized hospitals, indicating that the scale management of grade III specialized hospitals was better than that of grade III general hospitals, but the technical level of grade III specialized hospitals was not as good as that of grade III general hospitals. Among general hospitals, the average PTE of grade III hospitals was higher than that of grade II hospitals, but the average SE of grade III hospitals was lower than that of grade II hospitals, indicating that the excessive scale of grade III general hospitals affected the improvement of their efficiency. Among the specialized hospitals, the average PTE and the average SE of grade III hospitals were higher than those of specialized hospitals, indicating that the scale management and technical level of grade III specialized hospitals were better than those of grade II specialized hospitals.
Further analysis used the same output model and assumed that all hospitals had the same output to measure the gap between the input index value of ineffective hospitals and the target value of indicators under the condition of efficiency; consequently, the redundancy between the actual value of input resources of the ineffective hospital and the target value was obtained (Table 8). The negative sign indicated that the decision-making unit needs to reduce the input to achieve the effective state. For grade II hospitals, if the hospital operation achieved relative effectiveness, the average number of physicians needed to be reduced by 37.02%, the number of nurses needed to be reduced by 51.24%, and the number of hospital beds needed to be reduced by 37.27%. Similarly, personnel expenditure and public administration expenditure should be reduced by 34.35 and 24.73%, respectively, for the best use of resources. Similarly, for grade III hospitals, the number of physicians needs to be reduced by 25.45%, the number of nurses needs to be reduced by 30.67%, the number of beds needs to be reduced by 29.32%, and the personnel expenditure and public administration expenditure should be reduced by 20.51 and 19.66%, respectively. The comparison found that among the ineffective hospitals, grade III public hospitals had more investment redundancy than grade II public hospitals in terms of human, material, and financial resources.
In terms of scale remuneration, 69.39% of public hospitals have decreased scale compensation, 24.49% of public hospitals have constant scale compensation, and 6.12% of public hospitals have increased scale compensation. From the perspective of hospital grade, the proportion of hospitals with decreasing scale remuneration in grade III hospitals was much higher than that of grade II hospitals, indicating that the scale of grade III hospitals was too large, which was not conducive to the improvement of their comprehensive efficiency. From the perspective of the type, the proportion of hospitals with increasing scale remuneration of specialized hospitals was higher than that of general hospitals, indicating that the appropriate increase in the operation scale of specialized hospitals was conducive to the improvement of comprehensive efficiency (Table 9).
3.4. Analysis of factors influencing the efficiency of public hospitals
In this study, the comprehensive TE and PTE of public hospitals in Fujian Province were considered as the dependent variables, and the institutional and background factors selected above were taken as independent variables. A Tobit regression model was established to analyze the influencing factors of CCR and BCC efficiencies of grade II and III public hospitals, respectively. The results showed the Tobit regression coefficients and testing results (Table 10).
The regression results of grade III hospitals showed that in the CCR model, the effects of bed occupancy rate and proportion of beds on the comprehensive TE of grade III hospitals were statistically significant at the level of 1%, and the increased bed occupancy rate had a negative effect on the inefficiency of tertiary hospitals and the effect of proportion of beds on the inefficiency of grade III hospitals was positive. Importantly, grade III public hospitals with high bed occupancy rate had high comprehensive TE, while higher proportion of beds could hinder the further improvement of TE. In addition, the effects of average length of stay, hospital bed size, GDP per capita, and proportion of government subsidies in hospital income had statistically significant effects on the comprehensive TE of grade III hospitals at the level of 5%. With an increase in the average hospital stay and the proportion of government subsidies in hospital income, the comprehensive TE of grade III hospitals decreased. With the increasing size of hospital beds and regional GDP per capita, the comprehensive TE of grade III hospitals increased. In the BCC model, only the effect of average length of stay on the PTE of grade III hospitals was significant at the level of 1%. With the increase in bed occupancy rate, hospital bed size and GDP per capita, the PTE of tertiary hospitals increased. With the increase in average hospital stay, the proportion of beds and the proportion of government subsidies in hospital income, the PTE of grade III hospitals decreased.
Compared to grade III public hospitals, the bed occupancy rate, hospital bed size, and the proportion of government subsidies in hospital income did not have a significant impact on the efficiency of grade II hospitals. The results showed that the influencing factors of different levels of comprehensive TE varied. The significance level in Figure 4. was the result of reverse processing of the critical value of the model regression coefficient test. The higher the level value, the more significant the influence of the factor on the comprehensive TE.
In the CCR model, the comprehensive TE of grade II hospitals decreased with the increase in average length of stay and the proportion of beds. With the increase in GDP per capita, the comprehensive TE of grade II hospitals increased, while in the BCC model, the PTE of grade II hospitals decreased with the increase in the average length of stay. The regression results of CCR and BCC models did not show any significant effects of hospital bed size on the efficiency value of grade II public hospitals. Because the values of hospital bed size variables of all grade II hospitals were 0, the number of beds in all grade II sample hospitals was <1,000, and the regression results of the influencing factors on hospital bed size in the four models only provided reference values for grade III hospitals.
4. Discussion
In order to assess hospital efficiency, most scholars only use a qualitative or quantitative method to select indicators. Due to the complex environment of the medical system, there are many optional indicators. In order to ensure the representativeness of indicators, we regard the medical system as a gray system. With the help of gray correlation and gray clustering analysis methods, we combine qualitative and quantitative methods to select indicators.
Recently, most of the studies on public hospitals in China only consider tertiary hospitals or primary medical institutions, and few of them put secondary hospitals or above together. Public hospitals in China are divided into different levels according to the size of beds. Different levels of hospitals have the same resource conditions, but face different development opportunities. Therefore, it is necessary to compare the differences in the amount and efficiency between hospitals of different levels, It can better promote the improvement and perfection of public hospitals. In order to analyze the operational efficiency of public hospitals in Fujian Province, we evaluated the efficiency of different types and levels of public hospitals and the institutional and environmental factors related to efficiency, such as bed occupancy rate, average hospital stay, hospital bed size, proportion of beds, regional per capita GDP, and government subsidies to hospital revenue. Most of the available literature has only focused on the comparison of public and private hospitals or evaluated the efficiency of public hospitals in different administrative units. Thus, the present study evaluated the operational efficiency of different types and levels of public hospitals rather than the operational efficiency of hospitals in different administrative regions.
The results showed that among the 49 sample public hospitals in Fujian Province in 2020, 11 were located at the production frontier. The proportion of effective hospitals is 22.45%, which was low. Although only 22.45% of hospitals had the scale efficiency of 1, the proportion of hospitals with pure technical efficiency of 1 reached 46.94%, indicating that 24.49% of hospitals hindered the improvement of comprehensive efficiency value due to low-scale efficiency value, suggesting that public hospitals in the Fujian Province had the problem of hindered operational efficiency due to oversize. This result was consistent with that reported by Kirigia and Asbu (49), showing that most public hospitals need to reduce their size to improve efficiency.
Among the 13 high-efficiency hospitals included in this study (excluding the hospitals with TE of 1), 12 (92.31%) exhibited decreasing returns to scale, suggesting that although they were the most efficient, there was a large amount of over-resourced production system in the hospitals. Similarly, 18/19 slightly inefficient hospitals (94.74%) had decreasing returns to scale. Among the 6 inefficient hospitals, 4 (66.67%) had decreasing returns to scale, showing that although the operation efficiency of the inefficient hospitals was not high, the production of some hospitals was carried out under increasing returns to scale. The grading study showed that the SE of grade II hospitals was equivalent to the PTE, and the PTE of grade III hospitals was significantly greater than the SE, indicating that the problem of the excessive scale of public hospitals in Fujian Province was mainly caused by grade III hospitals.
Tobit regression analysis found that the effect of bed occupancy rate on the comprehensive TE of grade III hospitals was statistically significant at the level of 1%, indicating that the higher the bed occupancy rate of the hospital, the higher the efficiency value of the hospital, which was consistent with the finding by Orsini et al. (35). Similarly to the results of Dimas et al. (50), the present study showed that the average stay was one of the main reasons hindering the improvement of comprehensive TE in hospitals. In addition, this study found that some policy variables, such as the proportion of government subsidies in hospital income and the GDP per capita of development level indicators, have positive effects on the technical efficiency of hospitals, while the proportion of beds restrained the improvement of technical efficiency, i.e., public hospitals in Fujian Province had the issue of excessive beds and hindered operational efficiency.
Our research has several advantages: First, this is the first paper to study the influencing factors of public hospitals at different levels in China. This research provides empirical evidence for national public hospital evaluation research and practical suggestions for public hospital reform. In addition, we combine qualitative and quantitative methods when selecting indicators. This scientific method avoids the defects of single method. Third, our research compares the efficiency of public hospitals at different levels, and points out the problems in the current management of public hospitals in China. It also explores the institutional and environmental factors that affect the low efficiency of public hospitals.
Our research has several limitations: First, we unable to explain the long-term impact of institutional and environmental factors on hospital inefficiency due to a lack of available panel data. However, our research results are still useful to assess the short-term impact of hospital inefficiency. In the future, research on data sets with different time dimensions will yield more interesting facts. Secondly, since the complete data of the study population cannot be obtained, our study is based on sample data. However, since our sample includes hospitals of all levels and types in all cities, it has the same structure as the research population and is representative of the population. Third, we only have data on hospitals in one provincial, which limits the generalization of our results. Although this limitation is very common in studies, we are lucky to include the hospitals in our study province. In addition, the medical development level of our study province ranks in the middle of the country and is representative of the whole China in terms of the average level of economic and social development. Therefore, our findings are still applicable to public hospitals in all provinces of China.
5. Conclusion
This study analyzed the operational efficiency of 49 hospitals and discussed the influencing factors of hospitals at different levels. The results showed that the overall operational efficiency of public hospitals in Fujian Province was low, and most hospitals had redundant resources. Tobit regression analysis showed that government subsidies and regional economic development affected the operational efficiency of hospitals. As Clemens et al. (51) studied EU hospitals, this study suggests that managers solve health system problems through hospital structure reform. To alleviate current problems and improve the operational efficiency of hospitals, several strategies are suggested for hospital managers and relevant government agencies.
We put forward several suggestions to improve the utilization efficiency of medical resources. First of all, the managers of inefficient hospitals should follow the best performing hospitals at the same level when possible, and find the appropriate proportion of investment according to their specific conditions. In addition, relevant departments should reasonably allocate the resources of each hospital, appropriately develop secondary public hospitals, and control the further expansion of tertiary public hospitals to maximize the use of resources. Finally, hospital managers should formulate talent introduction plans, build a reasonable talent echelon, and increase the introduction of nursing staff and high-level personnel.
The management department should vigorously develop specialized hospitals to make them play a full role in the medical system. In addition, on the basis of scientific planning for the size of hospital beds, managers can consider to carry out day hospitals as much as possible, and adequate nursing without overnight care can also increase the occupancy rate of beds.
Certainly, please remember that efficiency is not the ultimate goal of the hospitals, but merely a means through which the primary goal of achieving health output can be supported. In the process of moving toward an efficient hospital, decision-makers must continue to recognize the unique challenges faced by hospitals and bear the burden of inpatient and outpatient care for local residents. In this process, the negative impact of basic services on population health should be minimized.
Data availability statement
The datasets presented in this study can be found in online repositories. The names of the repository/repositories and accession number(s) can be found below: http://fujian.gov.cn/zwgk/zdlyxxgk/ggws/ylzlxxgs/.
Author contributions
MS made contributions to study design, developed the methodology, performed the statistical analysis, and wrote the manuscript. GZ developed the methodology and coordinated the analyses. YY, XS, and YX developed the methodology, reviewed, and edited the manuscript. All authors contributed to the article and approved the submitted version.
Funding
This protocol was financially supported by Fujian Provincial Department of Finance, Fujian Province, China [Grant number: (2021) MCZ917].
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
1. Hu R, Zou H, Shen C, Heng F. Health Care System Reform in China-Issues, Challenges and Options. Beijing: China Economics and Management Academy, Central University of Finance and Economics (2011).
2. Council GOOTS. Opinions of the General Office of the State Council on Promoting the High Quality Development of Public Hospitals. Beijing: Council GOOTS (2021).
3. News H. Fujian: The Main Quality Information of the Hospital is Completely Open. Jiangxi: News Press (2018).
4. Jiang S, Min R, Fang PQ. The impact of healthcare reform on the efficiency of public county hospitals in China. BMC Health Serv Res. (2017) 17:838. doi: 10.1186/s12913-017-2780-4
5. Aigner DJ, Chu SF. On estimating the industry production function. Am Econ Rev. (1968) 58:826–39.
6. Cordero JM, Santin D, Sicilia G. Testing the accuracy of DEA estimates under endogeneity through a Monte Carlo simulation. Eur J Oper Res. (2015) 244:511–8. doi: 10.1016/j.ejor.2015.01.015
7. Siciliani L. Estimating technical efficiency in the hospital sector with panel data a comparison of parametric and non-parametric techniques. Appl Health Econ Health Policy. (2006) 5:99–116. doi: 10.2165/00148365-200605020-00004
8. Suraratdecha C, Okunade AA. Measuring operational efficiency in a health care system: a case study from Thailand. Health Policy. (2006) 77:2–23. doi: 10.1016/j.healthpol.2005.07.005
9. Aigner D, Lovell CK, Schmidt P. Formulation and estimation of stochastic frontier production functions. J Econ. (1977) 6:21–37.
10. Charnes A, Cooper WW, Rhodes E. Measuring the efficiency of decision making units. Eur J Oper Res. (1978) 2:429–44.
12. Kohl S, Schoenfelder J, Fügener A, Brunner JO. The use of data envelopment analysis (DEA) in healthcare with a focus on hospitals. Health Care Manag Sci. (2019) 22:245–86. doi: 10.1007/s10729-018-9436-8
13. Emrouznejad A, Yang GL. A survey and analysis of the first 40 years of scholarly literature in DEA: 1978–2016. Soc Econ Plan Sci. (2018) 61:4–8. doi: 10.1016/j.seps.2017.01.008
14. Gavurova B, Kocisova K, Sopko J. Health system efficiency in OECD countries: dynamic network DEA approach. Health Econ Rev. (2021) 11:40. doi: 10.1186/s13561-021-00337-9
15. Seddighi H, Nosrati Nejad F, Basakha M. Health systems efficiency in Eastern Mediterranean Region: a data envelopment analysis. Cost Eff Resour Alloc. (2020) 18:22. doi: 10.1186/s12962-020-00217-9
16. Oh DH. A global Malmquist-Luenberger productivity index. J Prod Anal. (2010) 34:183–97. doi: 10.1007/s11123-010-0178-y
17. Aydin A. Benchmarking healthcare systems of OECD countries: a DEA—based Malmquist Productivity Index approach. Alphanum J. (2022) 10:25–40. doi: 10.17093/alphanumeric.1057559
18. Top M, Konca M, Sapaz B. Technical efficiency of healthcare systems in African countries: an application based on data envelopment analysis. Health Policy Technol. (2020) 9:62–8. doi: 10.1016/j.hlpt.2019.11.010
19. Cinaroglu S. Integrated k-means clustering with data envelopment analysis of public hospital efficiency. Health Care Manag Sci. (2020) 23:325–38. doi: 10.1007/s10729-019-09491-3
20. Amado CA, Santos SP. Challenges for performance assessment and improvement in primary health care: the case of the Portuguese health centres. Health Policy. (2009) 91:43–56. doi: 10.1016/j.healthpol.2008.11.008
21. Halkos GE, Tzeremes NG. A conditional nonparametric analysis for measuring the efficiency of regional public healthcare delivery: an application to Greek prefectures. Health Policy. (2011) 103:73–82. doi: 10.1016/j.healthpol.2010.10.021
22. Mazon LM, Freitas SFT, Colussi CF. Financing and management: the technical efficiency in public health expenditures of small-scale municipalities in the state of Santa Catarina. Cien Saude Colet. (2021) 26:1521–32. doi: 10.1590/1413-81232021264.09712019
23. Ngobeni V, Breitenbach MC, Aye GC. Technical efficiency of provincial public healthcare in South Africa. Cost Eff Resour Alloc. (2020) 18:3. doi: 10.1186/s12962-020-0199-y
24. Alonso JM, Clifton J, Diaz-Fuentes D. The impact of new public management on efficiency: an analysis of Madrid's hospitals. Health Policy. (2015) 119:333–40. doi: 10.1016/j.healthpol.2014.12.001
25. Ozcan YA, Luke RD, Haksever C. Ownership and organizational performance. A comparison of technical efficiency across hospital types. Med Care. (1992) 30:781–94.
26. O'Neill L. Multifactor efficiency in data envelopment analysis with an application to urban hospitals. Health Care Manag Sci. (1998) 1:19–27.
27. Pirani N, Zahiri M, Engali KA, Torabipour A. Hospital efficiency measurement before and after health sector evolution plan in Southwest of Iran: a DEA-panel data study. Acta Inform Med. (2018) 26:106–10. doi: 10.5455/aim.2018.26.106-110
28. Gong G, Chen Y, Gao H, Su D, Chang J. Has the efficiency of china's healthcare system improved after healthcare reform? A network data envelopment analysis and Tobit regression approach. Int J Environ Res Public Health. (2019) 16:4847. doi: 10.3390/ijerph16234847
29. Du T. Performance measurement of healthcare service and association discussion between quality and efficiency: evidence from 31 Provinces of Mainland China. Sustainability. (2018) 10:74. doi: 10.3390/su10010074
30. Jing R, Xu T, Lai X, Mahmoudi E, Fang H. Technical efficiency of public and private hospitals in Beijing, China: a comparative study. Int J Environ Res Public Health. (2019) 17:82. doi: 10.3390/ijerph17010082
31. Pelone F, Kringos DS, Romaniello A, Archibugi M, Salsiri C, Ricciardi W. Primary care efficiency measurement using data envelopment analysis: a systematic review. J Med Syst. (2015) 39:156. doi: 10.1007/s10916-014-0156-4
32. Liu W, Xia Y, Hou J. Health expenditure efficiency in rural China using the super-SBM model and the Malmquist productivity index. Int J Equity Health. (2019) 18:111. doi: 10.1186/s12939-019-1003-5
33. Cheng Z, Cai M, Tao H, He Z, Lin X, Lin H, et al. Efficiency and productivity measurement of rural township hospitals in China: a bootstrapping data envelopment analysis. BMJ Open. (2016) 6:e011911. doi: 10.1136/bmjopen-2016-011911
34. Yin G, Ning J, Peng Y, Yue J, Tao H. Configurational paths to higher efficiency in county hospital: evidence from qualitative comparative analysis. Front Public Health. (2022) 10:918571. doi: 10.3389/fpubh.2022.918571
35. Piubello Orsini L, Leardini C, Vernizzi S, Campedelli B. Inefficiency of public hospitals: a multistage data envelopment analysis in an Italian region. BMC Health Serv Res. (2021) 21:1–15. doi: 10.1186/s12913-021-07276-5
36. Medarevic A, Vukovic D. Efficiency and productivity of public hospitals in Serbia using DEA-Malmquist model and Tobit regression model, 2015–2019. Int J Environ Res Public Health. (2021) 18:12475. doi: 10.3390/ijerph182312475
37. Asiabar AS, Sharifi T, Rezapour A, Firouzabadi SM, Haghighat-Fard P, Mohammad-Pour S. Technical efficiency and its affecting factors in Tehran's public hospitals: DEA approach and Tobit regression. Med J Islam Repub Iran. (2020) 34:176. doi: 10.47176/mjiri.34.176
38. Hajiagha SH, Amoozad Mahdiraji H, Hashemi SS, Garza-Reyes JA, Joshi R. Public hospitals performance measurement through a three-staged data envelopment analysis approach: evidence from an emerging economy. Cybern Syst. (2022) 15:1–26. doi: 10.1080/01969722.2022.2055382
39. Johnson WC. The dynamics of performance space of major league baseball pitchers 1871–2006. Ann Oper Res. (2010) 181:287–302. doi: 10.1007/s10479-010-0743-9
40. Lari MS, Sefiddashti SE. Measuring the efficiency of health systems: a case of mental health in middle east and North Africa countries. Iran J Public Health. (2021) 50:1017–27. doi: 10.18502/ijph.v50i5.6119
41. Xenos P, Yfantopoulos J, Nektarios M, Polyzos N, Tinios P, Constantopoulos A. Efficiency and productivity assessment of public hospitals in Greece during the crisis period 2009–2012. Cost Eff Resour Alloc. (2017) 15:6. doi: 10.1186/s12962-017-0068-5
42. Ozcan YA. Performance measurement using data envelopment analysis (DEA). In: Health Care Benchmarking and Performance Evaluation. Cham: Springer (2014). p. 15–47. doi: 10.1007/978-1-4899-7472-3_2
43. Dyson RG, Allen R, Camanho AS, Podinovski VV, Sarrico CS, Shale EA. Pitfalls and protocols in DEA. Eur J Oper Res. (2001) 132:245–59. doi: 10.1016/S0377-2217(00)00149-1
44. Banker RD, Charnes A, Cooper WW. Some models for estimating technical and scale inefficiencies in data envelopment analysis. Manag Sci. (1984) 9:1078–92.
45. Jacobs R, Smith PC, Street A. Measuring Efficiency in Health Care : Analytic Techniques and Health Policy. New York, NY: Cambridge University Press (2006). doi: 10.1017/CBO9780511617492
47. Zere E. Hospital Efficiency in Sub-Saharan Africa Evidence. Working Paper No 187. Helsinki: The United National University World Institute for Development Economic Research (2000).
48. Mehrtak M, Yusefzadeh H, Jaafaripooyan E. Pabon Lasso and data envelopment analysis: a complementary approach to hospital performance measurement. Glob J Health Sci. (2014) 6:107–16. doi: 10.5539/gjhs.v6n4p107
49. Kirigia JM, Asbu EZ. Technical and scale efficiency of public community hospitals in Eritrea: an exploratory study. Health Econ Rev. (2013) 3:6. doi: 10.1186/2191-1991-3-6
50. Dimas G, Goula A, Soulis S. Productive performance and its components in Greek public hospitals. Oper Res. (2012) 12:15–27. doi: 10.1007/s12351-010-0082-2
51. Clemens T, Michelsen K, Commers M, Garel P, Dowdeswell B, Brand H. European hospital reforms in times of crisis: aligning cost containment needs with plans for structural redesign? Health Policy. (2014) 117:6–14. doi: 10.1016/j.healthpol.2014.03.008
Keywords: hospital efficiency, gray relational analysis, gray clustering, data envelopment analysis, Tobit regression
Citation: Sun M, Ye Y, Zhang G, Xue Y and Shang X (2023) Measuring the efficiency of public hospitals: A multistage data envelopment analysis in Fujian Province, China. Front. Public Health 11:1091811. doi: 10.3389/fpubh.2023.1091811
Received: 07 November 2022; Accepted: 17 February 2023;
Published: 07 March 2023.
Edited by:
Nera Agabiti, Regional Health Service of Lazio, ItalyReviewed by:
John Yfantopoulos, National and Kapodistrian University of Athens, GreeceAleksandar Medarevic, Dr Milan Jovanovic Batut Institute of Public Health of Serbia, Serbia
Copyright © 2023 Sun, Ye, Zhang, Xue and Shang. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Yaojun Ye, eWp5ZTIwMTMmI3gwMDA0MDsxNjMuY29t; Xiuling Shang, emtzeGxpbmcmI3gwMDA0MDsxNjMuY29t; Yuan Xue, OTYyOTE3MiYjeDAwMDQwO3FxLmNvbQ==