Skip to main content

ORIGINAL RESEARCH article

Front. Cardiovasc. Med., 28 February 2022
Sec. Cardiovascular Epidemiology and Prevention
This article is part of the Research Topic Innovative Patterns and Technologies of Cardiac Rehabilitation in Patients with Coronary Artery Disease View all 15 articles

Predicting ICU Mortality in Rheumatic Heart Disease: Comparison of XGBoost and Logistic Regression

\nYixian Xu&#x;Yixian Xu1Didi Han&#x;Didi Han2Tao Huang&#x;Tao Huang3Xiaoshen ZhangXiaoshen Zhang4Hua LuHua Lu4Si ShenSi Shen5Jun Lyu
Jun Lyu3*Hao Wang
Hao Wang1*
  • 1Department of Anesthesiology, The First Affiliated Hospital of Jinan University, Guangzhou, China
  • 2School of Public Health, Xi'an Jiaotong University Health Science Center, Xi'an, China
  • 3Department of Clinical Research, The First Affiliated Hospital of Jinan University, Guangzhou, China
  • 4Department of Cardiovascular Surgery, The First Affiliated Hospital of Jinan University, Guangzhou, China
  • 5Department of Radiology, Medical Imaging Center, The First Affiliated Hospital of Jinan University, Guangzhou, China

Background: Rheumatic heart disease (RHD) accounts for a large proportion of Intensive Care Unit (ICU) deaths. Early prediction of RHD can help with timely and appropriate treatment to improve survival outcomes, and the XGBoost machine learning technology can be used to identify predictive factors; however, its use has been limited in the past. We compared the performance of logistic regression and XGBoost in predicting hospital mortality among patients with RHD from the Medical Information Mart for Intensive Care IV (MIMIC-IV) database.

Methods: The patients with RHD in the MIMIC-IV database were divided into two groups retrospectively according to the availability of data and its clinical significance based on whether they survived or died. Backward stepwise regression was used to analyze the independent factors influencing patients with RHD, and to compare the differences between the two groups. The XGBoost algorithm and logistic regression were used to establish two prediction models, and the areas under the receiver operating characteristic curves (AUCs) and decision-curve analysis (DCA) were used to test and compare the models. Finally, DCA and the clinical impact curve (CIC) were used to validate the model.

Results: Data on 1,634 patients with RHD were analyzed, comprising 207 who died during hospitalization and 1,427 survived. According to estimated results for the two models using AUCs [0.838 (95% confidence interval = 0.786–0.891) and 0.815 (95% confidence interval = 0.765–0.865)] and DCA, the logistic regression model performed better. DCA and CIC verified that the logistic regression model had convincing predictive value.

Conclusions: We used logistic regression analysis to establish a more meaningful prediction model for the final outcome of patients with RHD. This model might be clinically useful for patients with RHD and help clinicians to provide detailed treatments and precise management.

Introduction

Rheumatic heart disease (RHD) is a high priority in areas with restricted health systems (13), and causes approximately 250,000 deaths worldwide annually. RHD is heart damage caused by an abnormal immune response to group A streptococcal infections, which makes the morbidity and mortality of its complications a major burden for developing countries (4). Therefore, the early identification and diagnosis of RHD are very important for providing clinicians with meaningful information and allowing timely and appropriate treatment to improve survival outcomes. The pathogenesis of RHD is complicated and not yet fully understood. For this reason, an effective and reliable model for evaluating the prognosis of RHD is urgently needed to offer a basis for comprehensive diagnoses and treatments of the disease and the effective use of medical and health resources. Recent studies have indicated that serum-related markers, such as IL-1β, IL-8, IL-6, CXCL-1, tumor necrosis factor α, antistreptolysin, antideoxyribose, and nuclease B concentrations have been widely used in prognostic evaluations of RHD. However, their prognostic values are limited, for they lack sensitivity or specificity (5, 6). XGBoost is a machine learning technology with the noteworthy characteristics of assembling weak prediction models, and providing flexible and efficient missing data processing for establishing accurate prediction models (5). A logistic regression model is usually developed by the variables of each patient that predict the outcomes of future patients. Its accuracy is primarily based on the ability of the model to correctly assign patients as higher risk. The ability of the model to determine and assign the correct average absolute risk level is essential for judging the usefulness of any new predicting tool (7). Compared with machine learning technology, logistic regression has indicated better predictive performance (811).

In a word, this study has two purposes: (I) to use the XGBoost algorithm and logistic regression to compare the overall performance of the model in predicting mortality of patients from the Medical Information Mart for Intensive Care IV (MIMIC-IV) database with RHD during hospitalization, and (II) to perform decision-curve analysis (DCA) and calculate clinical impact curves (CICs) to verify the logistic regression model.

Methods

Database

This study was based on version 0.4 of the MIMIC-IV database and contained information on Acute Medical Unit (AMU) and ICU admissions at the Beth Israel Deaconess Medical Center from 2008 to 2019 (12). We extracted patient parameters, including demographic data, vital signs, and laboratory test data. GitHub was used to locate the codes for data extraction (https://github.com/mit-lcp/mimic-iv).

Study Population

This study included adult patients clinically diagnosed with RHD. The inclusion criteria included (I) patients were elder than 18 years and (II) diagnosed with heart tissue lesions caused by rheumatic fever activity that affected the heart structure. Only patients with first admission information showing RHD would be selected. We used the R packages “vim” (13) and “MICE” (14) for multiple imputation and visualization of <20% missing or randomly missing data in order to improve the accuracy of the review of the MIMIC-IV database, and deleted variables that were absent in more than 20% of observations.

Data Extraction

The pgAdmin PostgreSQL (version 1.22.1) and Navicat Premium (version 12.0.28) tools were used to extract the raw data of patients diagnosed with RHD during their first hospital admission. R software (version 3.6.3) was used for the data processing (15). The following demographic data were extracted: age, sex, race, weight, length of hospital stay, and hospital death signs at their first admission. The vital signs of ICU patients were collected within 24 h of admission, including heart rate, blood pressure, body temperature, respiratory rate, Oxyhemoglobin saturation (SpO2), heart rhythm, glucose, and urine output. Laboratory indicators were extracted, such as routine blood tests, liver function, kidney function, arterial blood gas analysis, Oxyhemoglobin saturation, blood electrolytes, and coagulation function. The following severity scoring systems were extracted: Charlson Comorbidity Index, systemic inflammatory response syndrome score, Simplified Acute Physiology Score-II, sequential organ failure assessment score, Acute Physiology Score-III (APSIII), Logical Evaluation System for Organ Dysfunction, sepsis, chronic kidney disease (CKD), and Glasgow Coma Scale (GCS) score (5). Information on whether the patients were using vasoactive drugs or antibiotics and taking the valve replacement/valvuloplasty, and their ventilation statuses, were all extracted at the first hospital admission.

Statistical Analysis

Patients with RHD were divided into two groups according to survival or death during hospitalization, and the variables were compared between the groups. We eliminated the confounding variables and outliers with great impacts, and determined the influence of variables on the mortality of patients with RHD during hospitalization using correlation analysis. The Kolmogorov-Smirnov test was used to test continuous variables that conformed to a normal distribution. Student's t-test, one-way analysis of variance, Mann-Whitney U test, or Kruskal-Wallis H test were used to test and compare nonnormally distributed continuous data. Categorical variables were reported as numbers or percentages, and were evaluated using chi-square or Fisher's exact tests according to the number of patients.

We developed the logistic regression and XGBoost algorithm models during the model construction phase. First, through backward stepwise analysis and identification using the chi-square test, the variables for which p < 0.05 were selected for the logistic regression model. Second, the XGBoost model (16, 17) was established to analyze the impact of each factor on mortality gain during the hospitalization period. Backward stepwise analysis was performed according to the Akaike information criterion (18), variables for which p < 0.05 were selected, and clinical symptoms, signs, and laboratory test variables were used to develop the XGBoost machine learning models. We tested and compared the overall performances of the two predictive models using the area under the receiver operating characteristic curve (AUC) and DCA, and selected and verified the model with the highest diagnostic value and prognostic evaluation. Finally, the CIC and DCA were drawn to clarify the clinical practicality and applicability of the model with the highest prognostic value.

Both models were analyzed using R software, and the criterion for statistically significance was set at p < 0.05.

Results

Baseline Characteristics

This study analyzed the data of 1,634 patients with RHD, comprising 207 who died during hospitalization and 1,427 survived. Among the dead patients, admission age, norepinephrine, vasopressin, heart rhythm, sepsis, valve replacement, cefazolin, cefepime, mupirocin ointment, vancomycin, CKD, ventilation status, serum creatinine, urine volume, Partial Pressure of Oxygen (PO2), total CO2, SpO2, Partial Pressure of Carbon Dioxide (PCO2), blood gas analysis, routine blood test, blood biochemical indicators, scoring system, comorbidity index, and survival group were significant different. However, the differences were not statistically significant (p > 0.05) indicators between groups were sex, race, valvuloplasty, PCO2, diastolic blood pressure, temperature, weight, bicarbonate, and hematocrit. Figure 1 showed a flow chart of the measures for extracting research objective data. Table 1 compared the baseline characteristics, laboratory data, and vital signs between the dead and surviving patients during the hospitalization periods. Figure 2 was a pie chart showing racial characteristics and overall heart rhythm.

FIGURE 1
www.frontiersin.org

Figure 1. The detailed process of data extraction.

TABLE 1
www.frontiersin.org

Table 1. Baseline characteristics, vital signs, laboratory parameters and statistic results of mimic-IV patients with Rheumatic heart disease.

FIGURE 2
www.frontiersin.org

Figure 2. Characteristics of MIMIC-IV patients with Rheumatic heart disease by heart rhythm (A) and characteristics of MIMIC-IV patients with Rheumatic heart disease by races (B).

Features Selected in Models

The most important features were included in the logistic regression and XGBoost models (Tables 2, 3, respectively), which were determined by the results of backward stepwise regression analysis, and had strong correlations with mortality during hospitalization, with all p < 0.05. According to the analysis results for the logistic regression model regarding the contribution rate of each feature (Table 2; Figure 3), the 13 most important variables in the data set were APSIII, vasopressin, Sp2, valve replacement, cefepime, GCS score, admission age, Model for End-stage Liver Disease (MELD), urine output, magnesium, prothrombin time (PT), norepinephrine, and red blood cells.

TABLE 2
www.frontiersin.org

Table 2. Features selected in the logistic regression.

TABLE 3
www.frontiersin.org

Table 3. Features selected in the XGboost model.

FIGURE 3
www.frontiersin.org

Figure 3. Top 13 features selected using logistic regression and the corresponding variable importance score. X-axis indicates the top 13 weighted variables, Y-axis indicates the importance score which is the relative number of a variable that is used to distribute the data.

Model Comparisons

The AUCs of the two models during the model development and verification stages were 0.838 (95% confidence interval = 0.786–0.891) and 0.815 (95% confidence interval = 0.765–0.865), respectively, which indicated good distinguishing ability (Figure 4). The logistic regression model had a larger AUC than the XGBoost algorithm model. DCA of the two predictive models at the same time indicated that the logistic model had greater net benefit than the XGBoost algorithm model (Figure 5).

FIGURE 4
www.frontiersin.org

Figure 4. The receiver operating characteristic (ROC) curves. (A) XGboost model, AUC is 0.815 [0.765–0.865], (B) logistic regression model, area under curves (AUC) is 0.838 [95% confidence interval (CI); 0.786–0.891], the best performance of the models was the logistic regression model.

FIGURE 5
www.frontiersin.org

Figure 5. Decision curve analysis (DCA) of the two prediction models. The net benefit curves for the two prognostic models are shown. X-axis indicates the threshold probability for critical care outcome and Y-axis indicates the net benefit. dashed purple line = XGboost model, dashed blue line = logistic model. The preferred model is the logistic model, the net benefit of which was larger over the range of XGboost model.

Optimal Model Analysis

Figure 6 visualizes the logistic regression model as a nomogram for calculating the risks of mortality and incidence during hospitalization using 13 selected variables for the logistic regression and 15 for the XGBoost algorithm model. The clinical applicability of the risk prediction nomogram in Figure 7 was assessed using CIC analysis. CIC intuitively indicated that the clinical intervention guided by the nomogram scoring system had a superior overall net benefit within the actual range of the threshold probability and affected the prognoses of patients. This indicated that the logistic regression model had significant predictive value. In short, logistic regression analysis was the best model for the prognoses of patients with RHD.

FIGURE 6
www.frontiersin.org

Figure 6. Nomogram to estimate the risk of mortality in Rheumatic heart disease patients. To use the nomogram, we first draw a line from each parameter value to the score axis for the score, the points for all the parameters are then added, finally, a line from the total score axis is drawn to determine the risk of mortality on the lower line of the nomogram.

FIGURE 7
www.frontiersin.org

Figure 7. Clinical impact curve (CIC) of logistic model. The purple curve (number of high-risk individuals) indicates the number of people who are classified as positive (high risk) by the model at each threshold probability; the blue curve (number of high-risk individuals with outcome) is the number of true positives at each threshold probability. CIC visually indicated that nomogram conferred high clinical net benefit and confirmed the clinical value of the logistic model.

Discussion

RHD causes severe mortality and huge medical economic burdens in developing countries worldwide (19). Previous reports have indicated that about 1% of over one million asylum seekers who immigrated to Europe in 2015 may have had RHD (20). Previous data suggested that the hospitalization rate of heart disease patients due to RHD increased from 20 to 50% in 1945 and 1963, respectively. According to the annual mortality rate of 1.5%, the number of worldwide deaths from RHD is estimated to be 233,000–294,000 (19).

It is currently difficult for ICU doctors to predict the adverse clinical consequences of patients with RHD, and it is also difficult to enhance the prognoses of these patients through timely interventions and treatments. Hence, the establishment of a reliable clinical prediction model is particularly important in clinical decision-making. The calculated AUCs and DCA suggested the benefits of using the logistic regression model very much more than XGBoost machine algorithm model analysis, which could be used for early predictions of patient mortality during ICU stay.

XGBoost Model Performance

XGBoost is an efficient, flexible, and scalable machine learning algorithm classifier that improves the subsampling rate, learning rate, and maximum tree depth to control overfitting and enhance its performance. It has been extensively used to detect cardiovascular diseases and associations between prognoses (21). For example, Rong et al. (22) observed that T-wave repolarization synchronization was an important factor for determining the presence of ischemic heart disease using the non-invasive XGBoost machine learning algorithm, and found the correlation between magnetic pole characteristics and cardiac ischemia. Localized ischemia provided an opportunity, and Baskaran et al. (23) used machine learning to obtain insight into the role of images and clinical variables in predicting obstructive coronary artery disease and revascularization, while Tseng et al. (24) determined the risks after cardiac surgery, which could optimize postoperative treatment strategies and minimize postoperative complications.

Logistic Regression Model Performance

Logistic regression technology has recently been used to analyze the unique benefits of utilizing quantified independent variables, and to determine the influence of a set of independent variables on the regression results (25). Moreover, a prediction model derived from the data set of patient information can predict adverse clinical consequences (26). Sandfort et al. (27) found a significant correlation between long-term heart rate increase and the decrease in ICU survival rate based on logistic regression analysis. Liu et al. (28) investigated the relationship between blood urea nitrogen (BUN) and hospital mortality in patients with critical cardiogenic shock. Their use of a logistic regression algorithm indicated that higher BUN was associated with poorer clinical outcomes. Sun et al. (29) used a logistic regression algorithm to determine that the anion gap was an independent risk variable for the mortality of inpatients in coronary care units (CCUs) and was linked to the poor prognosis of CCU patients. Li et al. (30) used a logistic regression algorithm to estimate whether β2-agonist inhalation would increase the ICU mortality of patients with heart failure. However, compared with other types of predictive models, none of the above studies verified the superiority of the logistic regression model or analyzed it in-depth. More importantly, the main aims of these studies were to detect the poor prognosis of patients with cardiogenic shock and coronary heart disease, whereas logistic regression analysis had not been applied previously to the prognoses of patients with RHD.

Predictors of Logistic Regression Model Outcomes

The features in the logistic regression and XGBoost models were consistent, highlighting the excellent performance of the logistic regression model. However, the characteristics and adverse consequences of RHD had not yet been completely explained. Therefore, it is necessary to further investigate the effects of these characteristics on patients with RHD. Among these characteristics, ASPIII had the greatest weight, indicating that it was the most important predictor of the RHD mortality of patients in the MIMIC-IV. Meng et al. (31) reported that APSIII and GCS scores were validated disease severity and mortality prediction tools that did well in identifying high-risk patients in a timely manner and in formulating intervention strategies (32). The MELD score was a clinical predictor in the logistic regression analysis of hospital mortality patients with RHD in ICUs and was used to assess cardiovascular-disease-related secondary liver dysfunction (33), and also was taken as a measure of liver and kidney dysfunction. Quantitative indicators had high specificity and sensitivity for predicting the operative mortality of RHD valve surgery (34).

Dzimiri et al. (35) reported that the density of lymphocyte β-adrenergic receptors was markedly decreased in patients with valvular RHD, and the significant decrease in blood oxygen saturation might directly stimulate atrial natriuretic peptide (ANP) release into the heart. There was a good evidence showing that ANP, norepinephrine, vasopressin, and the renin-angiotensin-aldosterone system were involved in controlling water and electrolyte balances. When the blood pressure was low, the elevation of ANP could inhibit the response of vasopressin and renin to arterial hypotension. Hence, the administration of norepinephrine and vasopressin affected the prognosis and mortality of patients in ICUs with RHD, and was essential for the prevention and treatment of complications (36). RHD was the leading cause of valve damage, and heart valve prosthesis implantation was one of the key predictors in the logistic regression model for RHD. Chen et al. (37) and other studies indicated that mitral valve replacement should be performed when patients with RHD had mitral valve damage. Valve replacement could be performed to strengthen driving the decisions making around the surgical treatment of RHD (37). Valve damage that occurring during atrial fibrillation (AF) might be persisting or be aggravated by repeated occurrences, leading to chronic RHD (6). Cefepime is a fourth-generation cephalosporin that is used for the infections of respiratory, urinary, skin, soft tissue and so on from bacteria. Long-term antibiotics use for secondary prevention is critical for preventing disease progression. Prospective studies have demonstrated that life-threatening allergic reactions are uncommon after intravenous antibiotics, and the long-term benefits of this preventive measure outweigh its risks (38). The prevention and treatment of AF recurrence with long-term antibiotics can contribute to reducing the progression and severity of RHD (6, 39).

Age was included in our model as a demographic parameter. Agenson et al. (40) indicated that advanced age had an adverse effect on mortality. In sub-Saharan Africa, RHD is thought to be responsible for up to 32% of heart failure cases (41). Patients with RHD, like those with congestive heart failure, show a significantly improved condition after treatment with cardiac drugs and diuretics, which can be relieved by treating pulmonary vein congestion that can prolong diastolic time and improve cardiac output (6). For this reason, recording urine volume is of great significance to ICU patients (42).

PT was another key predictor in the logistic regression model. Increased fibrinogen levels in patients with RHD were linked to accidental ischemic stroke (43). Arvind and Ramakrishnan (6) suggested that patients with RHD accompanied by AF, a medical history of thromboembolism, or left atrial thrombosis require anticoagulant therapy when testing their coagulation function indexes, including PT. The most common persistent arrhythmia is AF, which can increase the likelihood of stroke about 5 fold and the risk of death from all causes by 2 fold in patients with RHD.

Serum magnesium is a particularly interesting parameter. With serum magnesium levels >3.8 mg/dl, sinus rhythm of patients had a conversion rate of 88.89%, which far exceeded that of 16.67% in patients with serum magnesium levels <3.8 mg/dl. Intravenous magnesium supplementation can significantly improve the effect of converting AF and improve sinus rhythm in patients with RHD (44). A recent study by Deora et al. (45) found that the main cause of heart failure was diastolic heart failure, and the most common cause was RHD. Anemia has a huge impact on the course and prognosis of patients with heart failure. Appropriate interventions and prognoses should be provided early in the course of the disease. Treatment will improve the survival rate of patients, and the red blood cell count has also been included in the model (45). Our research indicated that in addition to the unknown heart rhythm and normal heart rhythm, AF accounted for the highest proportion of cases. To prevent adverse complications such as cardiovascular or cerebrovascular embolism, some studies have indicated that socioeconomic and environmental factors related to race were also the reasons for the increase in RHD prevalence (46).

Strengths

The main advantage of this study was that it was the first one to use a logistic regression model to predict hospital mortality of patients with RHD from the MIMIC-IV database. According to the variables selected by the backward stepwise regression analysis, the accuracy and representativeness were improved over XGBoost. The models were compared and verified using DCA and CIC, and certain important parameters such as the body weight and heart rhythm were not missing.

Limitations

Our research inevitably has some limitations: Firstly, it was a retrospective observational study, not a randomized study, and the data were only obtained from the MIMIC-IV database, which the majority of patients were white, and there may be unobserved confounding factors that might lead to potential biases in the results. Secondly, the MIMIC-IV database did not provide patient history and long-term follow-up events. The inherent limitations in the data extraction technology meant that some crucial influencing variables were overlooked. Thirdly, RHD patients might also have complications such as cardiovascular and cerebrovascular accidents during ICU admission. Fourthly, despite the very high quality of the MIMIC-IV database, there were still some underlying variables and missing data that prevented the availability of certain clinical variables and surgical operation data, including left ventricular ejection fraction, functional classification of heart failure, echocardiographic data, variables such as C-reactive protein, lactate and D-dimer, implying that the inability to accurately identified the severity of RHD is another limitation of this study. Finally, as a retrospective observational single-center study of electronic health record data, the earliest cases were taken from nearly 14 years ago, when care might have been inconsistent with currently accepted standards. The single-center nature of the study might also make our findings limiting the applicability of other sites. Nonetheless, single-center studies have increased the likelihood that patients will be treated uniformly, alleviating concerns that observed differences in mortality may be due to differences in practice across centers.

Despite owning these limitations, it can currently provide comprehensive and high-quality data on critical illnesses, and has provided a large number of scientific researchers with good research ideas and data, and published many high-quality scientific articles. And some studies using retrospective studies are sufficient, such as when rofecoxib was withdrawn from the market or we convinced the public that smoking was associated with a risk of cancer. In this paper, we aimed to utilize secondary analysis of electronic health record (EHR) data to evaluate practical application-related tests and treatments based on limited benefit or theory, and we considered that the proposed model could help further the understanding of the prognosis of patients with RHD during ICU hospitalization. However, further prospective multicenter studies are needed to validate our findings.

Conclusions

In summary, this research has indicated that machine learning based on logistic regression analysis algorithm is better than using the XGBoost algorithm. Our simple and efficient nomogram based on logistic regression analysis is indicated to be clinically useful. It can help clinicians to tailor precise management and treatments for patients with RHD, which is conducive to maximizing the survival probability of these patients.

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Author Contributions

YX, DH, and TH performed statistical analysis and data interpretation. HW and JL contributed to the study concept and study design and contributed equally. XZ performed literature research and data extraction. HL and SS were responsible for the quality control of data and algorithms. All authors contributed to writing of the manuscript and approved the final version.

Funding

This study was funded by National Natural Science Foundation, China (Grant No. 82071340); Natural Science Foundation of Guangdong Province, China (Grant No. 2018A0303131003); Science and Technology Planning Project of Guangdong Province, China (Grant No. 2020A1414010291) and Medical Science and Technology Foundation of Guangdong Province, China (Grant No. A2019550).

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Abbreviations

ICU, Intensive care unit; RHD, Rheumatic heart disease; MIMIC-IV, Medical Information Mart for Intensive Care IV; AUCs, Areas-under-the-receiver operating characteristic curves; DCA, decision-curve analysis; CIC, Clinical impact curve; AMU, Acute Medical Unit; SpO2, Oxyhemoglobin saturation; APSIII, Acute Physiology Score-III; CKD, chronic kidney disease; GCS, Glasgow Coma Scale; PO2, partial pressure of oxygen; PCO2, Partial Pressure of Carbon Dioxide; MELD, Model for End-stage Liver Disease; PT, prothrombin time; BUN, blood urea nitrogen; ANP, atrial natriuretic peptide; AF, atrial fibrillation; CCUs, coronary care units; ROC, The receiver operating characteristic curves; OR, Odds ratio; CI, Confidence interval.

References

1. Karthikeyan G, Connolly SJ, Ntsekhe M, Benz A, Rangarajan S, Lewis G, et al. The INVICTUS rheumatic heart disease research program: rationale, design and baseline characteristics of a randomized trial of rivaroxaban compared to vitamin K antagonists in rheumatic valvular disease and atrial fibrillation. Am Heart J. (2020) 225:69–77. doi: 10.1016/j.ahj.2020.03.018

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Opara CC, Aghassibake N, Watkins DA. Economic consequences of rheumatic heart disease: a scoping review. Int J Cardiol. (2021) 323:235–41. doi: 10.1016/j.ijcard.2020.09.020

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Muhamed B, Mutithu D, Aremu O, Zühlke L, Sliwa K. Rheumatic fever and rheumatic heart disease: Facts and research progress in Africa. Int J Cardiol. (2019) 295:48–55. doi: 10.1016/j.ijcard.2019.07.079

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Marijon E, Mirabel M, Celermajer DS, Jouven X. Rheumatic heart disease. Lancet. (2012) 3799819:953–64. doi: 10.1016/S0140-6736(11)61171-9

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Dooley LM, Ahmad TB, Pandey M, Good MF, Kotiw M. Rheumatic heart disease: a review of the current status of global research activity. Autoimmun Rev. (2021) 202:102740. doi: 10.1016/j.autrev.2020.102740

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Arvind B, Ramakrishnan S. Rheumatic fever and rheumatic heart disease in children. Indian J Pediatr. (2020) 874:305–11. doi: 10.1007/s12098-019-03128-7

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Meurer WJ, Tolles J. Logistic regression diagnostics: understanding how well a model predicts outcomes. JAMA. (2017) 31710:1068–9. doi: 10.1001/jama.2016.20441

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Tan HS, Liu N, Sultana R, Han NLR, Tan C, Zhang J, et al. Prediction of breakthrough pain during labour neuraxial analgesia: comparison of machine learning and multivariable regression approaches. Int J Obstet Anesth. (2021) 45:99–110. doi: 10.1016/j.ijoa.2020.08.010

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Guan WJ, Jiang M, Gao YH, Li HM, Xu G, Zheng JP, et al. Unsupervised learning technique identifies bronchiectasis phenotypes with distinct clinical characteristics. Int J Tuberc Lung Dis. (2016) 203:402–10. doi: 10.5588/ijtld.15.0500

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Howard R, Rattray M, Prosperi M, Custovic A. Distinguishing asthma phenotypes using machine learning approaches. Curr Allergy Asthma Rep. (2015) 157:38. doi: 10.1007/s11882-015-0542-0

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Weng SF, Reps J, Kai J, Garibaldi JM, Qureshi N. Can machine-learning improve cardiovascular risk prediction using routine clinical data? PLoS ONE. (2017) 124:e0174944. doi: 10.1371/journal.pone.0174944

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Yang J, Li Y, Liu Q, Li L, Feng A, Wang T, et al. Brief introduction of medical database and data mining technology in big data era. J Evid Based Med. (2020) 131:57–69. doi: 10.1111/jebm.12373

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Templ M, Alfons A, Filzmoser P. Exploring incomplete data using visualization techniques. Adv Data Anal Classif. (2012) 61:29–47. doi: 10.1007/s11634-011-0102-y

CrossRef Full Text | Google Scholar

14. Zhang Z. Multiple imputation with multivariate imputation by chained equation (MICE) package. Ann Transl Med. (2016) 42:30. doi: 10.3978/j.issn.2305-5839.2015.12.63

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Wu W-T, Li Y-J, Feng A-Z, Li L, Huang T, Xu A-D, et al. Data mining in clinical big data: the frequently used databases, steps, and methodological models. Mil Med Res. (2021) 81:44. doi: 10.1186/s40779-021-00338-z

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Zhang Z, Ho KM, Hong Y. Machine learning for the prediction of volume responsiveness in patients with oliguric acute kidney injury in critical care. Crit Care. (2019) 231:112. doi: 10.1186/s13054-019-2411-z

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Livne M, Boldsen JK, Mikkelsen IK, Fiebach JB, Sobesky J, Mouridsen K. Boosted tree model reforms multimodal magnetic resonance imaging infarct prediction in acute stroke. Stroke. (2018) 494:912–8. doi: 10.1161/STROKEAHA.117.019440

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Collins GS, Reitsma JB, Altman DG, Moons KGM. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement. Br J Surg. (2015) 1023:148–58. doi: 10.1002/bjs.9736

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Kumar RK, Tandon R. Rheumatic fever & rheumatic heart disease: the last 50 years. Indian J Med Res. (2013) 1374:643–58.

Google Scholar

20. Mutagaywa RK, Wind A-M, Kamuhabwa A, Cramer MJ, Chillo P, Chamuleau S. Rheumatic heart disease anno 2020: impacts of gender and migration on epidemiology and management. Eur J Clin Invest. (2020) 5012:e13374. doi: 10.1111/eci.13374

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Davagdorj K, Pham VH, Theera-Umpon N, Ryu KH. XGBoost-Based Framework for Smoking-Induced Noncommunicable Disease Prediction. Int J Environ Res Public Health. (2020) 17:6513. doi: 10.3390/ijerph17186513

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Rong T, Shulin Z, Xiao H, Minfang T, Jian M, Shixin M, et al. Magnetocardiography-based ischemic heart disease detection and localization using machine learning methods. IEEE Trans Biomed Eng. (2019) 666:1658–67. doi: 10.1109/TBME.2018.2877649

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Baskaran L, Ying X, Xu Z, Al'Aref SJ, Lee BC, Lee S-E, et al. Machine learning insight into the role of imaging and clinical variables for the prediction of obstructive coronary artery disease and revascularization: An exploratory analysis of the CONSERVE study. PLoS ONE. (2020) 156:e0233791. doi: 10.1371/journal.pone.0233791

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Tseng P-Y, Chen Y-T, Wang C-H, Chiu K-M, Peng Y-S, Hsu S-P, et al. Prediction of the development of acute kidney injury following cardiac surgery by machine learning. Crit Care. (2020) 241:478. doi: 10.1186/s13054-020-03179-9

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Stoltzfus JC. Logistic regression: a brief primer. Acad Emerg Med. (2011) 1810:1099–104. doi: 10.1111/j.1553-2712.2011.01185.x

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Steyerberg EW, Harrell FE, Borsboom GJ, Eijkemans MJ, Vergouwe Y, Habbema JD. Internal validation of predictive models: efficiency of some procedures for logistic regression analysis. J Clin Epidemiol. (2001) 548:774–81. doi: 10.1016/S0895-4356(01)00341-9

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Sandfort V, Johnson AEW, Kunz LM, Vargas JD, Rosing DR. Prolonged elevated heart rate and 90-day survival in acutely ill patients: data from the MIMIC-III database. J Intensive Care Med. (2019) 348:622–9. doi: 10.1177/0885066618756828

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Liu E-Q, Zeng C-L. Blood urea nitrogen and in-hospital mortality in critically ill patients with cardiogenic shock: analysis of the mimic-III database. Biomed Res Int. (2021) 2021:5948636. doi: 10.1155/2021/5948636

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Sun T, Cai C, Shen H, Yang J, Guo Q, Zhang J, et al. Anion gap was associated with inhospital mortality and adverse clinical outcomes of coronary care unit patients. Biomed Res Int. (2020) 2020:4598462. doi: 10.1155/2020/4598462

PubMed Abstract | CrossRef Full Text | Google Scholar

30. Li Z, Ling Y, Chen Q, Wu B, Peng L, Tang X, et al. Inhaled beta2-agonists increase in-hospital mortality in ICU patients with heart failure. Int Heart J. (2021) 625:1076–82. doi: 10.1536/ihj.20-825

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Meng Z, Zhao Y, He Y. Fibrinogen level predicts outcomes in critically ill patients with acute exacerbation of chronic heart failure. Dis Markers. (2021) 2021:6639393. doi: 10.1155/2021/6639393

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Feng J-S, Lou B-H, Chen Y. [Comparisons of clinical effectiveness and survival between continuous and interrupted chest compressions in out-of-hospital cardiac arrest]. Zhongguo Yi Xue Ke Xue Yuan Xue Bao. (2018) 404:473–80. doi: 10.3881/j.issn.1000-503X.9940

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Morimoto N, Matsushima S, Aoki M, Henmi S, Nishioka N, Murakami H, et al. Long-term results of bioprosthetic tricuspid valve replacement: an analysis of 25 years of experience. Gen Thorac Cardiovasc Surg. (2013) 613:133–8. doi: 10.1007/s11748-012-0190-4

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Lim K, Chow SCY, Ho JYK, Wan S, Underwood M J, Wong RHL. Hepatorenal dysfunction predicts operative mortality after triple valve surgery: Utility of MELD-Na. J Card Surg. (2021) 369:3112–8. doi: 10.1111/jocs.15745

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Dzimiri N, Hussain S, Moorji A, Prabhakar G, Bakr S, Kumar M, et al. Characterization of lymphocyte beta-adrenoceptor activity and Gs-protein in patients with rheumatic heart valvular disease. Fundam Clin Pharmacol. (1995) 94:372–80. doi: 10.1111/j.1472-8206.1995.tb00512.x

PubMed Abstract | CrossRef Full Text | Google Scholar

36. Lewin RF, Raff H, Findling JW, Dorros G. Stimulation of atrial natriuretic peptide and vasopressin during retrograde mitral valvuloplasty. Am Heart J. (1990) 120:1305–10. doi: 10.1016/0002-8703(90)90240-X

PubMed Abstract | CrossRef Full Text | Google Scholar

37. Chen S-W, Chen C-Y, Chien-Chia Wu V, Chou A-H, Cheng Y-T, Chang S-H, et al. Mitral valve repair versus replacement in patients with rheumatic heart disease. J Thorac Cardiovasc Surg. (2020). doi: 10.1016/j.jtcvs.2020.07.117. [Epub ahead of print].

PubMed Abstract | CrossRef Full Text | Google Scholar

38. Allergic reactions to long-term benzathine penicillin prophylaxis for rheumatic fever. International Rheumatic Fever Study Group. Lancet. (1991) 337:1308–10.

Google Scholar

39. Adem A, Dukessa Gemechu T, Jarso H, Reta W. Rheumatic heart disease patients' adherence to secondary prophylaxis and associated factors at hospitals in Jimma zone, southwest ethiopia: a multicenter study. Patient Prefer Adherence. (2020) 14:2399–406. doi: 10.2147/PPA.S281413

PubMed Abstract | CrossRef Full Text | Google Scholar

40. Agenson T, Katzenellenbogen JM, Seth R, Dempsey K, Anderson M, Wade V, et al. Case ascertainment on australian registers for acute rheumatic fever and rheumatic heart disease. Int J Environ Res Public Health. (2020) 17:5505. doi: 10.3390/ijerph17155505

PubMed Abstract | CrossRef Full Text | Google Scholar

41. Chang A Y, Nabbaale J, Okello E, Ssinabulya I, Barry M, Beaton A Z, et al. Outcomes and care quality metrics for women of reproductive age living with rheumatic heart disease in Uganda. J Am Heart Assoc. (2020) 98:e015562. doi: 10.1161/JAHA.119.015562

PubMed Abstract | CrossRef Full Text | Google Scholar

42. Wu W, Chen Q, Zhang L, Chen W. Epidural anesthesia for cesarean section for pregnant women with rheumatic heart disease and mitral stenosis. Arch Gynecol Obstet. (2016) 2941:103–8. doi: 10.1007/s00404-015-4003-8

PubMed Abstract | CrossRef Full Text | Google Scholar

43. Liu J, Wang D, Xiong Y, Liu B, Lin J, Zhang S, et al. Association between coagulation function and cerebral microbleeds in ischemic stroke patients with atrial fibrillation and/or rheumatic heart disease. Aging Dis. (2017) 82:131–5. doi: 10.14336/AD.2016.0715

PubMed Abstract | CrossRef Full Text | Google Scholar

44. Malviya A, Kapoor M, Sivam R K N, Khan S A, Pandey R, Kumar U, et al. Ibutilide with magnesium for conversion of atrial fibrillation or flutter in rheumatic heart disease patients: ibutilide with magnesium for chemical cardioversion of atrial fibrillation or flutter. Indian Heart J. (2020) 724:283–8. doi: 10.1016/j.ihj.2020.07.008

PubMed Abstract | CrossRef Full Text | Google Scholar

45. Deora S, Sharma J B, Sharma S K, Chaudhary N, Kaushik A, Choudhary R, et al. Clinical characteristic, red blood cell indices, iron profile and prognosis of heart failure in females. Glob Cardiol Sci Pract. (2021) 20212:e202113. doi: 10.21542/gcsp.2021.13

PubMed Abstract | CrossRef Full Text | Google Scholar

46. Chatard J-C, Dubois T, Espinosa F, Kamblock J, Ledos P-H, Tarpinian E, et al. Screening rheumatic heart disease in 1530 new caledonian adolescents. J Am Heart Assoc. (2020) 99:e015017. doi: 10.1161/JAHA.119.015017

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: MIMIC-IV, rheumatic heart disease, XGBoost, logistic regression, intensive care unit, mortality, prediction

Citation: Xu Y, Han D, Huang T, Zhang X, Lu H, Shen S, Lyu J and Wang H (2022) Predicting ICU Mortality in Rheumatic Heart Disease: Comparison of XGBoost and Logistic Regression. Front. Cardiovasc. Med. 9:847206. doi: 10.3389/fcvm.2022.847206

Received: 01 January 2022; Accepted: 25 January 2022;
Published: 28 February 2022.

Edited by:

Yan Zhang, Peking University, China

Reviewed by:

Linggen Gao, People's Liberation Army General Hospital, China
Marco Matteo Ciccone, University of Bari Aldo Moro, Italy

Copyright © 2022 Xu, Han, Huang, Zhang, Lu, Shen, Lyu and Wang. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Jun Lyu, lyujun2020@jnu.edu.cn; Hao Wang, haowang@jnu.edu.cn

These authors have contributed equally to this work and share first authorship

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.