Skip to main content

ORIGINAL RESEARCH article

Front. Cardiovasc. Med., 01 April 2022
Sec. General Cardiovascular Medicine
This article is part of the Research Topic Highlights in General Cardiovascular Medicine: 2021 View all 12 articles

Machine Learning-Based Personalized Risk Prediction Model for Mortality of Patients Undergoing Mitral Valve Surgery: The PRIME Score

\r\nNing Zhou,,Ning Zhou1,2,3Zhili JiZhili Ji1Fengjuan Li,Fengjuan Li1,2Bokang Qiao,Bokang Qiao1,2Rui Lin,Rui Lin1,2Wenxi Jiang,Wenxi Jiang1,2Yuexin Zhu,Yuexin Zhu1,2Yuwei LinYuwei Lin4Kui Zhang,Kui Zhang1,3Shuanglei LiShuanglei Li5Bin You,Bin You1,3Pei Gao,,Pei Gao4,6,7Ran Dong,*Ran Dong1,3*Yuan Wang,*Yuan Wang1,2*Jie Du,*\r\nJie Du1,2*
  • 1Beijing Anzhen Hospital, Capital Medical University, Beijing, China
  • 2Beijing Institute of Heart, Lung and Blood Vessel Diseases, Beijing Anzhen Hospital, Capital Medical University, Beijing, China
  • 3Department of Cardiac Surgery, Beijing Anzhen Hospital, Capital Medical University, Beijing, China
  • 4Department of Epidemiology and Biostatistics, School of Public Health, Peking University, Beijing, China
  • 5Department of Cardiac Surgery, Chinese People’s Liberation Army General Hospital, Beijing, China
  • 6Peking University Health Science Center, Peking University, Beijing, China
  • 7Key Laboratory of Molecular Cardiovascular Sciences, Ministry of Education, Peking University, Beijing, China

Background: Mitral valve surgery (MVS) is an effective treatment for mitral valve diseases. There is a lack of reliable personalized risk prediction models for mortality in patients undergoing mitral valve surgery. Our aim was to develop a risk stratification system to predict all-cause mortality in patients after mitral valve surgery.

Methods: Different machine learning models for the prediction of all-cause mortality were trained on a derivation cohort of 1,883 patients undergoing mitral valve surgery [split into a training cohort (70%) and internal validation cohort (30%)] to predict all-cause mortality. Forty-five clinical variables routinely evaluated at discharge were used to train the models. The best performance model (PRIME score) was tested in an externally validated cohort of 220 patients undergoing mitral valve surgery. The model performance was evaluated according to the area under the curve (AUC). Net reclassification improvement (NRI) and integrated discrimination improvement (IDI) were compared with existing risk strategies.

Results: After a median follow-up of 2 years, there were 133 (7.063%) deaths in the derivation cohort and 17 (7.727%) deaths in the validation cohort. The PRIME score showed an AUC of 0.902 (95% confidence interval [CI], 0.849–0.956) in the internal validation cohort and 0.873 (95% CI: 0.769–0.977) in the external validation cohort. In the external validation cohort, the performance of the PRIME score was significantly improved compared with that of the existing EuroSCORE II (NRI = 0.550, [95% CI 0.001–1.099], P = 0.049, IDI = 0.485, [95% CI 0.230–0.741], P < 0.001).

Conclusion: Machine learning-based model (the PRIME score) that integrate clinical, demographic, imaging, and laboratory features demonstrated superior performance for the prediction of mortality patients after mitral valve surgery compared with the traditional risk model EuroSCORE II.

Clinical Trial Registration: [http://www.clinicaltrials.gov], identifier [NCT05141292].

Introduction

Mitral valve disease is the most common valve disease, patients with severe valvular disease progress rapidly, leading to heart failure and even life-threatening (1, 2). Although the hemodynamics of patients can be corrected by valve surgery, not everyone benefits equally, and the mortality rate remains high among these patients. Careful evaluation of the risk of mortality plays a fundamental role in clinical management, with important implications for the management of personalized diagnosis and treatment (3).

The guidelines for the management of valvular heart disease recommend that risk prediction models be developed to assess personalized risk for patients undergoing valvular surgery (4, 5). To this aim, several risk prediction models have been developed to assess the risk of death in patients after valve surgery (68). Traditional risk scores have been developed and validated in surgical populations, primarily for patients undergoing coronary artery bypass grafting. These algorithms have been shown to overestimate the risk of mortality, particularly in the valvular subgroup, and there are limited data on risk assessment for patients with mitral valve disease (9, 10). Most studies predicted perioperative mortality after surgery (4); however, perioperative adverse events only accounted for a small proportion of the overall deaths, and with the improvement of surgical techniques, the perioperative event rate decreased significantly (11, 12). Therefore, the clinical need for a comprehensive prognostic assessment of patients undergoing mitral valve surgery (MVS) remains unmet.

The existing risk score, EuroSCORE II, is mainly based on clinical characteristics, surgical factors, and imaging features. In addition to these factors, hemodynamic abnormalities caused by valvular disease can lead to a series of complex pathophysiological processes that affect patient outcomes, such as inflammation, left ventricular volume overload, and left ventricular systolic dysfunction, which can be reflected by clinical laboratory indicators (4, 5). Machine learning may be a useful tool for comprehensive and personalized assessment of prognosis.

Current risk prediction models were developed using classic statistical modeling techniques constrained by assumptions such as distribution normality, non-informative or random censoring, and hazard risk linearity. Machine learning methods can overcome these limitations by capturing high-dimensional non-linear relationships among a large number of clinical features (13). The effectiveness of this approach has been demonstrated in several medical applications for cardiovascular diseases. For example, machine learning-based models for mortality in patients treated with cardiac resynchronization therapy and prediction of all-cause mortality in patients with suspected coronary artery disease (14, 15). However, few studies have evaluated the risk of mortality in patients after mitral valve surgery based on machine learning.

Therefore, we sought to develop a machine learning-based risk stratification model integrating clinical, demographic, imaging, and laboratory features to predict mortality in patients undergoing mitral valve surgery. We hypothesized that machine learning can capture the relationship between clinical characteristics and develop a risk stratification system to assess the mortality of patients undergoing mitral valve surgery.

Materials and Methods

Data Sets

To develop the machine learning models, we used a derivation cohort of 1,883 adult patients (≥18 years) who underwent mitral valve surgery in the Beijing Anzhen Hospital from January 2019 to December 2019. To assess the performance of the models, we used an external validation cohort that included 220 adult patients in the Chinese People’s Liberation Army General Hospital from January 2019 to December 2019. These patients were obtained from the Registry Study of Biomarkers in Mitral Valve Disease (BIOMS-MVD, NCT05141292).

The study protocol complied with the Declaration of Helsinki and was approved by the Beijing Anzhen Hospital Ethics Review Board, and data were routinely collected from a database of electronic medical records by a multicenter research platform.

The patients were diagnosed by echocardiography, and surgery was scheduled according to the 2017 ESC/EACTS Guidelines for the management of valvular heart disease (16). The doctor who performed the operation performs more than 25 mitral valve operations per year, or the surgeon’s unit has surgeons who perform 50 operations per year. We excluded patients who underwent mitral valve surgery at age ≤18 years, did not have full medical records, had >50% study data missing, and the patients after balloon dilation and perivalvular leakage repair who did not undergo cardiopulmonary bypass (Figure 1). The other included surgery is aortic surgery, aortic valve surgery, tricuspid valve repair surgery, radio-frequency ablation, combined coronary artery bypass grafting, ventricular septal repair, and atrial septal repair. Procedures for the inclusion and exclusion of patients are provided in Supplementary Methods 1.

FIGURE 1
www.frontiersin.org

Figure 1. Analysis overview for identifying best-performing risk prediction model.

Outcomes

The endpoint was all-cause mortality. We obtained outcome data from patient visits, medical records, and telephone interviews. The median follow-up time was 2 years, and the cut-off follow-up time point was December 31, 2021. A total of 230 patients were not provided with follow-up information due to lack of contact information or withdrawal.

Feature Selection and Data Preprocessing

Data quality control was performed before the data analysis. Candidate variables included the patient’s demographic and clinical characteristics, as well as imaging, surgical, and laboratory variables, with a total of 45 daily variables. The imaging and laboratory indexes obtained were the last test before discharge after valvular surgery. Each category of variables is detailed in Supplementary Methods 2. The predictive variables of EuroSCORE II included sex, age, chronic pulmonary disease, extracardiac arteriopathy, neurological dysfunction, previous cardiac surgery, serum creatinine, active endocarditis, critical preoperative state, unstable angina, recent myocardial infarct, pulmonary hypertension, left ventricular ejection fraction (LVEF), emergency, other than isolated CABG, surgery on thoracic aorta, and postinfarct septal rupture.

Model Development and Validation

The derivation cohort was randomly split into a training cohort and an internal validation cohort with a ratio of 70:30. We used 10 datasets for multiple imputation to handle missing values. The model was trained on each imputed dataset (Missing values are shown in Supplementary Tables 1, 2).

The model was developed by forward stepwise, backward stepwise, Lasso regression, and XGBoost methods to screen variables, and the logistic regression model was used for modeling. Receiver operating characteristic curves were used to estimate model discrimination by calculating the area under the curve (AUC). In the internal validation cohort, the best performance model (PRIME score) was chosen for further evaluation in the 220 external cohort. PRIME score were compared with the traditional model in terms of net reclassification improvement (NRI) and integrated discrimination improvement (IDI). As for the comparison between the developed model and existing risk strategies, the EuroSCORE II is mainly used as the prediction scoring model of mortality (4, 5).

Statistical Analysis

For continuous variables, normally distributed variables were represented by mean ± standard deviation, and non-normally distributed variables were represented by median (quartile range). Categorical variables were expressed as frequencies or percentages. Two groups of continuous variables were compared using the bilateral independent t-test or Wilcoxon test, and categorical variables were compared using the chi-square test or Fisher’s exact test and the Mann–Whitney U test. We analyzed the predictor variable effects using the odds ratio (OR) values and beta coefficients in the model. Kaplan–Meier estimates were used to construct survival curves based on all available follow-up data for time-to-event analysis. In addition, a nomogram was developed to predict individual mortality for each patient (Figure 2).

FIGURE 2
www.frontiersin.org

Figure 2. Nomogram. The nomogram is constructed according to the regression coefficient in the model, which is convenient for better clinical application. Blocking time, blocking time of the ascending aorta during surgery; BNP, brain natriuretic peptide; Cr, serum creatinine; CRP, C-reactive protein; Hb, hemoglobin; Neu, neutrophil count; PLT, platelet count; TNI, cardiac troponin I; LVEF, left ventricular ejection fraction.

Analyses were performed using Stata 15.1 (Stata Corp, College Station, TX, United States) and R v4.0.3 (R Foundation for Statistical Computing, Vienna, Austria; packages party, MASS, rms, missForest).

Results

The demographic, clinical, surgical, imaging, and laboratory characteristics of the study population are shown in Table 1. In the derivation cohort, 1,318 patients (70%) split into the training cohort and 565 patients (30%) into the internal validation cohort. In the derivation cohort 133 patients (7.06%) died by the mean median follow-up of 2 years (Table 1). In the external validation cohort, 17 patients (7.13%) died at a median follow-up of 2 years. The mean value of the internal validation cohort EuroSCORE II was 10.758 ± 2.408, and the external validation cohort EuroSCORE II was 4.164 ± 3.039.

TABLE 1
www.frontiersin.org

Table 1. Baseline characteristics of patients undergoing mitral valve surgery according to the derived cohort and validation cohort (n = 2,103)*.

Risk prediction models were developed by XGBoost, forward stepwise, backward stepwise, and Lasso regression in the training cohort. The beta coefficient and OR value of the different prediction models are shown in Table 2 and Supplementary Tables 35. The performance of the different models in the internal validation cohort is shown in Supplementary Figure 1.

TABLE 2
www.frontiersin.org

Table 2. Beta coefficients and odds ratios of the PRIME Score.

Predictive variables for the PRIME score included age, blocking time (The blocking time is time delta between the two time records of ascending aorta occlusion and re-perfusion simultaneously for each patient), creatinine, left ventricular ejection fraction (LVEF), neutrophils, C-reactive protein (CRP), Cardiac Troponin I (TNI), hemoglobin, B-type natriuretic peptide (BNP) and platelets. The beta coefficient and OR value of the model are shown in Table 2. Leading predictors varied according to the study outcomes of the overall population (Figure 3). A nomogram was constructed according to the regression coefficients in the model for clinical use, such as in information sharing and decision making for both clinicians and patients (Figure 2).

FIGURE 3
www.frontiersin.org

Figure 3. Radar chart of the 10 most important predictors of poor prognosis screened by the PRIME score. For each important predictor, standardized beta coefficients of overall population are shown. Blocking time, blocking time of the ascending aorta during surgery; BNP, brain natriuretic peptide; Cr, serum creatinine; CRP, C-reactive protein; Hb, hemoglobin; Neu, neutrophil count; PLT, platelet count; TNI, cardiac troponin I; LVEF, left ventricular ejection fraction.

The AUC of EuroSCORE II was 0.768 (95% CI [confidence interval]: 0.699–0.838) in the internal validation cohort and 0.654 (95% CI: 0.514–0.795) in the external validation cohort. The PRIME score achieved an AUC of 0.902 (95% CI: 0.849–0.956) in the internal validation cohort, which was better than the EuroSCORE II (P = 0.001). When applied to the external validation cohort, the AUC was 0.873 (95% CI: 0.769–0.977), which was also better than the EuroSCORE II (P = 0.006) (Figure 4). The mortality were assessed in four subgroups quartile by EuroSCORE II (shown in Supplementary Figure 2). The PRIME score demonstrated robust performance in different risk subgroup patients divided by EuroSCORE II, highlighting its generalizability across different risk settings. In addition, compared with the EuroSCORE II, the performance of the model in reclassification and recognition was significantly improved in the externally validated cohort (NRI = 0.550, [95% CI 0.001–1.099], P = 0.049, IDI = 0.485, [95% CI 0.230–0.741], P < 0.001) (Table 3).

FIGURE 4
www.frontiersin.org

Figure 4. Performance evaluation of internal validation cohort and external verification cohort on the PRIME score and verification of EuroSCORE II. (A) The area under the receiver operating characteristic (ROC) curves showed that the area under the curve (AUC) of all-cause death in the internal validation cohort of the PRIME score was 0.9021 (95% confidence interval [CI]: 0.8487–0.9555), which was better than that of EuroSCORE II (P = 0.0011). (B) The area under the ROC curve showed that the prime score with AUC of 0.8730 (95% CI: 0.7690–0.9770) in the external validation cohort was also better than EuroSCORE II (P = 0.0062).

TABLE 3
www.frontiersin.org

Table 3. Improved model performance over the EuroSCORE II.

The mean PRIME risk score of the internal and external validation cohorts were 0.069 ± 0.122 and 0.124 ± 0.244, respectively. The PRIME score effectively stratifies the risk of all-cause mortality into low-risk, medium-risk, and high-risk subsets. As shown in the Kaplan–Meier curves, the internal and external validation cohorts showed significant differences in mortality among the three risk assessment subgroups, significant differences in 2-year mortality (P < 0.001), and a significant increase in mortality rates was observed in the high-risk group (Figure 5).

FIGURE 5
www.frontiersin.org

Figure 5. Kaplan–Meier Estimates of mortality for internal validation cohort and external verification cohort. The survival rate was observed using the Kaplan–Meier curve and compared using the log-rank test. (A) Kaplan–Meier estimated the survival rate of the internal validation cohort using the PRIME score. (B) Kaplan–Meier estimated the survival rate of the external validation cohort using the PRIME score. As shown by the Kaplan–Meier curve, the two cohorts showed significant differences in mortality among the three risk score groups (P < 0.0001).

Discussion

In this study, we used data from 2,103 patients discharged after mitral valve surgery to develop and validate a machine learning-based risk prediction system, using the PRIME score, to predict the risk of mortality. We identified predictive variables from routine clinical data to generate a risk prediction model. We found that the PRIME score presented excellent discriminative abilities for the prediction of all-cause mortality. Compared with pre-existing risk score, the PRIME score had improved discriminatory power and predictive range for all-cause mortality. In addition, the PRIME score was able to identify patients with a significantly increased risk of all-cause mortality throughout the follow-up period.

Simultaneous interpretation of the myriad risk predictors for individual patients is a challenge for clinicians. The complexity of the assessment is increased by the large number of clinical variables that need to be considered in relation to mortality, which makes it more difficult for clinicians to draw overall conclusions about the risks for individual patients. In addition, the potential effects of complex and hidden interactions between several weaker predictors are often overlooked. In this study, we demonstrate that machine learning can overcome these challenges by utilizing complex high-level interactions. We aimed to develop a accurate risk stratification system integrating high-dimensional and features to predict mortality. XGBoost, lasso and stepwise regression are all widely used variable selection methods based on different mathematical theories. XGBoost algorithm was employed due to its state-of-the-art accuracy and interpretability (17). LASSO was used for it is a popular method for regression with high-dimensional predictors. This approach has been extended and broadly applied for survival analysis with high-dimensional data (18). We used the methods to filter the predictive variables. In addition, logistic regression was used for risk model building to solve the binary classification problems in this study (19). Therefore, we used the methods for selecting the variables and constructing the risk model, and chose the best performance model named the PRIME score.

The PRIME score has improved the ability and predictive range of all-cause mortality due to the explainable predictive variables that reflect individual pathophysiological factors. Age factors have an impact on the postoperative prognosis, such as decreased physiological reserve, resistance to stressors, and increased vulnerability (20). Second, chronic renal insufficiency causes myocardial damage caused by cardiac structure and function changes, which seriously affects the patient’s prognosis. Patients should reduce creatinine levels by reducing the use of contrast agents, using renal protective measures, and more aggressive intermittent renal replacement therapy to protect kidney function (21). Third, the LVEF is related to the contractility of the myocardium. Patients with myocardial systolic dysfunction should control the volume load and take drugs that can improve the myocardial systolic function (22, 23). The aspects mentioned above are all mentioned in traditional scoring, while the new variables include surgical procedures such as blocking time and pathological indicators reflecting different pathophysiological states. Fourth, the blocking time of the ascending aorta during surgery has a great influence on myocardial injury in patients undergoing valve surgery, and it is important to control the aortic clamp for valve surgery (24). Fifth, laboratory indicators reflecting pathophysiological states lead to different postoperative outcomes in individual patients (25). With the decrease of hemoglobin in patients, the blood oxygen-carrying capacity is reduced, and the myocardium requires a larger cardiac output to compensate and maintain its function, resulting in ventricular remodeling and dysfunction (26, 27). The rapid or continuous decrease in platelet count in a short period of time often indicates the possibility of acute platelet dysfunction and poor prognosis (28). Bleeding should be controlled as much as possible during surgery. If a decrease in hemoglobin and platelet levels is found, the etiology should be actively sought and timely intervention should be performed. The levels of neutrophils and C-reactive protein reflect the inflammatory state of the body and the degree of damage to myocardial tissue, which is a fast and simple method to evaluate the inflammatory state and a predictor of cardiovascular risk. Monitoring and controlling inflammation in the diagnosis and treatment of valve patients is crucial for patient prognosis (29). BNP reflects the volumetric load of the left ventricle; patients with elevated BNP levels should control fluid intake and use diuretics according to symptoms to reduce water and sodium retention, which can exacerbate heart failure and lead to poor prognosis (30). Increased troponin I (TnI) levels are associated with a higher risk of death, and patients with high TnI levels should shorten the follow-up period and have regular observation (31).

In summary, the predictive variables included in the PRIME score reflect the combined effects of the system pathological state. With respect to the weights of variables and their contributions to the model, it can be inferred that variables with relatively high weights reflect inherent pathophysiology and are in good agreement with clinical outcomes.

Strengths

The main advantage of our study, is that compared with the existing risk strategy EuroSCORE II, the PRIME score uses fewer predictive variables, can comprehensively combine demographic characteristics, complications, surgical, and pathophysiological factors, better predict mortality in patients undergoing mitral valve surgery, and may reduce the risk of death by monitoring and controlling these risk factors.

Limitations

This study had several limitations. First, the data used in this study were from two central cohorts, and although the PRIME score was validated in external cohorts, further exploration should be provided in other less controlled settings. Second, the weights of some of the risk factors considered in the model may change over time, and the follow-up period should be extended for validation. Third, this study was retrospective and could be performed prospectively. Finally, our scoring requires manual input and calculation steps, such as being linked to an electronic medical record system to automatically calculate the risk score; avoiding the process of manual calculation and potentially increasing the use of the model in clinical practice could further improve this scoring system.

Conclusion

Using daily clinical variables, we established and validated a machine-learning-based personalized risk prediction model for the mortality of patients undergoing mitral valve surgery. This study showed that the machine learning-based method is feasible and effective, with potentially important implications for the management of patients.

Data Availability Statement

The original contributions presented in the study are included in the article/Supplementary Material, further inquiries can be directed to the corresponding author/s.

Ethics Statement

Written informed consent was obtained from the individual(s) for the publication of any potentially identifiable images or data included in this article.

Author Contributions

NZ conceptualized the study, carried out the analyses, and drafted the initial manuscript. ZJ participated in the establishment and judgment of the multi-center cohort, made suggestions for medical records of patients, and revised the manuscript in this study. YW and RD conceptualized the study, supervised the analyses, and reviewed and revised the manuscript. JD conceptualized the study, supervised the analyses, reviewed and revised the manuscript, and was responsible for the administration of the BIOMS-MVD registry study. YL and YZ conducted data collection and statistical analysis. PG supervised the analyses and reviewed the manuscript. RL, KZ, SL, and WJ collected the data and conducted the literature search. FL and BQ conceptualized the study and reviewed the manuscript. All authors were involved in the manuscript review and agreed to be accountable for the content of the work.

Funding

This study was supported by the National Natural Science Foundation of China (Grant No. 81861128025) and Beijing Advanced Innovation Center for Big Data-Based Precision Medicine (PXM2021_014226_000026).

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Acknowledgments

We thank Peijie Yu, Meng Yuan, Hui Ni, Xueyan Peng, and Kai Wang from the Beijing Institute of Heart, Lung and Blood Vessel Diseases for helping with the collection of clinical data. We also thank Haichu Wen from the Beijing Institute of Heart, Lung and Blood Vessel Diseases for helping modifying the language of this article.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fcvm.2022.866257/full#supplementary-material

References

1. Nishimura RA, Vahanian A, Eleid MF, Mack MJ. Mitral valve disease–current management and future challenges. Lancet. (2016) 387:1324–34. doi: 10.1016/S0140-6736(16)00558-4

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Maltais S, Anwer LA, Daly RC, Poddi S, Topilsky Y, Enrique-Sarano M, et al. Robotic mitral valve repair: indication for surgery does not influence early outcomes. Mayo Clin Proc. (2019) 94:2263–9. doi: 10.1016/j.mayocp.2019.05.025

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Rosenhek R, Iung B, Tornos P, Antunes MJ, Prendergast BD, Otto CM, et al. ESC working group on valvular heart disease position paper: assessing the risk of interventions in patients with valvular heart disease. Eur Heart J. (2012) 33:822–8; 828a; 828b. doi: 10.1093/eurheartj/ehr061

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Otto CM, Nishimura RA, Bonow RO, Carabello BA, Erwin JP III, Gentile F, et al. 2020 ACC/AHA guideline for the management of patients with valvular heart disease: executive summary: a report of the American college of cardiology/American heart association joint committee on clinical practice guidelines. Circulation. (2021) 143:e35–71.

Google Scholar

5. Vahanian A, Beyersdorf F, Praz F, Milojevic M, Baldus S, Bauersachs J, et al. ESC/EACTS guidelines for the management of valvular heart disease. Eur Heart J. (2022) 43:561–632.

Google Scholar

6. Nilsson J, Algotsson L, Hoglund P, Luhrs C, Brandt J. Comparison of 19 pre-operative risk stratification models in open-heart surgery. Eur Heart J. (2006) 27:867–74. doi: 10.1093/eurheartj/ehi720

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Thourani VH, Badhwar V, Shahian DM, Edwards FH, O’Brien S, Habib RH, et al. The society of thoracic surgeons adult cardiac surgery database: 2017 update on research. Ann Thorac Surg. (2017) 104:22–8. doi: 10.1016/j.athoracsur.2017.05.013

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Nashef SA, Roques F, Michel P, Gauducheau E, Lemeshow S, Salamon R. European system for cardiac operative risk evaluation (EuroSCORE). Eur J Cardio Thorac Surg. (1999) 16:9–13. doi: 10.1016/s1010-7940(99)00134-7

CrossRef Full Text | Google Scholar

9. Siregar S, Groenwold RH, de Heer F, Bots ML, van der Graaf Y, van Herwerden LA. Performance of the original EuroSCORE. Eur J Cardio Thorac Surg. (2012) 41:746–54.

Google Scholar

10. Mack MJ. Risk scores for predicting outcomes in valvular heart disease: how useful? Curr Cardiol Rep. (2011) 13:107–12. doi: 10.1007/s11886-010-0167-9

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Lantelme P, Eltchaninoff H, Rabilloud M, Souteyrand G, Dupre M, Spaziano M, et al. Development of a risk score based on aortic calcification to predict 1-year mortality after transcatheter aortic valve replacement. JACC Cardiovasc Imaging. (2019) 12:123–32. doi: 10.1016/j.jcmg.2018.03.018

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Schneiderman LJ, Jecker NS, Jonsen AR. Medical futility: its meaning and ethical implications. Ann Intern Med. (1990) 112:949–54. doi: 10.7326/0003-4819-112-12-949

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Schwalbe N, Wahl B. Artificial intelligence and the future of global health. Lancet. (2020) 395:1579–86. doi: 10.1016/s0140-6736(20)30226-9

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Tokodi M, Schwertner WR, Kovacs A, Toser Z, Staub L, Sarkany A, et al. Machine learning-based mortality prediction of patients undergoing cardiac resynchronization therapy: the SEMMELWEIS-CRT score. Eur Heart J. (2020) 41:1747–56. doi: 10.1093/eurheartj/ehz902

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Motwani M, Dey D, Berman DS, Germano G, Achenbach S, Al-Mallah MH, et al. Machine learning for prediction of all-cause mortality in patients with suspected coronary artery disease: a 5-year multicentre prospective registry analysis. Eur Heart J. (2017) 38:500–7. doi: 10.1093/eurheartj/ehw188

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Baumgartner H, Falk V, Bax JJ, De Bonis M, Hamm C, Holm PJ, et al. 2017 ESC/EACTS guidelines for the management of valvular heart disease. Eur Heart J. (2017) 38:2739–91.

Google Scholar

17. Al’Aref SJ, Maliakal G, Singh G, van Rosendael AR, Ma X, Xu Z, et al. Machine learning of clinical variables and coronary artery calcium scoring for the prediction of obstructive coronary artery disease on coronary computed tomography angiography: analysis from the CONFIRM registry. Eur Heart J. (2020) 41:359–67. doi: 10.1093/eurheartj/ehz565

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Zhang JX, Song W, Chen ZH, Wei JH, Liao YJ, Lei J, et al. Prognostic and predictive value of a microRNA signature in stage II colon cancer: a microRNA expression analysis. Lancet Oncol. (2013) 14:1295–306. doi: 10.1016/S1470-2045(13)70491-1

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Meurer W, Tolles J. Logistic regression diagnostics: understanding how well a model predicts outcomes. JAMA. (2017) 317:1068–9. doi: 10.1001/jama.2016.20441

PubMed Abstract | CrossRef Full Text | Google Scholar

20. McDonagh J, Ferguson C, Newton PJ. Frailty assessment in heart failure: an overview of the multi-domain approach. Curr Heart Fail Rep. (2018) 15:17–23. doi: 10.1007/s11897-018-0373-0

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Rihal CS, Kashani KB. Prevention of acute kidney injury with the renalguard system in patients undergoing transcatheter aortic valve replacement: the PROTECT-TAVI trial (PROphylactic effecT of furosEmide-induCed diuresis with matched isotonic intravenous hydraTion in transcatheter aortic valve implantation). JACC Cardiovasc Interv. (2015) 8:1605–7. doi: 10.1016/j.jcin.2015.08.007

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Enriquez-Sarano M, Tajik AJ, Schaff HV, Orszulak TA, McGoon MD, Bailey KR, et al. Echocardiographic prediction of left ventricular function after correction of mitral regurgitation: results and clinical implications. J Am Coll Cardiol. (1994) 24:1536–43. doi: 10.1016/0735-1097(94)90151-1

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Enriquez-Sarano M, Tajik AJ, Schaff HV, Orszulak TA, Bailey KR, Frye RL. Echocardiographic prediction of survival after surgical correction of organic mitral regurgitation. Circulation. (1994) 90:830–7. doi: 10.1161/01.cir.90.2.830

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Moss RR, Humphries KH, Gao M, Thompson CR, Abel JG, Fradet G, et al. Outcome of mitral valve repair or replacement: a comparison by propensity score analysis. Circulation. (2003) 108(Suppl. 1):II90–7. doi: 10.1161/01.cir.0000089182.44963.bb

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Nishimura RA, Otto CM, Bonow RO, Carabello BA, Erwin JP III, Guyton RA, et al. 2014 AHA/ACC guideline for the management of patients with valvular heart disease: a report of the American college of cardiology/American heart association task force on practice guidelines. J Am Coll Cardiol. (2014) 63:e57–185.

Google Scholar

26. Sarnak MJ, Tighiouart H, Manjunath G, MacLeod B, Griffith J, Salem D, et al. Anemia as a risk factor for cardiovascular disease in the atherosclerosis risk in communities (ARIC) study. J Am Coll Cardiol. (2002) 40:27–33. doi: 10.1016/s0735-1097(02)01938-1

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Horwich TB, Fonarow GC, Hamilton MA, MacLellan WR, Borenstein J. Anemia is associated with worse symptoms, greater impairment in functional capacity and a significant increase in mortality in patients with advanced heart failure. J Am Coll Cardiol. (2002) 39:1780–6. doi: 10.1016/s0735-1097(02)01854-5

CrossRef Full Text | Google Scholar

28. Dvir D, Genereux P, Barbash IM, Kodali S, Ben-Dor I, Williams M, et al. Acquired thrombocytopenia after transcatheter aortic valve replacement: clinical correlates and association with outcomes. Eur Heart J. (2014) 35:2663–71. doi: 10.1093/eurheartj/ehu082

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Soeki T, Sata M. Inflammatory biomarkers and atherosclerosis. Int Heart J. (2016) 57:134–9. doi: 10.1536/ihj.15-346

PubMed Abstract | CrossRef Full Text | Google Scholar

30. Chen S, Redfors B, O’Neill BP, Clavel MA, Pibarot P, Elmariah S, et al. Low and elevated B-type natriuretic peptide levels are associated with increased mortality in patients with preserved ejection fraction undergoing transcatheter aortic valve replacement: an analysis of the PARTNER II trial and registry. Eur Heart J. (2020) 41:958–69. doi: 10.1093/eurheartj/ehz892

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Jia X, Sun W, Hoogeveen RC, Nambi V, Matsushita K, Folsom AR, et al. High-sensitivity troponin I and incident coronary events, stroke, heart failure hospitalization, and mortality in the ARIC study. Circulation. (2019) 139:2642–53. doi: 10.1161/circulationaha.118.038772

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: mitral valve surgery, machine learning, risk stratification, personalized risk prediction, mortality

Citation: Zhou N, Ji Z, Li F, Qiao B, Lin R, Jiang W, Zhu Y, Lin Y, Zhang K, Li S, You B, Gao P, Dong R, Wang Y and Du J (2022) Machine Learning-Based Personalized Risk Prediction Model for Mortality of Patients Undergoing Mitral Valve Surgery: The PRIME Score. Front. Cardiovasc. Med. 9:866257. doi: 10.3389/fcvm.2022.866257

Received: 31 January 2022; Accepted: 01 March 2022;
Published: 01 April 2022.

Edited by:

Junjie Xiao, Shanghai University, China

Reviewed by:

Ding Ai, Tianjin Medical University, China
Yuling Zhang, Sun Yat-sen Memorial Hospital, China

Copyright © 2022 Zhou, Ji, Li, Qiao, Lin, Jiang, Zhu, Lin, Zhang, Li, You, Gao, Dong, Wang and Du. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Ran Dong, dongran6618@hotmail.com; Yuan Wang, wangyuan980510@163.com; Jie Du, jiedu@ccmu.edu.cn

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.