- 1Department of Nephrology, First Medical Center of Chinese PLA General Hospital, National Key Laboratory of Kidney Diseases, National Clinical Research Center for Kidney Diseases, Beijing Key Laboratory of Kidney Diseases Research, Beijing, China
- 2School of Clinical Medicine, Guangdong Pharmaceutical University, Guangzhou, China
- 3Medical Innovation Research Division of Chinese PLA General Hospital, Beijing, China
- 4National Engineering Research Center of Medical Big Data, PLA General Hospital, Beijing, China
Introduction: Cardiovascular disease (CVD) is the leading cause of death in patients with chronic kidney disease (CKD). This study aimed to develop CVD risk prediction models using machine learning to support clinical decision making and improve patient prognosis.
Methods: Electronic medical records from patients with CKD at a single center from 2015 to 2020 were used to develop machine learning models for the prediction of CVD. Least absolute shrinkage and selection operator (LASSO) regression was used to select important features predicting the risk of developing CVD. Seven machine learning classification algorithms were used to build models, which were evaluated by receiver operating characteristic curves, accuracy, sensitivity, specificity, and F1-score, and Shapley Additive explanations was used to interpret the model results. CVD was defined as composite cardiovascular events including coronary heart disease (coronary artery disease, myocardial infarction, angina pectoris, and coronary artery revascularization), cerebrovascular disease (hemorrhagic stroke and ischemic stroke), deaths from all causes (cardiovascular deaths, non-cardiovascular deaths, unknown cause of death), congestive heart failure, and peripheral artery disease (aortic aneurysm, aortic or other peripheral arterial revascularization). A cardiovascular event was a composite outcome of multiple cardiovascular events, as determined by reviewing medical records.
Results: This study included 8,894 patients with CKD, with a composite CVD event incidence of 25.9%; a total of 2,304 patients reached this outcome. LASSO regression identified eight important features for predicting the risk of CKD developing into CVD: age, history of hypertension, sex, antiplatelet drugs, high-density lipoprotein, sodium ions, 24-h urinary protein, and estimated glomerular filtration rate. The model developed using Extreme Gradient Boosting in the test set had an area under the curve of 0.89, outperforming the other models, indicating that it had the best CVD predictive performance.
Conclusion: This study established a CVD risk prediction model for patients with CKD, based on routine clinical diagnostic and treatment data, with good predictive accuracy. This model is expected to provide a scientific basis for the management and treatment of patients with CKD.
1 Introduction
Chronic kidney disease (CKD) affects more than 10% of the global population and is closely associated with increases in the incidence and mortality rates of cardiovascular disease (CVD) (1, 2). Therefore, effective prediction and management of the cardiovascular risk in this group are of paramount importance (3).
However, there are few established prediction tools developed specifically for this population, and classical models, such as the Framingham prediction model and the Systematic Coronary Risk Evaluation (SCORE) tool, perform poorly in patients with CKD (4–6). Hence, predicting the risk of cardiovascular events in patients with CKD is an important research area that still requires refinement and the development of more accurate and reliable prediction tools tailored for patients with CKD.
After conducting a literature review, we identified several modeling techniques commonly used in predictive modeling tasks. These include Logistic Regression (LR), Cox Model, Support Vector Machine (SVM), Random Forest (RF), K-Nearest Neighbor (KNN), Extreme Gradient Boosting (XGBoost), and Back propagation Neural Network (BPNN). Of note, XGBoost has emerged as a prevalent machine learning method that has demonstrated effective outcomes in various risk prediction models.Zelnick et al. (7) used a predictive model developed using gradient boosting machines, which demonstrated superior performance in forecasting atrial fibrillation events among patients with CKD compared to previously published predictive models.
This study utilized data from patients’ medical records to identify risk factors associated with cardiovascular events in patients with CKD. Subsequently, machine learning was employed to construct artificial intelligence models to predict disease occurrence and assist clinicians in the timely detection of cardiovascular events.
2 Materials and methods
2.1 Study population
This was a single-center retrospective study of data sourced from the electronic medical record system of a large tertiary hospital for inpatients with CKD at the Chinese People’s Liberation Army general Hospital(PLAGH). Data were collected from patients who received treatment at the Nephrology Department of the PLAGH between January 1, 2015, and December 31, 2020, totaling 8,894 cases. The inclusion criteria were as follows (1): diagnosis of CKD according to the 2012 Kidney Disease: Improving Global Outcomes guidelines or a clinical diagnosis of CKD; (2) age ≥18 years; and (3) complete data on key clinical indicators including creatinine and routine urine indicators. Patients with acute kidney failure were excluded.
This study was approved by the Ethics Committee of the General Hospital of the Chinese People’s Liberation Army (S2021–696-01). The study was conducted in accordance with the Declaration of Helsinki and was approved by the ethics committee, the informed consent may be exempted from signing.
2.2 Definitions
2.2.1 Study outcome
CVD was defined as a composite of cardiovascular events, including coronary heart disease (coronary artery disease, myocardial infarction, angina pectoris, and coronary artery revascularization), cerebrovascular disease (hemorrhagic stroke and ischemic stroke), death from all causes (cardiovascular death, non-cardiovascular death, and unknown cause of death), congestive heart failure, and peripheral artery disease (aortic aneurysm, aortic, or other peripheral arterial revascularization) (8–10). A cardiovascular event was defined as a composite outcome of multiple cardiovascular events, as determined by reviewing medical records.
2.2.2 Other definitions
The specific definition of CKD depended primarily on the pathological diagnosis of biopsy findings in the medical records, on a clinical diagnosis by a nephrologist, or according to the Kidney Disease Outcomes Quality Initiative (KDOQI) guidelines, which define renal injury as an estimated glomerular filtration rate (eGFR)<60 mL/min/1.73 m² for 3 months or more. Renal injury was defined as the presence of pathological abnormalities or injury markers, including abnormal blood or urine test results, or imaging findings. The eGFR was calculated using the Chronic Kidney Disease Epidemiology Collaboration equation (11).
2.3 Clinical data extraction
We collected patients’ demographic information, vital signs, and clinical data, including the following: age, sex, history of hypertension, C-reactive protein, serum creatinine (SCr), eGFR, blood urea nitrogen (BUN), total cholesterol, triglycerides, high-density lipoprotein (HDL), low-density lipoprotein, serum cystatin C, serum albumin, hemoglobin, blood potassium, blood sodium, blood calcium, blood chlorine, blood phosphorus, blood magnesium, plasma D-dimer, interleukin 6 activated partial thromboplastin time, prothrombin time, and medication treatment measures, including whether antiplatelet drugs were taken. The 24-h urine protein, body mass index (BMI), neutrophil and lymphocyte ratio, monocyte count/lymphocyte ratio, platelet count/lymphocyte ratio, and platelet count × (neutrophil/lymphocyte count) were also calculated using information from the medical records.
2.4 Statistical analysis
Data were computed and statistically analyzed using software SPSS version 26, R software version 4.3.2, and Python version 3.4. Variables with >25% missing values were excluded, and missing data were imputed using the KNN. For continuous variables, comparisons were made using Student’s t-test (for normally distributed variables) or the Wilcoxon rank-sum test (for non-normally distributed variables). Continuous variables conforming to normal or approximately normal distributions were expressed as mean ± standard deviation and were compared using the t-test. Continuous variables not conforming to normal distributions were expressed as median (M) (quartile 1 [Q1], quartile [Q3]) and were compared using the Mann–Whitney U test. Categorical variables were described using counts (%), and comparisons were made using the chi-square test. A P-value<0.05 was considered significant.
2.5 Data augmentation
Data augmentation was used to balance the number of patients with and without CVD, with 6,640 cases each. To address data imbalance, we employed the synthetic minority over-sampling technique (12) for data augmentation.
2.6 Model construction
The dataset was divided into training and testing sets in an 8:2 ratio. Least absolute shrinkage and selection operator (LASSO) regression analysis was used to select variables that could predict CVD risk. After a thorough literature search, we carefully selected the currently used modeling methods. Seven models were built using machine learning including LR, Naive Bayes (NB), KNN, XGBoost, RF, and Back propagation neural network (BPNN) to evaluate the model performance.
2.7 Evaluation metrics for machine learning
Receiver operating characteristic (ROC) curves were drawn to assess the model performance using the accuracy, sensitivity, specificity, F1-score (13) and area under the curve (AUC) as indicators to evaluate the model’s ability to predict cardiovascular events. The formulas for the model evaluation index are as follows: where TP represents the number of true positives; FP, number of false positives; FN, number of false negatives; and TN, number of true negatives.
These indicators were used to validate the results, evaluate their ability to predict cardiovascular events, and select the best model.
2.8 Model interpretation
Shapley Additive explanations (SHAP) was used to interpret the model results. SHAP (14) values are used to explain the output of any machine learning model by quantifying the impact of each feature on the prediction.
3 Results
3.1 Study population
Data from 8,894 patients with CKD were collected; patients were divided based on the presence (n=2,304) or absence (n=6,640) of CVD. As there was an imbalance in the data, data augmentation was used to balance the number of patients with or without CVD to 6,640 cases each. The dataset was divided into a training set (n=10,624) and a testing set (n=2,656) at an 8:2 ratio. Data collected from the training dataset were used to evaluate important variables related to CVD and to establish prediction models. The data from the test set was utilized to assess the performance of the prediction models trained on the training set. The data collection process is illustrated in Figure 1.
![www.frontiersin.org](https://www.frontiersin.org/files/Articles/1390729/fendo-15-1390729-HTML/image_m/fendo-15-1390729-g001.jpg)
Figure 1 Flowchart of participant screening. CKD, chronic kidney diseases; CVD, cardiovascular disease.
3.2 Clinical characteristics of the included patients
As shown in Table 1, a total of 13,280 patients were enrolled in the study following data augmentation. The median age of the participants was 52 years. Among them, 69.1% were male, and 30.9% were female. The incidence of composite CVD events was 50% (6640/13280), with 6,640 patients reaching the outcome. The average age of patients with CVD was significantly higher than that of patients without cardiovascular disease. BMI and prevalence of hypertension were higher in the CVD group than in the non-CVD group. The proportion of males was significantly higher in the CVD group. Nearly all laboratory indicators including hemoglobin, SCr, eGFR, 24-h urinary protein, HDL, BUN, and inflammatory markers such as the neutrophil-to-lymphocyte ratio were significantly different between the CVD and non-CVD groups (P<0.05).
3.3 Feature selection
LASSO regression was used to select the important variables associated with CVD. The optimal parameter (lambda) in the LASSO regression model was determined using five-fold cross-validation. A dotted vertical line was drawn at the value of lambda that represents the best trade-off according to the minimum criterion, and another at the most regularized model within one standard error of the minimum (Figure 2A), while a vertical line was drawn at the value selected by five-fold cross-validation, where the optimal lambda produced eight features with non-zero coefficients (Figure 2B). Eight variables were found to be predictors of CVD occurrence (Figure 2), with the corresponding model risk factors being age, history of hypertension, sex, antiplatelet medication, HDL, sodium, 24-h urinary protein, and eGFR.
![www.frontiersin.org](https://www.frontiersin.org/files/Articles/1390729/fendo-15-1390729-HTML/image_m/fendo-15-1390729-g002.jpg)
Figure 2 Features selection using the LASSO binomial regression model. LASSO, least absolute shrinkage and selection operator. (A) The partial likelihood deviance (binomial deviance) curve was plotted versus log (lambda).LASSO coefficient profiles of the 31 baseline features. (B) Tuning parameter (A) selection in the LASSO model used 5-fold cross validation via minimum criteria variable selection. LASSO coefficient profiles of the 8 features.
3.4 Model construction and evaluation
We evaluated seven machine-learning models for predicting CVD using training and testing datasets, including the SVM, LR, NB, KNN, XGBoost, RF, and BPNN to evaluate model performance. The training set was used to train the models, and the testing set was used to test their accuracy and generalizability. The performances of the different models is shown in Figure 3 and Table 2. The test set had the following AUC values: SVM algorithm, 0.817; LR model, 0.817; KNN, 0.784 (lowest AUC); RF, 0.829; BPNN, 0.808; and NB algorithm, 0.796; and XGBoost algorithm, 0.893. The XGBoost model had the highest AUC, which was significantly higher than that of the other models. This indicates a good ability to distinguish between the presence and absence of CVD. Besides, the XGBoost model exhibited the highest accuracy (0.806), specificity (0.8), and F1 score (0.806), which suggests that it is the best performing model among those listed. The ranking of this CVD prediction model as one of the best models indicates that it has strong predictive ability and can be used in clinical settings.
![www.frontiersin.org](https://www.frontiersin.org/files/Articles/1390729/fendo-15-1390729-HTML/image_m/fendo-15-1390729-g003.jpg)
Figure 3 Performance of 7 types of predicting models of training dataset (A) and testing dataset (B); SVM, support vector machine; Log Reg, logistic regression; XGBoost, extreme gradient boosting; KNN, k-nearest neighbor neighbor; NB, naïve Bayesian; RF, Random Forest; BPNN, Backpropagation Neural Network.
3.5 Model interpretation
SHAP was used to interpret the predictions of the XGBoost machine learning model by calculating the contribution of each feature to the CVD prediction (14). Figure 4B shows the rankings of the top eight risk factors; the importance decreases with age, history of hypertension, sex, 24-h urinary protein, antiplatelet medication, eGFR, sodium, and HDL. Age was found to be the most influential feature, followed by history of hypertension and sex, which had the strongest predictive impact on the model. SHAP summary plots (Figures 4A, 5) were used to visually represent the impact of each variable on the model’s output. The position of the SHAP value (x-axis) indicates the impact of the feature on prediction, with each point representing a sample, and the redder (bluer) color indicating higher (lower) feature values. If the SHAP value increases with an increase in the feature value, it indicates a positive correlation between the feature and the predicted outcome; otherwise, it indicates a negative relationship (Figures 4A, 5). The results show that for age, history of hypertension, being male, and a lower GFR, many patients’ SHAP distributions are positive, indicating that an increase in age, having a history of hypertension, being male, and lower eGFR increase the risk of cardiovascular events. Higher levels of HDL and the use of antiplatelet medications reduce the risk of cardiovascular events. The prediction results of the XGBoost model are displayed using a confusion matrix, where the positive predictive value is 80.7% and the negative predictive value is 80.5% (Figure 6).
![www.frontiersin.org](https://www.frontiersin.org/files/Articles/1390729/fendo-15-1390729-HTML/image_m/fendo-15-1390729-g004.jpg)
Figure 4 (A) SHAP summary plot in XGBoost model with 8 variables. (B) A importance matrix plot of the XGBoost.
4 Discussion
This study retrospectively analyzed clinical data from the electronic medical records of 8,894 Chinese patients with CKD and successfully constructed a risk prediction model for the occurrence of CVD in these patients. To our knowledge, this is the first large-sample risk prediction model for cardiovascular events in CKD based on a Chinese population using clinical indicators, including adult patients with CKD. The demographic characteristics of these patients, including age and sex, were representative of patients with CKD, showing good model efficacy and a strong clinical application value.
Previous studies have explored the construction of prediction models for CVD in CKD (15–18). R. Avram et al. conducted a cohort study in which elastic net regression was employed to develop a proteomic risk model for predicting cardiovascular risk among 2,182 participants from a chronic kidney dysfunction cohort (19), with AUC values ranging from 0.84 to 0.89 over 1 to 10 years, yet the clinical model performed poorly, with AUCs between 0.70 and 0.73. In addition, the Chronic Renal Insufficiency Cohort study constructed a 10-year atherosclerotic cardiovascular disease risk prediction model for patients with CKD( (20)); the AUC of the Chronic Renal Insufficiency Cohort model developed using clinically available variables was 0.760, which targeted atherosclerotic cardiovascular disease and not composite cardiovascular events. A cohort study aimed to predict atrial fibrillation events in CKD with models developed using machine learning methods in the CKD population, which were compared to previously published prediction models; however, the C-index of the model using clinical variables was only 0.67 (7).
This study utilized clinical variables to construct a risk prediction model for cardiovascular events in CKD with superior performance. Among the seven machine learning models, most artificial intelligence models have shown a higher predictive performance than traditional LR and Cox regression models. Artificial Neural Networks (21) are highly suitable for extensive datasets rich in sequential and unstructured features, requiring the estimation of a large number of parameters, and thus necessitating substantial data to avoid overfitting. Machine learning, using routine clinical data, can accurately predict CVD in CKD. For this study, which primarily involves straightforward numerical variables, simpler machine learning models would be more appropriate. XGBoost, developed from RF, is not affected by multicollinearity and is characterized by its flexibility and efficiency.
In our study, we compared the performance of prediction models generated by seven machine learning algorithms and used the XGBoost ensemble machine learning method to construct the model. The results showed that the model had the highest AUC (0.89), sensitivity, and F1 score, indicating a good predictive effect on the risk of CVD in patients with CKD. This may be due to the effectiveness of XGBoost in handling complex patterns for disease prediction, outperforming other models.
Machine learning is often referred to as a “black box.” To explain the decision-making process of the XGBoost model algorithm, we employed the SHAP visualization method to interpret our predictions (14). The combination of machine learning and SHAP can provide clear explanations for individualized risk predictions and allow doctors to intuitively understand the impact of key features in the model (22). This study explained the contribution of the model and risk factors using SHAP values, which showed that age, hypertension, sex, and dyslipidemia can determine the risk of CVD in patients with CKD. Specifically, patients with CKD who are older, male, and have hypertension, lower eGFR, and lower high-density lipoprotein levels have a higher risk of CVD. The risk factors mentioned in the prediction model can be used to predict the CVD risk. This finding supports previous research and emphasizes the importance of risk factors for the occurrence of CVD events later in life. Starting from the mid-20th century with the Framingham Study (23), previous research has proven that older age, hypertension, male sex, and dyslipidemia are traditional independent risk factors for CVD in patients with CKD (24–27), which were also factors included in the Framingham prediction model (28). Sodium accumulates in tissues, potentially causing systemic inflammation and directly affecting myocardial and vascular structures. High sodium levels lead to blood pressure changes and sodium retention in patients with CKD, thereby increasing the risk of CVD (29). Compared with individuals without CKD, higher sodium content in the muscles and skin was observed in patients undergoing dialysis (30), which was positively correlated with systemic inflammation.
Previous research has identified multiple risk factors for CVD, while recent studies have focused on using artificial intelligence or regression-based models to identify new risk factors and provide insights into disease mechanisms, thereby improving the accuracy of CVD predictions in patients with CKD. These computational models attempt to overcome the limitations of the traditional models by incorporating a broader range of variables and using advanced techniques. The integration of novel CKD-specific markers and the use of complex computational techniques are expected to resolve this issue. The new models combine traditional and CKD-specific risk factors, recognizing the complex interactions between CKD progression and cardiovascular health. Many studies have confirmed that a decline in eGFR and albuminuria are independent risk factors for an increased risk of CVD death (31, 32). Kunihiro Matsushita et al (15) added unique kidney indicators, such as eGFR and the urine albumin–creatinine ratio (UACR) to the CKD supplement model, verifying that their inclusion significantly improves the risk prediction of CVD in patients with CKD. This is also relevant as the primary clinical guidelines for CVD prevention are yet to adopt CKD in CVD risk prediction; SCr is recommended as a primary marker of the eGFR in the current KDOQI guidelines, and eGFR-defined CKD is related to adverse CVD outcomes (33). This study incorporated 24-h proteinuria into the model, which differs from the previously used albuminuria and the UACR. Considering the higher cost of albumin measurement compared to total protein measurement, using UACR or urine protein–creatinine ratio for population screening is reasonable (33). However, despite the convenience of urine protein–creatinine ratio (UPCR) and UACR in quantifying proteinuria, their use has limitations. The random measured UPCR or UACR may not always reflect the 24-h excretion rate because protein or albumin excretion varies with the time of the day, stress levels, fatigue, and other factors. Therefore, incorporating the 24-h quantitative measurement of proteinuria into models, as illustrated by SHAP graphs, shows that an increase in 24-h proteinuria can lead to an increased risk of CKD. As traditional CVD risk factors may have different weights in the prediction factors among the CKD population (34), other indicators can serve as valuable supplements to enhance the predictive capability of such models. SHAP visualizations provide information for clinical decision making, highlighting the complexity of predictive models. Factors included in the predictive model are rooted in established and emerging evidence. New indicators of kidney disease risk are integrated into relevant predictive models as complements, offering better possibilities for clinicians to accurately assess patients’ cardiovascular risk and take appropriate intervention measures to reduce the incidence of cardiovascular events.
This study has some limitations. First, the model was not validated externally and was based on retrospective data, necessitating prospective cohort studies to verify the accuracy and stability of the model. Second, only routine clinical indicators were included in this study, and the addition of novel biomarkers from multi-omics studies may further enhance the model. However, this study was based on a large sample of the Chinese population and had a good model effect. Additionally, the use of clinically accessible indicators to build a CVD prediction model has strong clinical application value.
Moving forward, we may consider integrating our predictive model into clinical practice via mini-programs and mobile applications. This approach may facilitate precise diagnosis and treatment in clinical settings.
In conclusion, this study successfully established a risk-prediction model for CVD in patients with CKD. The risk prediction model is expected to serve as a practical tool for clinicians to identify high-risk individuals at an early stage and initiate targeted interventions in a timely manner, thus improving the scientific accuracy of clinical decision-making.
Data availability statement
The original contributions presented in the study are included in the article/Supplementary Material. Further inquiries can be directed to the corresponding authors.
Ethics statement
All methods were performed in accordance with the Declaration of Helsinki and the relevant guidelines and regulations. As we used anonymized and deidentified data, the need for written informed consent was waived by the Ethics Committee of the General Hospital of the Chinese People’s Liberation Army due to the retrospective nature of the study (approval number S2021-696-01).
Author contributions
HZ: Data curation, Formal analysis, Validation, Writing – original draft, Writing – review & editing. SQ: Data curation, Formal analysis, Writing – review & editing. DZ: Conceptualization, Investigation, Methodology, Writing – review & editing. KW: Methodology, Project administration, Supervision, Validation, Writing – review & editing. BW: Formal analysis, Methodology, Supervision, Writing – review & editing. YN: Data curation, Formal analysis, Project administration, Writing – review & editing. SS: Methodology, Supervision, Writing – review & editing. ZD: Supervision, Writing – review & editing. WZ: Supervision, Writing – review & editing. YZ: Conceptualization, Data curation, Methodology, Project administration, Supervision, Writing – review & editing. XC: Investigation, Methodology, Project administration, Supervision, Writing – review & editing.
Funding
The author(s) declare financial support was received for the research, authorship, and/or publication of this article. This study was supported by the National Natural Science Foundation of China (No.32141005,No.82030025), Capital’s Funds for Health Improvement and Research, China (No. Z221100007422121), Young Talent Project of Chinese PLA General Hospital (NO.2019XXMBD-005, NO.2019XXJSYX01), Project of the Department of the Integrated Traditional Chinese and Western Medicine and Ethnic Minority Medicine of the State Administration of Traditional Chinese Medicine(No.2023384) and High Level Key Disciplines of Traditional Chinese Medicine of the State Administration of Traditional Chinese Medicine (No.zyyzdxk−2023310).
Acknowledgments
We would like to express our sincere thanks to colleagues from the First Medical Center of Chinese PLA General Hospital. We would like to thank all volunteers who participated in the study. We would like to thank Medical Innovation Research Division, National Engineering Research Center of Medical Big Data of the General Hospital of the People’s Liberation Army (PLA) for their support of this study.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fendo.2024.1390729/full#supplementary-material
References
1. Mills KT, Xu Y, Zhang W, Bundy JD, Chen CS, Kelly TN, et al. A systematic analysis of worldwide population-based data on the global burden of chronic kidney disease in 2010. Kidney Int. (2015) 88:950–7. doi: 10.1038/ki.2015.230
2. Matsushita K, Ballew SH, Wang AY, Kalyesubula R, Schaeffner E, Agarwal R. Epidemiology and risk of cardiovascular disease in populations with chronic kidney disease. Nat Rev Nephrol. (2022) 18:696–707. doi: 10.1038/s41581-022-00616-6
3. Provenzano M, Coppolino G, Faga T, Garofalo C, Serra R, Andreucci M. Epidemiology of cardiovascular risk in chronic kidney disease patients: the real silent killer. Rev Cardiovasc Med. (2019) 20:209–20. doi: 10.31083/j.rcm.2019.04.548
4. Bertomeu-González V, Soriano Maldonado C, Bleda-Cano J, Carrascosa-Gonzalvo S, Navarro-Perez J, López-Pineda A, et al. Predictive validity of the risk SCORE model in a Mediterranean population with dyslipidemia. Atherosclerosis. (2019) 290:80–6. doi: 10.1016/j.atherosclerosis.2019.09.007
5. Lerner B, Desrochers S, Tangri N. Risk prediction models in CKD. Semin Nephrol. (2017) 37:144–50. doi: 10.1016/j.semnephrol.2016.12.004
6. Lidgard B, Zelnick LR, Go A, O'Brien KD, Bansal N. Framingham and american college of cardiology/american heart association pooled cohort equations, high-sensitivity troponin T, and N-terminal pro-brain-type natriuretic peptide for predicting atherosclerotic cardiovascular events across the spectrum of kidney dysfunction. J Am Heart Assoc. (2022) 11:e024913. doi: 10.1161/JAHA.121.024913
7. Zelnick LR, Shlipak MG, Soliman EZ, Anderson A, Christenson R, Lash J, et al. Prediction of incident atrial fibrillation in chronic kidney disease: the chronic renal insufficiency cohort study. Clin J Am Soc Nephrology: CJASN. (2021) 16:1015–24. doi: 10.2215/CJN.01060121
8. Liu XQ, Jiang TT, Wang MY, Liu WT, Huang Y, Huang YL, et al. Using machine learning to evaluate the role of microinflammation in cardiovascular events in patients with chronic kidney disease. Front Immunol. (2021) 12:796383. doi: 10.3389/fimmu.2021.796383
9. Pammer LM, Lamina C, Schultheiss UT, Kotsis F, Kollerits B, Stockmann H, et al. Association of the metabolic syndrome with mortality and major adverse cardiac events: A large chronic kidney disease cohort. J Internal Med. (2021) 290:1219–32. doi: 10.1111/joim.13355
10. Cohen JB, Yang W, Li L, Zhang X, Zheng Z, Orlandi P, et al. Time-updated changes in estimated GFR and proteinuria and major adverse cardiac events: findings from the chronic renal insufficiency cohort (CRIC) study. Am J Kidney diseases: Off J Natl Kidney Foundation. (2022) 79:36–44.e1. doi: 10.1053/j.ajkd.2021.03.021
11. Levey AS, Stevens LA, Schmid CH, Zhang YL, Castro AF, Feldman 3HI, et al. A new equation to estimate glomerular filtration rate. Ann Internal Med. (2009) 150:604–12. doi: 10.7326/0003-4819-150-9-200905050-00006
12. Taft LM, Evans RS, Shyu CR, Egger MJ, Chawla N, Mitchell JA, et al. Countering imbalanced datasets to improve adverse drug event predictive models in labor and delivery. J BioMed Inform. (2009) 42:356–64. doi: 10.1016/j.jbi.2008.09.001
13. Handelman GS, Kok HK, Chandra RV, Razavi AH, Lee MJ, Asadi H. eDoctor: machine learning and the future of medicine. J Internal Med. (2018) 284:603–19. doi: 10.1111/joim.12822
14. Rodríguez-Pérez R, Bajorath J. Interpretation of machine learning models using shapley values: application to compound potency and multi-target activity predictions. J computer-aided Mol design. (2020) 34:1013–26. doi: 10.1007/s10822-020-00314-0
15. Matsushita K, Jassal SK, Sang Y, Ballew SH, Grams ME, Surapaneni A, et al. Incorporating kidney disease measures into cardiovascular risk prediction: Development and validation in 9 million adults from 72 datasets. EClinicalMedicine. (2020) 27:100552. doi: 10.1016/j.eclinm.2020.100552
16. Li N, Zhang J, Xu Y, Yu M, Zhou G, Zheng Y, et al. A novel nomogram based on a competing risk model predicting cardiovascular death risk in patients with chronic kidney disease. Front Cardiovasc Med. (2022) 9:827988. doi: 10.3389/fcvm.2022.827988
17. Mohebi R, van Kimmenade R, McCarthy CP, Magaret CA, Barnes G, Rhyne RF, et al. Performance of a multi-biomarker panel for prediction of cardiovascular event in patients with chronic kidney disease. Int J Cardiol. (2023) 371:402–5. doi: 10.1016/j.ijcard.2022.09.074
18. Bhavsar NA, Davenport CA, Yang LZ, Peskoe S, Scialla JJ, Hall RK, et al. Psychosocial determinants of cardiovascular events among black Americans with chronic kidney disease or associated risk factors in the Jackson heart study. BMC Nephrol. (2021) 22:375. doi: 10.1186/s12882-021-02594-6
19. Avram R. Revolutionizing cardiovascular risk prediction in patients with chronic kidney disease: machine learning and large-scale proteomic risk prediction model lead the way. Eur Heart J. (2023) 44:2111–3. doi: 10.1093/eurheartj/ehad127
20. Bundy JD, Rahman M, Matsushita K, Jaeger BC, Cohen JB, Chen J, et al. Risk prediction models for atherosclerotic cardiovascular disease in patients with chronic kidney disease: the CRIC study. J Am Soc Nephrology: JASN. (2022) 33:601–11. doi: 10.1681/ASN.2021060747
21. van der Velden BHM, Kuijf HJ, Gilhuijs KGA, Viergever MA. Explainable artificial intelligence (XAI) in deep learning-based medical image analysis. Med Image Anal. (2022) 79:102470. doi: 10.1016/j.media.2022.102470
22. Wang K, Tian J, Zheng C, Yang H, Ren J, Liu Y, et al. Interpretable prediction of 3-year all-cause mortality in patients with heart failure caused by coronary heart disease based on machine learning and SHAP. Comput Biol Med. (2021) 137:104813. doi: 10.1016/j.compbiomed.2021.104813
23. Hajar R. Framingham contribution to cardiovascular disease. Heart views: Off J Gulf Heart Assoc. (2016) 17:78–81. doi: 10.4103/1995-705X.185130
24. Ellulu MS, Patimah I, Khaza'ai H, Rahmat A, Abed Y. Obesity and inflammation: the linking mechanism and the complications. Arch Med science: AMS. (2017) 13:851–63. doi: 10.5114/aoms.2016.58928
25. Jha V, Garcia-Garcia G, Iseki K, Li Z, Naicker S, Plattner B, et al. Chronic kidney disease: global dimension and perspectives. Lancet. (2013) 382:260–72. doi: 10.1016/S0140-6736(13)60687-X
26. Laffin LJ, Bakris GL. Intersection between chronic kidney disease and cardiovascular disease. Curr Cardiol Rep. (2021) 23:117. doi: 10.1007/s11886-021-01546-8
27. Teo KK, Rafiq T. Cardiovascular risk factors and prevention: A perspective from developing countries. Can J Cardiol. (2021) 37:733–43. doi: 10.1016/j.cjca.2021.02.009
28. D'Agostino S.R. RB, Vasan RS, Pencina MJ, Wolf PA, Cobain M, Massaro JM, et al. General cardiovascular risk profile for use in primary care: the Framingham Heart Study. Circulation. (2008) 117:743–53. doi: 10.1161/CIRCULATIONAHA.107.699579
29. Yu HC, Burrell LM, Black MJ, Wu LL, Dilley RJ, Cooper ME, et al. Salt induces myocardial and renal fibrosis in normotensive and hypertensive rats. Circulation. (1998) 98:2621–8. doi: 10.1161/01.CIR.98.23.2621
30. Sahinoz M, Tintara S, Deger SM, Alsouqi A, Crescenzi RL, Mambungu C, et al. Tissue sodium stores in peritoneal dialysis and hemodialysis patients determined by 23-sodium magnetic resonance imaging. Nephrology dialysis transplantation: Off Publ Eur Dialysis Transplant Assoc - Eur Renal Assoc. (2020) 36:1307–17. doi: 10.1093/ndt/gfaa350
31. Matsushita K, van der Velde M, Astor BC, Woodward M, Levey AS, de Jong PE, et al. Association of estimated glomerular filtration rate and albuminuria with all-cause and cardiovascular mortality in general population cohorts: a collaborative meta-analysis. Lancet. (2010) 375:2073–81. doi: 10.1016/S0140-6736(10)60674-5
32. Matsushita K, Coresh J, Sang Y, Chalmers J, Fox C, Guallar E, et al. Estimated glomerular filtration rate and albuminuria for prediction of cardiovascular outcomes: a collaborative meta-analysis of individual participant data. Lancet Diabetes Endocrinol. (2015) 3:514–25. doi: 10.1016/S2213-8587(15)00040-6
33. Lees JS, Welsh CE, Celis-Morales CA, Mackay D, Lewsey J, Gray SR, et al. Glomerular filtration rate by differing measures, albuminuria and prediction of cardiovascular disease, mortality and end-stage kidney disease. Nat Med. (2019) 25:1753–60. doi: 10.1038/s41591-019-0627-8
Keywords: chronic kidney disease, cardiovascular disease, electronic medical records, prediction model, machine learning
Citation: Zhu H, Qiao S, Zhao D, Wang K, Wang B, Niu Y, Shang S, Dong Z, Zhang W, Zheng Y and Chen X (2024) Machine learning model for cardiovascular disease prediction in patients with chronic kidney disease. Front. Endocrinol. 15:1390729. doi: 10.3389/fendo.2024.1390729
Received: 23 February 2024; Accepted: 08 May 2024;
Published: 28 May 2024.
Edited by:
Samar Rezq, University of Mississippi Medical Center, United StatesReviewed by:
Sivakannan Subramani, St.Joseph’s University, IndiaPunam Thapa, University of Mississippi Medical Center, United States
Copyright © 2024 Zhu, Qiao, Zhao, Wang, Wang, Niu, Shang, Dong, Zhang, Zheng and Chen. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Xiangmei Chen, xmchen301@126.com; Ying Zheng, zhengying301@126.com
†These authors contributed equally to this work and share first authorship