Skip to main content

ORIGINAL RESEARCH article

Front. Med., 13 March 2024
Sec. Hepatobiliary Diseases

Development and validation of a machine learning model to predict prognosis in liver failure patients treated with non-bioartificial liver support system

Shi Shi,Shi Shi1,2Yanfen YangYanfen Yang3Yuanli LiuYuanli Liu3Rong ChenRong Chen4XiaoXia JiaXiaoXia Jia3Yutong WangYutong Wang4Chunqing Deng,
Chunqing Deng1,2*
  • 1Department of Health Statistics, School of Public Health, Shanxi Medical University, Taiyuan, Shanxi, China
  • 2Department of Infectious Disease, First Hospital of Shanxi Medical University, Taiyuan, Shanxi, China
  • 3The 1st School of Clinical Medicine, Shanxi Medical University, Taiyuan, Shanxi, China
  • 4Department of Health Statistics, School of Medical Sciences, Shanxi Medical University, Taiyuan, Shanxi, China

Background and objectives: The prognosis of liver failure treated with non-bioartificial liver support systems is poor. Detecting its risk factors and developing relevant prognostic models still represent the top priority to lower its death risk.

Methods: All 215 patients with liver failure treated with non-bioartificial liver support system were retrospectively analyzed. Potential prognostic factors were investigated, and the Nomogram and the Random Survival Forests (RSF) models were constructed, respectively. Notably, we evaluated the performance of models and calculated the risk scores to divide patients into low-risk and high-risk groups.

Results: In the training set, multifactorial Cox regression analysis showed that etiology, hepatic encephalopathy, total bilirubin, serum alkaline phosphatase, platelets, and MELD score were independent factors of short-term prognosis. The RSF model (AUC: 0.863, 0.792) performed better in prediction than the Nomogram model (AUC: 0.816, 0.756) and MELD (AUC: 0.658, 0.700) in the training and validation groups. On top of that, patients in the low-risk group had a significantly better prognosis than those in the high-risk group.

Conclusion: We constructed the RSF model with etiology, hepatic encephalopathy, total bilirubin, serum alkaline phosphatase, platelets, and MELD score, which showed better prognostic power than the Nomogram model and MELD score and could help physicians make optimal treatment decisions.

1 Introduction

Liver failure (LF) is a seriously life-threatening hepatic syndrome associated with numerous serious complications characterized by organ failure and high clinical mortality (1, 2). There is no specific treatment for LF, and the current treatment consists of general management, artificial liver support system therapy, and liver transplantation. However, the efficacy of comprehensive management is relatively slow. Donor liver scarcity and high treatment costs have made liver transplantation (LT) impracticable for most patients (3, 4).

In the past few decades, artificial liver support system (ALSS) therapy has developed into a therapeutic option for LF because it is able to temporarily replace part of the functions of the failing liver, remove harmful substances from the body, stabilize the internal environment, and reduce the burden on the liver (5). Several studies found that the non-bioartificial liver support system (NBAL) could afford survival benefits for LF patients (68). However, one study (9) found the deterioration of liver failure in some patients even after more than 10 treatments. The prognosis has emerged as a clinical challenge. Comprehensively digesting its risk factors and thus accurately estimating its prognosis is all the more important.

Nowadays, various prognostic models, including the Chinese Group on the Study of Severe Hepatitis B-ACLF (COSSH ACLF) (10), the PALS model (11), and the APM model (12) were deemed suitable to predict the prognosis in patients with acute-on chronic liver failure (ACLF) treated using NBAL. Nevertheless, LF can present as acute liver failure (ALF), subacute liver failure (SALF), ACLF (an acute deterioration of known or unknown chronic liver disease), and chronic liver failure (CLF) (13, 14). Whether these models serve to evaluate the prognosis of LF patients with NBAL is uncertain. Besides that, most of the models have been constructed based on the Cox regression that should initially be satisfied with the assumptions.

Yet, Random Survival Forests (RSF), proposed by Ishwaran et al., has few limitations. RSF is a newly introduced forest ensemble learner to analyze right-censored survival data (15). Given the limited survival data, it sought a model that best represented the data. Moreover, there is the possibility to rank the importance of the variables, thus filtering out variables with greater significance. Now, RSF has successfully applied to the risk prediction of several diseases (16, 17). Accordingly, in the present study, we investigated the factors affecting short-term prognosis in patients with LF treated with NBAL therapy and applied the nomogram and RSF to develop clinical prediction models, respectively. We hope to find the optimal models which will help clinicians identify patients with LF at different risk levels and make treatment decisions, regardless of presentation.

2 Materials and methods

2.1 Study population

Two groups of patients were identified retrospectively: one for model establishment (training set) and the other for model validation (validation set). The training group included patients admitted to the Department of Infectious Diseases at the First Hospital of Shanxi Medical University between January 2014 and December 2021. The validation group included patients admitted to the Department of Infectious Diseases at the First Hospital of Shanxi Medical University between January 2022 and December 2022. The study protocol conforms to the ethical guidelines of the 1975 Declaration of Helsinki (6th revision, 2008) as reflected in a priori approval by the Ethics Committee of the First Hospital of Shanxi Medical University research committee, and the requirement for informed consent was waived owing to the retrospective nature of the study.

The inclusion criteria were as follows: (1) patients with SALF and CLF who were diagnosed according to the Guidelines for Diagnosis and Treatment of Liver Failure, and patients with ACLF and ALF were, respectively, diagnosed according to the consensus recommendations of the Asian Pacific Association for the Study of the Liver and the recommendations of the American College of Gastroenterology (13, 14, 18); (2) patients that underwent NBAL therapy; (3) age ranging from 18 to 75 years; (4) hospitalization time for at least 1 day; (5) complete availability inpatient clinical data, including basic patient information (name, gender, age, classification of LF, etiology, contact information and prior medical history), non-biological artificial liver treatments (number of treatments, mode of treatment and date of treatment), and clinical parameters (missing values <30%). The exclusion criteria included: (1) pregnancy or lactation; (2) HIV infection and other viral infections; (3) liver cancer and other malignancy; (4) any other severe extrahepatic chronic disease including severe renal, cardiac, respiratory, neurologic diseases, or other systemic diseases; (5) patients lacking timely follow-up.

All patients were followed up routinely at 3-month intervals from the first NBAL treatment with a cohort follow-up cut-off date of March 2023. The outcome of this study was all-cause mortality after 3 months of follow-up. During that time, if patients underwent liver transplantation, they were considered dead. The patient enrollment process is shown in Figure 1.

Figure 1
www.frontiersin.org

Figure 1. Flowchart of patient selection. LF, liver failure; NBAL therapy, non-bioartificial liver therapy.

2.2 Treatment

All patients received standard medical therapy (SMT), including bed rest, adequate nutritional support, and correction of hypoproteinemia, water-electrolyte, and acid–base balance. Antiviral treatment was provided for HBV DNA-positive patients. Complications were also treated as follows: treatment of ascites included mainly etiologic therapy, sodium intake restriction, and diuretic therapy; treatment of hepatic encephalopathy included dietary restriction, lactulose, ammonia-lowering drugs, L-ornithine-L-aspartate (LOLA) and other supportive therapy.

The NBAL treatments in our study included plasma exchange (PE), double plasma molecular adsorption system (DPMAS), and DPMAS with sequential half-dose plasma exchange (DPMAS+PE). These methods are performed depending on the patient’s condition. PE applies to patients with other diseases in which macromolecules or pathogenic mediators bound to albumin are present in the blood, but PE alone is not recommended in patients with preexisting significant hepatic encephalopathy; DPMAS applies to patients with prehepatic failure, hyperbilirubinemia, and also in those with hepatic encephalopathy; DPMAS + PE is indicated in patients with hyperbilirubinemia, especially those with bilirubin levels >500 μmol/L (6, 19).

2.3 Data-collection

Clinical data collected included gender, age, main complications, etiology, classification of LF, number of treatments and treatment modality of NBAL, and laboratory parameters within 24 h before the first treatment, including alanine aminotransferase (ALT), aspartate aminotransferase (AST), albumin (ALB), alkaline phosphatase (ALP), total bilirubin (TBIL), cholinesterase (CHE), gamma-glutamyl transpeptidase (GGT), low-density lipoprotein (LDL), platelets (PLT), prothrombin time (PT), international normalized ratio (INR), creatinine (Cr), sodium, alpha-fetoprotein (AFP), and MELD score. Furthermore, the calculation of total bilirubin actual resident rate (TBARR), total bilirubin rebound rate (TBRR), and total bilirubin clearance rate (TBCR) was performed, which were calculated according to the following formula:

MELD = 3.8 × ln TBIL mg / dl + 11.2 × ln I N R + 9.6 × ln C r mg / dl + 6.4 × aetiology : 0 i f cholestatic or alcoholic , 1 otherwise
TBARR = postoperative TBIL at 48 hours / preoperative TBIL
TBRR = postoperative TBIL at 48 hours immediately postoperative TBIL immediately postoperative TBIL
TBCR = preoperative TBIL immediately postoperative TBIL preoperative TBIL

2.4 Statistical analysis

Quantitative data were expressed as mean ± standard deviation (SD) when normally distributed and compared using Student’s t-test; when not normally distributed, they were indicated as median (interquartile range) and compared using the Mann–Whitney U test. Qualitative data were expressed as numbers (percentages), and chi-square tests were used for inter-group comparisons.

Baseline characteristics of the survival and death groups were compared using Student’s t-test, Mann–Whitney U-test, and Chi-square test. Potential predictors of prognosis were identified by univariate and multivariate analyses using Cox proportional risk regression models, using the forward stepwise method to screen for variables significantly associated with outcome. The test level α was set at 0.05, and the differences were considered significant at p < 0.05. The Nomogram and RSF models were developed, respectively, based on the above-mentioned characteristic variables. Bootstrap repeated sampling method (500 times) was used to perform internal validation of the prediction models. We compared the out-of-bag error rate and composite Brier score and plotted the prediction error curves. The optimal model was externally validated using calibration plots, decision-curse analysis (DCA) curves, and the area under the subject’s work characteristics curve.

All statistical analyses were performed using SPSS 25.0 software. Model construction was performed using R software version 4.2.1. Missing data were filled using the missForest package in the R software, version 4.2.1. The Nomogram model and calibration plots were constructed using the R package “rms”; the RSF model was constructed using the R package “randomForestSRC”; the DCA curves were drawn using the R package “dcurves”; “ROC curve analysis was performed using the R package “timeROC.”

3 Results

3.1 Patients characteristics

All 215 LF patients treated with NBAL participated in this study. Based on a three-month follow-up, patients were divided into survival (N = 138) and death groups (N = 77) in the training cohort. There were no significant differences in gender, classification of LF, treatment modality, and treatment frequency of NBAL in both groups (Table 1). A higher proportion of patients with hepatic encephalopathy (HE) was found in the death group than in the survival group (p < 0.05). Compared with the survival group, the levels of age, TBIL, PT, INR, Cr, MELD score, and TBARR were significantly higher in the death group (p < 0.05). Moreover, the levels of AST, ALP, CHE, GGT, LDL, and PLT in the death group were significantly lower than in the survival group (p < 0.05).

Table 1
www.frontiersin.org

Table 1. Characteristics of survival and death groups in the training cohort.

As shown in Table 2, we conducted the univariable Cox analysis on 25 potential factors, and the result determined 12 significant variables, including etiology, HE, age, ALP, TBIL, PLT, PT, INR, Cr, MELD score, TBARR, and TBCR. Additionally, the multivariable Cox regression analysis revealed that independent predictors of LF with NBAL treatments were etiology, HE, ALP, TBIL, PLT, and MELD scores.

Table 2
www.frontiersin.org

Table 2. Results from univariate Cox regression and multivariate Cox regression.

3.2 Development of models in the training cohort

According to independent predictors from multivariable Cox regression, we constructed a risk prediction nomogram model of LF with NBAL treatments (Figure 2).

Figure 2
www.frontiersin.org

Figure 2. Nomogram for predicting 3-month overall survival for patients in the training cohort. Etiology 1, hepatitis virus; Etiology 2, medication; Etiology 3, alcohol; Etiology 4, others; HE, hepatic encephalopathy; ALP, alkaline phosphatase; TBIL, total bilirubin; PLT, platelets; PT, prothrombin time; MELD, Model for End-stage Liver Disease. Total points indicate the total points and are the sum of the six indicators.

The RSF model incorporates the above feature variables, and we trained the trees continuously based on mtry = 1 and ntree = 5,000 trees. Ntree = 2,000, which made the model stable, was selected as the optimal parameter (Supplementary Figures S1A). The optimal parameters, nodesize = 15 and mtry = 1, were determined by the grid search method (Supplementary Figures S1B). Based on the VIMP method, variables ranked in importance. All had VIMP values greater than 0, and the importance in descending order was MELD, HE, ALP, TBIL, PLT, and etiology (Supplementary Figures S2).

The internal validation results showed that both OBB and the composite Brier score of the RSF model (0.255, 0.161) are slightly lower than those (0.264, 0.169) of the Nomogram model. Meanwhile, the error curve of the RSF model was slightly lower than that of the Nomogram model as time increased, further indicating that the RSF model was relatively stable and reliable (Supplementary Figure S3).

3.3 Testing of models in the validation cohort

The developed model was further tested in the validation group. We plotted the ROC curves and calculated the corresponding AUC values in the training and validation cohorts. As shown in the ROC plots, there were significantly higher AUC values of the RSF model [0.863(95% CI, 0.815 ~ 0.912), 0.792(95% CI, 0.668 ~ 0.917)] in the training cohort, and validation cohort, compared to Nomogram model [0.816(95% CI, 0.758 ~ 0.874), 0.756(95% CI, 0.607 ~ 0.904)] and MELD [0.658(95% CI, 0.577 ~ 0.739), 0.700(95% CI, 0.545 ~ 0.855)] (Figure 3).

Figure 3
www.frontiersin.org

Figure 3. Receiver operating curves (ROC) for the abilities of risk models to predict 3-month mortality. ROC for risk models predicting 3-month mortality in the training cohort (A) and validation cohort (B).

By observing the calibration plot both in the training cohort and the validation cohort, it is possible to roughly determine that there is a better agreement between the predicted survival probability and the actual observed results in the RSF model (Figure 4).

Figure 4
www.frontiersin.org

Figure 4. The calibration plot curves of models for predicting patients’ 3-month overall survival in the training cohort (A) and validation cohort (B).

Figure 5 is a decision curve depicting the clinical efficiency of the RSF model and the Nomogram model for predicting the prognosis of patients. Notably, the clinical efficiency of the RSF model was higher than that of the Nomogram model in the training cohort. However, the clinical efficiency of the RSF model was similar to that of the Nomogram model in the validation cohort. The net benefits of the RSF model were close to 0.94 and 0.81 in the training and validation cohorts, respectively.

Figure 5
www.frontiersin.org

Figure 5. Clinical application evaluation of models in the training cohort (A) and validation cohort (B).

Combining the results of OOB, the composite Brier score, ROC curve, calibration curve, and DCA curve, we found that the RSF model had better predictive value for the prognosis of LF patients treated with NBAL with high precision and clinical applicability.

3.4 Risk stratification of overall survival by the RSF model

The patients were divided into low-risk and high-risk groups by calculating the risk scores based on the RSF model. The optimal cutoff value for risk stratification of the RSF model was 11.97, which was determined using X-tile software version 3.6.1 (20). Supplementary Figure S4 shows the K-M survival curves for the different risk groups in the training and validation cohorts. As observed, patients in the low-risk group had a significantly better prognosis than those in the high-risk group (p < 0.001). Furthermore, as shown in Supplementary Tables S1, S2, the log-rank test results showed differences among groups.

4 Discussion

LF is a severely life-threatening clinical syndrome that has no effective treatment to improve patients’ clinical course. However, some LF patients with reversible potential may have a chance to be corrected by aggressive artificial liver therapy (21). PE has been widely used in China to remove toxic substances, but it requires a large amount of plasma and carries the potential risk of infection and allergy. Previous studies (22) have reported that PE helps to improve systemic inflammatory response syndrome (SIRS) and reduce the occurrence of multiple organ failure (MOF), thus prolonging the survival of patients. DPMAS fully utilizes plasma adsorption to remove inflammatory substances with plasma conservation and prevention of allergic reactions. These effects from DPMAS may help reduce TNF-α and IL-6 levels and effectively scavenge pro-inflammatory factors, with good survival benefits (23, 24). In recent years, it has been pointed out that DPMAS+PE combines both of these treatment modalities and has been considered as one of the best treatment modalities in case of plasma shortage and inability to perform liver transplantation (25, 26).

Although several previous prognostic models for LF have been applied and validated by some scholars, while specific models for predicting LF patients treated with ALSS have been published among Eastern and Western countries, few machine learning-based prognostic models have been published in detail for patients with LF treated with NBAL. We found that etiology, HE, ALP, TBIL, PLT, and MELD scores were associated with the outcome of LF patients treated with NBAL. Some scholars have reported that the prognosis of LF patients treated with NBAL is related to cirrhosis, TBIL, INR, infection, HE (11), Cr (7), age, MELD score (27), and AFP (12), which is generally consistent with our results. We also attempted to construct prognostic models based on the nomogram and RSF algorithm separately for LF patients treated with NBAL and select the better model while stratifying patients into different risk subgroups.

4.1 Etiology, complication, and prognosis

According to one study (28), approximately 1.32 million people worldwide died from alcohol-associated LF in 2017, making it the leading cause of liver-related mortality. Alcohol abuse increases intestinal permeability. In addition, lipids are peroxidized by reactive oxygen species produced by alcohol with its metabolites thus leading to hepatocellular damage (29, 30). Santhosh’s results (31) showed that low-volume plasma exchange and low-dose steroids improved survival in patients with alcohol-associated LF. We found that alcohol-associated LF was related to improved outcomes in patients treated with NBAL, although hepatitis virus-associated LF accounted for the highest proportion of LF. It suggests that more attention should be paid to this population of alcohol-associated LF. HE is a severe neuropsychiatric complication observed in patients with liver failure. The pathophysiology of HE is sophisticated and incompletely understood, but hyperammonemia and cerebral hemodynamic dysfunction appear to be central to the pathogenesis of HE (32). Some scholars have also hypothesized that HE may predict prognosis in patients with liver failure (33). Cai’s results (34) showed that HE, more commonly seen in LF patients presenting with infection, was an independent risk factor for 90-day mortality in ACLF patients showing infection. Du’s results (11) showed HE was the independent predictor of 3-month prognosis in patients with HBV-ACLF treated with PE therapy, which is generally consistent with our results.

4.2 Clinical indicators and prognosis

TBIL serves as an essential indicator of liver metabolic function and a prognostic indicator of liver failure (35). Severe hepatic impairment causes a decrease in bilirubin binding, allowing unconjugated bilirubin to accumulate in the blood. Meanwhile, biliary stasis leads to the accumulation of bile acids and conjugated bilirubin in the liver and systemic system (36). Studies have shown that high TBIL is associated with poor prognosis in patients with liver failure treated with non-bioartificial liver support systems, which is consistent with our findings (11). Our study also found lower ALP levels in the death group compared to the survival group. It suggests that cholestasis may develop in patients with a low risk of death, while high-risk patients have possible limitations of capillary bile duct function (37). Thrombocytopenia may be driven by viral infection, changes in portal pressure, and splenomegaly (38). Williamson and Chapman (39) found that ALP worked as one of the indicators to determine prognosis. Mu et al. (40) found that platelet counts had a high value in predicting short-term outcomes in patients with hepatitis E virus-related acute liver failure (HEV-ALF). Despite the different study populations, these findings seem to strengthen our results.

4.3 MELD score and prognosis

MELD is a recognized score for predicting survival in patients with end-stage liver disease, including TBIL, INR, Cr, and etiology (41). Che et al. (42) found a significant reduction in total bilirubin levels and MELD scores after NBAL treatment compared to pre-treatment. Chen’s results (43) showed that PE-based NBAL performed best in patients with 30 ~ 40 MELD scores. A meta-analysis by Li et al. (44) showed that patients treated with NBAL with lower-level MELD scores had a higher 28-day survival rate. In turn, our results found that MELD >32.12 had a higher risk of death. Moreover, our results showed that the MELD score within 24 h before the first NBAL treatment was an independent predictor of 3-month prognosis in LF patients treated with NBAL. Also, we found that both RSF and Nomogram models offered remarkable benefits compared to the MELD score. The TBIL level after artificial liver treatment will decrease to some extent, while it will rebound inevitably after a period of time. We sought to investigate the relationship between three indicators, TBCR, TBRR, and TBARR, and prognosis. Univariate Cox regression results suggest that TBARR and TBCR were probably relevant to prediction. However, data from retrospective studies were affected by various factors. Further confirmation of this conjecture is needed in the future.

4.4 Previous prognostic models

There are several nomogram models for predicting the prognosis of LF patients treated with NBAL. Ma et al. (10) conducted a retrospective study to assess the prognostic value of six models to predict the prognosis of patients with liver failure treated with artificial liver, and reported that the COSSH ACLF (AUC: 0.806, 95% confidence interval [CI]: 0.753 ~ 0.853) was more accurate in predicting the short-term prognosis of patients with ACLF treated with ALSS. Zhou et al. (27) used the number of comorbidities, age, MELD score, and artificial liver pattern to construct a model to predict the survival of patients with liver failure treated with artificial liver. PALS score (AUROC = 0.818) was established by Du et al. (11) to screen the subgroups (PALS score of 3–5 who received 1–2 sessions of ALSS therapy, PALS score of 6–9 who received ≥6 sessions of ALSS therapy) who could benefit from PE-centered ALSS therapy. Xie et al. (12) proposed a new APM model (AUC:0.790, 95% confidence interval [CI]: 0.740 ~ 0.834) including AFP levels to predict 28-day survival in patients with hepatitis B virus-related chronic plus acute liver failure treated with an artificial liver support system. To the best of our study, time-dependent AUC, calibration curve, and DCA all suggested that the RSF model had potential clinical application value. Also, we distinguished between high-risk and low-risk patients based on the risk score calculated from the RSF model. K-M plots and log-rank analysis showed significant differences between the two groups. Therefore, we should focus highly on patients with risk scores higher than 11.97. In addition, we wanted to try to compare the RSF model with existing prognostic models, but in this retrospective study, the data lacked relevant indicators. Further studies will have to be done in the future.

4.5 Limitations of study

There are several limitations of our study. The first one concerns that this is a single-center retrospective study and the issue of selection bias cannot be completely avoided. The second one lies in the small sample size of our data both in the training and validation sets. Because patients with acute liver failure, sub-acute liver failure, acute-on-chronic liver failure, and chronic liver failure have a diverse survival rate, sub-group analyses are required. However, the small sample size of our data will lead to an overfitting of the results. The last one is that our findings are based on the Chinese population and cannot be extrapolated to other countries. In the future, a prospective large sample of data shared by multiple medical centers may increase the reliability and generalizability of the prediction model.

In summary, the RSF model allows for predicting the short-term prognosis of patients with liver failure treated with non-bioartificial liver support systems, including etiology, HE, ALP, TBIL, PLT, and MELD scores. Stratifying the risk scores of the model enables the promotion of individualized treatment. This model needs to be further validated in the future.

Data availability statement

The datasets presented in this article are not readily available because protecting patients' privacy and interests. Requests to access the datasets should be directed to SS, sshi_zi@163.com.

Ethics statement

The studies involving humans were approved by the Ethics Committee of the First Hospital of Shanxi Medical University Research Committee. The studies were conducted in accordance with the local legislation and institutional requirements. Written informed consent for participation was not required from the participants or the participants’ legal guardians/next of kin because the retrospective nature of the study.

Author contributions

SS: Data curation, Formal analysis, Investigation, Methodology, Writing – original draft, Writing – review & editing. YY: Investigation, Methodology, Visualization, Writing – original draft. YL: Investigation, Writing – review & editing. RC: Data curation, Formal analysis, Investigation, Writing – review & editing. XJ: Writing – review & editing. YW: Data curation, Formal analysis, Writing – review & editing. CD: Funding acquisition, Methodology, Project administration, Software, Writing – original draft, Writing – review & editing.

Funding

The author(s) declare that financial support was received for the research, authorship, and/or publication of this article. This research was funded by the Beijing Liver and Gallbladder Foundation “Special Fund for Artificial Liver in 2022” (iGandanF-1082022-RGG005).

Acknowledgments

We thank the workers in the Medical Records Office for their help. We also thank all the patients who participated in this study for their understanding and recognition of our work.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fmed.2024.1368899/full#supplementary-material

References

1. Sarin, SK , and Choudhury, A . Acute-on-chronic liver failure: terminology, mechanisms and management. Nat Rev Gastroenterol Hepatol. (2016) 13:131–49. doi: 10.1038/nrgastro.2015.219

PubMed Abstract | Crossref Full Text | Google Scholar

2. Montrief, T , Koyfman, A , and Long, B . Acute liver failure: a review for emergency physicians. Am J Emerg Med. (2019) 37:329–37. doi: 10.1016/j.ajem.2018.10.032

PubMed Abstract | Crossref Full Text | Google Scholar

3. Li, H , Chen, HS , and Nyberg, SL . Extracorporeal liver support and liver transplant for patients with acute-on-chronic liver failure. Semin Liver Dis. (2016) 36:153–60. doi: 10.1055/s-0036-1583197

PubMed Abstract | Crossref Full Text | Google Scholar

4. Tujios, S , Stravitz, RT , and Lee, WM . Management of acute liver failure: update 2022. Semin Liver Dis. (2022) 42:362–78. doi: 10.1055/s-0042-1755274

PubMed Abstract | Crossref Full Text | Google Scholar

5. Li, LJ , Zhang, YM , Liu, XL , du, WB , Huang, JR , Yang, Q, et al. Artificial liver support system in China: a review over the last 30 years. Ther Apher Dial. (2006) 10:160–7. doi: 10.1111/j.1744-9987.2006.00358.x

Crossref Full Text | Google Scholar

6. Saliba, F , Bañares, R , Larsen, FS , Wilmer, A , Parés, A , Mitzner, S, et al. Artificial liver support in patients with liver failure: a modified Delphi consensus of international experts. Intensive Care Med. (2022) 48:1352–67. doi: 10.1007/s00134-022-06802-1

PubMed Abstract | Crossref Full Text | Google Scholar

7. Chen, JJ , Huang, JR , Yang, Q , Xu, XW , Liu, XL , Hao, SR, et al. Plasma exchange-centered artificial liver support system in hepatitis B virus-related acute-on-chronic liver failure: a nationwide prospective multicenter study in China. Hepatobiliary Pancreat Dis Int. (2016) 15:275–81. doi: 10.1016/S1499-3872(16)60084-X

PubMed Abstract | Crossref Full Text | Google Scholar

8. Yang, L , Wu, T , Li, J , Xin, J , Shi, D , Jiang, J, et al. Artificial liver treatment improves survival in patients with hepatitis B virus-related acute-on-chronic liver failure: a case-control matched analysis. Hepatol Res. (2020) 50:656–70. doi: 10.1111/hepr.13497

PubMed Abstract | Crossref Full Text | Google Scholar

9. García Martínez, JJ , and Bendjelid, K . Artificial liver support systems: what is new over the last decade? Ann Intensive Care. (2018) 8:109. doi: 10.1186/s13613-018-0453-z

PubMed Abstract | Crossref Full Text | Google Scholar

10. Ma, YJ , du, LY , Bai, L , and Tang, H . Assessment value of short-term prognosis of six predictive models for patients with acute-on-chronic liver failure treated with artificial liver support system. Sichuan Da Xue Xue Bao Yi Xue Ban. (2022) 53:758–63. doi: 10.12182/20220960203

PubMed Abstract | Crossref Full Text | Google Scholar

11. Du, L , Ma, Y , Zhou, S , Chen, F , Xu, Y , Wang, M, et al. A prognostic score for patients with acute-on-chronic liver failure treated with plasma exchange-centered artificial liver support system. Sci Rep. (2021) 11:1469. doi: 10.1038/s41598-021-81019-8

PubMed Abstract | Crossref Full Text | Google Scholar

12. Xie, Z , Violetta, L , Chen, E , Huang, K , Wu, D , Xu, X, et al. A prognostic model for hepatitis B acute-on-chronic liver failure patients treated using a plasma exchange-centered liver support system. J Clin Apher. (2020) 35:94–103. doi: 10.1002/jca.21762

PubMed Abstract | Crossref Full Text | Google Scholar

13. Sarin, SK , Choudhury, A , Sharma, MK , Maiwall, R , al Mahtab, M , Rahman, S, et al. Acute-on-chronic liver failure: consensus recommendations of the Asian Pacific association for the study of the liver (Apasl): an update. Hepatol Int. (2019) 13:353–90. doi: 10.1007/s12072-019-09946-3

PubMed Abstract | Crossref Full Text | Google Scholar

14. Liver Failure and Artificial Liver Group; Severe Liver Disease and Artificial Liver Group; Chinese Medical Association . Guideline for diagnosis and treatment of liver failure (2018). Chin J Hepatol. (2019) 27:18–26. doi: 10.3760/cma.j.issn.1007-3418.2019.01.006

Crossref Full Text | Google Scholar

15. Ishwaran, H , Kogalur, UB , Blackstone, EH , and Lauer, MS . Random survival forests. Ann App Stat. (2008) 2:841–60. doi: 10.1214/08-AOAS169

Crossref Full Text | Google Scholar

16. Mohammed, M , Mboya, IB , Mwambi, H , Elbashir, MK , and Omolo, B . Predictors of colorectal cancer survival using cox regression and random survival forests models based on gene expression data. PLoS One. (2021) 16:e0261625. doi: 10.1371/journal.pone.0261625

PubMed Abstract | Crossref Full Text | Google Scholar

17. Zhang, L , Huang, T , Xu, F , Li, S , Zheng, S , Lyu, J, et al. Prediction of prognosis in elderly patients with sepsis based on machine learning (random survival forest). BMC Emerg Med. (2022) 22:26. doi: 10.1186/s12873-022-00582-z

PubMed Abstract | Crossref Full Text | Google Scholar

18. Flamm, SL , Yang, YX , Singh, S , Falck-Ytter, YT , Flamm, SL , Lim, JK, et al. American Gastroenterological Association Institute guidelines for the diagnosis and management of acute liver failure. Gastroenterology. (2017) 152:644–7. doi: 10.1053/j.gastro.2016.12.026

PubMed Abstract | Crossref Full Text | Google Scholar

19. Liver Failure and Artificial Liver Group, Branch of Infectious Diseases, Chinese Medical Association . Guideline for non-bioartificial liver support systems in treatment of liver failure (2016). Chin J Clin Infect Dis. (2016) 9:97–103. doi: 10.3760/cma.j.issn.1674-2397.2016.02.001

Crossref Full Text | Google Scholar

20. Camp, RL , Dolled-Filhart, M , and Rimm, DL . X-tile: a new bio-informatics tool for biomarker assessment and outcome-based cut-point optimization. Clin Cancer Res. (2004) 10:7252–9. doi: 10.1158/1078-0432.CCR-04-0713

Crossref Full Text | Google Scholar

21. Moreau, R , Gao, B , Papp, M , Bañares, R , and Kamath, PS . Acute-on-chronic liver failure: a distinct clinical syndrome. J Hepatol. (2021) 75:S27–s35. doi: 10.1016/j.jhep.2020.11.047

Crossref Full Text | Google Scholar

22. Maiwall, R , Bajpai, M , Choudhury, AK , Kumar, A , Sharma, MK , Duan, Z, et al. Therapeutic plasma-exchange improves systemic inflammation and survival in acute-on-chronic liver failure: a propensity-score matched study from AARC. Liver Int. (2021) 41:1083–96. doi: 10.1111/liv.14806

PubMed Abstract | Crossref Full Text | Google Scholar

23. Zhang, J , Luo, H , Han, Y , and Zhou, X . Sequential versus mono double plasma molecular adsorption system in acute-on-chronic liver failures: a propensity-score matched study. Int J Artif Organs. (2022) 45:5–13. doi: 10.1177/0391398820987565

Crossref Full Text | Google Scholar

24. He, J , Zhang, XP , Zhou, X , Cai, ZL , Kang, XY , Duan, W, et al. Application of double plasma molecular adsorption system in children with acute liver failure. Zhongguo Dang Dai Er Ke Za Zhi. (2021) 23:180–5. doi: 10.7499/j.issn.1008-8830.2010145

PubMed Abstract | Crossref Full Text | Google Scholar

25. Guo, X , Wu, F , Guo, W , Zhang, J , Yang, Y , Lu, Y, et al. Comparison of plasma exchange, double plasma molecular adsorption system, and their combination in treating acute-on-chronic liver failure. J Int Med Res. (2020) 48:300060520932053. doi: 10.1177/0300060520932053

PubMed Abstract | Crossref Full Text | Google Scholar

26. Yao, J , Li, S , Zhou, L , Luo, L , Yuan, L , Duan, Z, et al. Therapeutic effect of double plasma molecular adsorption system and sequential half-dose plasma exchange in patients with Hbv-related acute-on-chronic liver failure. J Clin Apher. (2019) 34:392–8. doi: 10.1002/jca.21690

PubMed Abstract | Crossref Full Text | Google Scholar

27. Zhou, PQ , Zheng, SP , Yu, M , He, SS , and Weng, ZH . Prognosis of acute-on-chronic liver failure patients treated with artificial liver support system. World J Gastroenterol. (2015) 21:9614–22. doi: 10.3748/wjg.v21.i32.9614

PubMed Abstract | Crossref Full Text | Google Scholar

28. Singal, AK , and Mathurin, P . Diagnosis and treatment of alcohol-associated liver disease: a review. JAMA. (2021) 326:165–76. doi: 10.1001/jama.2021.7683

Crossref Full Text | Google Scholar

29. Gustot, T , and Jalan, R . Acute-on-chronic liver failure in patients with alcohol-related liver disease. J Hepatol. (2019) 70:319–27. doi: 10.1016/j.jhep.2018.12.008

Crossref Full Text | Google Scholar

30. Trebicka, J , Louvet, A , Arroyo, V , Jalan, R , Shah, VH , and Moreau, R . Severe alcoholic hepatitis as precipitant for organ failure and Aclf. Z Gastroenterol. (2022) 60:67–76. doi: 10.1055/a-1713-3796

PubMed Abstract | Crossref Full Text | Google Scholar

31. Kumar, SE , Goel, A , Zachariah, U , Nair, SC , David, VG , Varughese, S, et al. Low volume plasma exchange and low dose steroid improve survival in patients with alcohol-related acute on chronic liver failure and severe alcoholic hepatitis - preliminary experience. J Clin Exp Hepatol. (2022) 12:372–8. doi: 10.1016/j.jceh.2021.07.010

PubMed Abstract | Crossref Full Text | Google Scholar

32. Hadjihambi, A , Khetan, V , and Jalan, R . Pharmacotherapy for hyperammonemia. Expert Opin Pharmacother. (2014) 15:1685–95. doi: 10.1517/14656566.2014.931372

Crossref Full Text | Google Scholar

33. Zhang, Q , Shi, B , and Wu, L . Characteristics and risk factors of infections in patients with Hbv-related acute-on-chronic liver failure: a retrospective study. PeerJ. (2022) 10:e13519. doi: 10.7717/peerj.13519

PubMed Abstract | Crossref Full Text | Google Scholar

34. Cai, J , Zhang, M , Han, T , and Jiang, HQ . Characteristics of infection and its impact on short-term outcome in patients with acute-on-chronic liver failure. Medicine. (2017) 96:e8057. doi: 10.1097/MD.0000000000008057

PubMed Abstract | Crossref Full Text | Google Scholar

35. Wu, T , Li, J , Shao, L , Xin, J , Jiang, L , Zhou, Q, et al. Development of diagnostic criteria and a prognostic score for hepatitis B virus-related acute-on-chronic liver failure. Gut. (2018) 67:2181–91. doi: 10.1136/gutjnl-2017-314641

Crossref Full Text | Google Scholar

36. Vítek, L , and Ostrow, JD . Bilirubin chemistry and metabolism; harmful and protective aspects. Curr Pharm Des. (2009) 15:2869–83. doi: 10.2174/138161209789058237

Crossref Full Text | Google Scholar

37. Poupon, R . Liver alkaline phosphatase: a missing link between choleresis and biliary inflammation. Hepatology. (2015) 61:2080–90. doi: 10.1002/hep.27715

PubMed Abstract | Crossref Full Text | Google Scholar

38. Lisman, T , and Luyendyk, JP . Platelets as modulators of liver diseases. Semin Thromb Hemost. (2018) 44:114–25. doi: 10.1055/s-0037-1604091

PubMed Abstract | Crossref Full Text | Google Scholar

39. Williamson, KD , and Chapman, RW . Editorial: further evidence for the role of serum alkaline phosphatase as a useful surrogate marker of prognosis in PSC. Aliment Pharmacol Ther. (2015) 41:149–51. doi: 10.1111/apt.13004

PubMed Abstract | Crossref Full Text | Google Scholar

40. Mu, X , Zou, J , Chen, J , Tong, J , Ma, L , Ning, P, et al. Low platelets: a new and simple prognostic marker for patients with hepatitis E virus-related acute liver failure. Hepatol Int. (2022) 16:1116–26. doi: 10.1007/s12072-022-10302-1

PubMed Abstract | Crossref Full Text | Google Scholar

41. Kamath, PS , Wiesner, RH , Malinchoc, M , Kremers, W , Therneau, TM , Kosberg, CL, et al. A model to predict survival in patients with end-stage liver disease. Hepatology. (2001) 33:464–70. doi: 10.1053/jhep.2001.22172

PubMed Abstract | Crossref Full Text | Google Scholar

42. Che, XQ , Li, ZQ , Chen, Z , Guo, D , Jia, QY , Jiang, SC, et al. Plasma exchange combining with plasma bilirubin adsorption effectively removes toxic substances and improves liver functions of hepatic failure patients. Eur Rev Med Pharmacol Sci. (2018) 22:1118–25. doi: 10.26355/eurrev_201802_14400

PubMed Abstract | Crossref Full Text | Google Scholar

43. Chen, YY , Li, H , Xu, BY , Zheng, X , Li, BL , Wang, XB, et al. Plasma exchange-based non-bioartificial liver support system improves the short-term outcomes of patients with hepatitis B virus-associated acute-on-chronic liver failure: a multicenter prospective cohort study. Front Med. (2021) 8:779744. doi: 10.3389/fmed.2021.779744

PubMed Abstract | Crossref Full Text | Google Scholar

44. Li, G , Zhang, P , and Zhu, Y . Artificial liver support systems for hepatitis B virus-associated acute-on-chronic liver failure: a meta-analysis of the clinical literature. J Viral Hepat. (2023) 30:90–100. doi: 10.1111/jvh.13767

PubMed Abstract | Crossref Full Text | Google Scholar

Keywords: non-bioartificial liver support system, liver failure, random survival forests, multivariate cox regression, nomogram

Citation: Shi S, Yang Y, Liu Y, Chen R, Jia X, Wang Y and Deng C (2024) Development and validation of a machine learning model to predict prognosis in liver failure patients treated with non-bioartificial liver support system. Front. Med. 11:1368899. doi: 10.3389/fmed.2024.1368899

Received: 11 January 2024; Accepted: 29 February 2024;
Published: 13 March 2024.

Edited by:

Terry Cheuk-Fung Yip, The Chinese University of Hong Kong, Hong Kong SAR, China

Reviewed by:

Yalei Zhao, The First Affiliated Hospital of Xi'an Jiaotong University, China
Huapeng Lin, Shanghai Jiao Tong University, China

Copyright © 2024 Shi, Yang, Liu, Chen, Jia, Wang and Deng. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Chunqing Deng, 13546459087@163.com

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.