- 1Department of General Surgery, Wuxi People’s Hospital Affiliated to Nanjing Medical University, Wuxi, China
- 2Department of Neurosurgery, Wuxi People’s Hospital Affiliated to Nanjing Medical University, Wuxi, China
Background: Complications and mortality rates following gastrectomy for gastric cancer have improved over recent years; however, complications such as anastomotic leakage (AL) continue to significantly impact both immediate and long-term prognoses. This study aimed to develop a machine learning model to identify preoperative and intraoperative high-risk factors and predict mortality in patients with AL after radical gastrectomy.
Methods: For this investigation, 906 patients diagnosed with gastric cancer were enrolled and evaluated, with a comprehensive set of 36 feature variables collected. We employed three distinct machine learning algorithms—extreme gradient boosting (XGBoost), random forest (RF), and k-nearest neighbor (KNN)—to develop our models. To ensure model robustness, we applied k-fold cross-validation for internal validation of the four models and subsequently validated them using independent datasets.
Results: In contrast to the other machine learning models employed in this study, the XGBoost algorithm exhibited superior predictive performance in identifying mortality risk factors for patients with AL across one, three, and five-year intervals. The analysis identified several common risk factors affecting mortality rates at these intervals, including advanced age, hypoproteinemia, a history of anemia and hypertension, prolonged operative time, increased intraoperative bleeding, low intraoperative percutaneous arterial oxygen saturation (SPO2) levels, T3 and T4 tumors, tumor lymph node invasion, and tumor peripheral nerve invasion (PNI).
Conclusion: Among the three machine learning models examined in this study, the XGBoost algorithm exhibited superior predictive capabilities concerning the prognosis of patients with AL following gastrectomy. Additionally, the use of machine learning models offers valuable assistance to clinicians in identifying crucial prognostic factors, thereby enhancing personalized patient monitoring and management.
Introduction
Among malignant tumors, gastric cancer ranks second only to lung cancer in incidence, and its pervasive and severe nature renders it a major global public health concern. Despite considerable advancements in early detection and treatment through technological progress, gastric cancer remains a formidable threat to patient health due to its insidious and complex characteristics (1, 2). Consequently, surgery remains the principal modality for the curative treatment of this malignancy (3). Recent advancements have seen a shift from traditional open surgical approaches to minimally invasive laparoscopic and robotic techniques, leading to enhanced prognostic outcomes, reduced intraoperative trauma, and expedited postoperative recovery (4). Despite these improvements, the complex anatomical structure of the stomach, along with the distribution of adjacent lymph nodes and the technical challenges inherent in gastrectomy, often exposes patients to increased risks of severe postoperative complications such as anastomotic leakage (AL) and venous embolism (5, 6). Among the potential complications following cancer surgery, postoperative AL is particularly severe, with the potential to cause noncancer-related mortality. Additionally, AL increases the risk of subsequent complications, including anastomotic stricture and abdominal infection, which necessitate further medical interventions such as additional surgery, drainage, and antibiotic therapy. These additional medical costs can impose a significant burden on both patients and the healthcare system (7, 8).
Machine learning (ML) is a computational technique specializing in empirical prediction and pattern recognition from complex, multidimensional datasets. It leverages algorithms and statistical models to analyze vast quantities of data, uncovering latent patterns and relationships to facilitate accurate predictions and informed decisions. Recent advancements in machine learning have markedly expanded its utility in contemporary medical research. By processing intricate medical data—such as genomic sequences, medical imaging, and electronic health records—machine learning enables researchers to elucidate disease mechanisms, predict disease risk, tailor personalized treatment strategies, and enhance the precision and efficiency of clinical decision-making. The ongoing evolution of this technology increasingly augments its potential in the medical domain, offering robust support for early disease detection, treatment assessment, and novel drug development (9–11). Nonetheless, there remains a paucity of studies on machine learning models to prognosticate patients with AL following gastrectomy. Therefore, it is imperative to develop and compare prediction models based on various machine learning strategies to facilitate personalized and intelligent treatment and monitoring for postoperative patients with AL.
Materials and methods
Study Subjects
In this study, data were sourced from the clinical databases of the Affiliated Wuxi People’s Hospital of Nanjing Medical University, Wuxi Second People’s Hospital, and Shandong Provincial Hospital affiliated with Shandong First Medical University. The inclusion criteria were: (1) patients who underwent either laparoscopic-assisted or traditional open radical gastrectomy; (2) surgical teams composed of senior surgeons adept in performing radical gastrectomy; and (3) patients diagnosed with anastomotic leakage (AL). Exclusion criteria included: (1) patients with concurrent malignant tumors; (2) patients with confirmed distant metastasis of gastric cancer via pathological examination or imaging; (3) patients with severe cardiovascular or respiratory conditions; (4) patients with significant organ dysfunction, such as liver or kidney disease; and (5) patients with incomplete case, clinical data, or follow-up information. All participants were monitored for a minimum of five years post-surgery. The study was approved by the ethics committees of the Affiliated Wuxi People’s Hospital of Nanjing Medical University, Wuxi Second People’s Hospital, and Shandong Provincial Hospital affiliated with Shandong First Medical University, under approval number KY22086.
Diagnosis of AL and determination of associated factors
The diagnosis of AL in the present study adhered to the definition established by the Esophagectomy Complications Consensus Group (ECCG) (12). AL was diagnosed based on the following criteria: (1) a marked rise in the patient’s temperature following its normalization after surgery or sustained fever; (2) an increase in the leukocyte count and neutrophil ratio; (3) clinical signs of peritoneal irritation; (4) edema at the anastomotic site with observable exudate, confirmed by CT imaging; and (5) the presence of blue-colored drainage fluid in the drainage tube following methylene blue infusion. The patient met all five criteria, confirming the diagnosis of AL.
Study design and data collection
Demographic characteristics, fundamental clinical features, medical history, preoperative and postoperative laboratory indices, as well as tumor and intraoperative attributes of patients, were assessed for clinical information. Preoperative laboratory tests, including albumin (ALB), carcinoembryonic antigen (CEA), and carbohydrate antigen 19-9 (CA19-9), were obtained within 24 hours prior to surgery. Postoperative laboratory tests, comprising procalcitonin (PCT), C-reactive protein (CRP), and serum amyloid A (SAA), were collected within 48 hours following surgery. Patient demographics included sex, age, BMI, smoking history, and alcohol consumption history. Basic clinical characteristics evaluated encompassed the American Society of Anesthesiologists (ASA) score, Nutrition Risk Screening 2002 (NRS2002) score, history of previous surgeries, adjuvant chemotherapy, and adjuvant radiotherapy. Medical history information included anemia, diabetes mellitus, hypertension, chronic obstructive pulmonary disease (COPD), hyperlipidemia, and coronary heart disease (CHD). Tumor characteristics examined included tumor T-stage, N-stage, peripheral nerve invasion (PNI), tumor size, and tumor count. Intraoperative variables recorded included the type of procedure, anastomosis method and type, procedure duration, intraoperative bleeding, blood transfusion, percutaneous arterial oxygen saturation (SPO2) status, and whether the procedure was emergent. Outcome measures for this study included patient mortality at one, three, and five years.
Statistical analysis
Continuous variables were presented as medians with interquartile ranges (Q1-Q3), while categorical variables were reported as frequencies and percentages. The chi-square test was used to compare categorical variables between groups, and the t test was applied to continuous variables meeting the normality assumption. For continuous variables that did not follow a normal distribution, the rank sum test was utilized. Statistical significance was defined as a two-sided P value of less than 0.05. Statistical analyses were conducted using SPSS, R, and Python software.
Establishment and evaluation of predictive models for machine learning algorithms
(1) Data preprocessing: Patients diagnosed with gastric cancer at Wuxi People’s Hospital and Wuxi Second People’s Hospital from January 2010 to January 2018 were designated as the internal validation set, while patients from Shandong Provincial Hospital affiliated with Shandong First Medical University during the same period constituted the external validation set. The internal validation set was randomly partitioned into a training set (70%) and a test set (30%). (2) Data from the internal validation set underwent univariate analysis, with significant variables selected for the subsequent prediction model construction. (3) Build and evaluate prediction models: The selected feature variables were incorporated into prediction models utilizing three machine learning algorithms: extreme gradient boosting (XGBoost), random forest (RF), and k-nearest neighbor (KNN). K-fold cross-validation was employed to compare and select the optimal model algorithms, given its straightforward implementation and reduced bias compared to alternative methods. Hyperparameters were fine-tuned using grid search, with k-fold cross-validation conducted on the internal validation set using a resampling method with k=5. The k-fold cross-validation procedure was as follows: the dataset was divided into five subsets, one of which served as the test set while the remaining subsets constituted the training set. The model was trained and hyperparameters were adjusted using the training set, and performance was assessed using the test set. This process was iterated until each subset was used as a test set. Model evaluation metrics, including area under the curve (AUC), accuracy, sensitivity, and specificity, were recorded and averaged across the k iterations to provide a comprehensive estimate of model performance. We further assessed the models for their ability to predict the three outcome indicators by examining their discrimination, calibration, and clinical utility. The best model was selected for prediction analysis. We plotted receiver operating characteristic (ROC) curves to derive area under the curve (AUC) values and assess the model’s predictive performance. Calibration curves were also plotted to compare predicted outcomes with actual results. Additionally, decision curve analysis (DCA) was performed to evaluate whether model-based decisions were beneficial to patients. The DCA curve begins at the intersection of the red curve with the “All” curve and concludes at the intersection of the red curve with the “None” curve, within which patient benefit is indicated. (4) The optimal model was validated using an external test set, with ROC curves plotted to evaluate its generalizability and predictive accuracy. (5) Model interpretation: The influence of each feature on predictions was analyzed using SHAP (Shapley Additive Explanations) analysis, which calculates Shapley values. These values were utilized to create SHAP summary plots, facilitating the ranking of risk factor importance.
Results
Clinical information of the patients
The study encompassed a total of 906 patients, of whom 86 (9.49%) succumbed within one year, 270 (29.8%) within three years, and 366 (40.4%) within five years (Figures 1A, B). Within this cohort, 713 patients with gastric cancer constituted the internal validation set, with 66 (9.26%) one-year deaths, 206 (28.89%) three-year deaths, and 281 (39.41%) five-year deaths. The external validation set comprised 193 gastric cancer patients, of whom 20 (10.36%) died within one year, 64 (33.16%) within three years, and 85 (44.04%) within five years. The original data presented in the study are detailed in Supplementary Table S1.
Figure 1. Model-making process and flowchart of the study. (A) Study design flow chart. (B) Flow diagram of patients included in the study.
Screening for risk factors for death at one, three and five years in patients with AL
The findings from univariate analysis demonstrated that certain factors independently influenced one-year mortality in patients with AL. These factors included age, albumin levels, NRS2002 score, history of anemia and hypertension, emergency surgery, operative time, intraoperative bleeding and SPO2 levels, tumor T stage, tumor lymph node invasion, and tumor PNI (P<0.05). Similarly, for three-year mortality in patients with AL, age, ALB levels, history of anemia and hypertension, time of surgery, intraoperative bleeding, blood transfusion, intraoperative SPO2 levels, tumor T stage, tumor lymph node invasion, and tumor PNI were found to be significant independent influencing factors. In addition, sex, age, ALB levels, history of anemia and hypertension, surgical approach, operative time, intraoperative bleeding and blood transfusion, intraoperative SPO2 levels, tumor size, tumor T-stage, tumor lymph node invasion, and tumor PNI were found to significantly influence five-year mortality in patients with AL (Table 1). We additionally compared the baseline characteristics of the internal validation set with those of the external validation set, as well as the training set with the test set, identifying differences in several aspects. These findings further underscore the model’s generalizability and its potential applicability across a wider range of clinical scenarios (Supplementary Tables S2, S3).
Model building and evaluation
In the prediction analysis of one-year mortality in patients with anastomotic leakage (AL), the ROC curve results demonstrated that XGBoost achieved an AUC of 0.986 in the training set and 0.715 in the validation set. For three-year mortality prediction, XGBoost yielded an AUC of 0.994 in the training set and 0.825 in the validation set. For five-year mortality prediction, XGBoost attained an AUC of 0.997 in the training set and 0.946 in the validation set. Among the three algorithms evaluated, XGBoost exhibited superior performance across all three outcome indicators (Table 2). The calibration curves for all models closely approximated the ideal curves, reflecting strong concordance between predicted and actual outcomes. Additionally, decision curve analysis (DCA) curves indicated that all models provided a net clinical benefit relative to both full treatment and no treatment strategies, suggesting that employing these models for treatment decisions could be advantageous for patients (Figures 2A–L).
Figure 2. Evaluation of the three models for predicting prognosis. (A) ROC curves for the training set of three models predicting patient death at one year. (B) ROC curves for the validation set of three models predicting patient death at one year. (C) Calibration plots of the three models predicting patient death at one year. (D) DCA curves of the three models predicting patient death at one year. (E) ROC curves for the training set of three models predicting patient death at three years. (F) ROC curves for the validation set of three models predicting patient death at three years. (G) Calibration plots of the three models predicting patient death at three years. (H) DCA curves of the three models predicting patient death at three years. (I) ROC curves for the training set of three models predicting patient death at five years. (J) ROC curves for the validation set of three models predicting patient death at five years. (K) Calibration plots of the three models predicting patient death at five years. (L) DCA curves of the three models predicting patient death at five years.
The k-fold cross-validation method was employed to assess the generalization capabilities of the three models. A test set of 214 cases (30.01%) was selected, with the remaining samples used as the training set for 5-fold cross-validation. For the prediction of one-year mortality, XGBoost achieved an AUC of 0.7500 ± 0.0269 in the validation set and 0.7429 in the test set, with an accuracy of 0.8551 (Figures 3A–C). In contrast, Random Forest (RF) produced an AUC of 0.6737 ± 0.0736 in the validation set and 0.5842 in the test set, with an accuracy of 0.7477. The k-nearest neighbor (KNN) algorithm yielded an AUC of 0.6122 ± 0.0840 in the validation set and 0.6314 in the test set, with an accuracy of 0.8972.
Figure 3. Internal validation of the XGBoost model. (A) ROC curve for the training set of the XGBoost model predicting patient death at one year. (B) ROC curves for the validation set of the XGBoost model predicting patient death at one year. (C) ROC curves for the test set of the XGBoost model predicting patient death at one year. (D) External validation of the XGBoost model predicting patient death at one year. (E) ROC curves for the training set of the XGBoost model predicting patient death at three years. (F) ROC curves for the validation set of the XGBoost model predicting patient death at three years. (G) ROC curves for the test set of the XGBoost model predicting patient death at three years. (H) External validation of the XGBoost model predicting patient death at three years. (I) ROC curves for the training set of the XGBoost model predicting patient death at five years. (J) ROC curves for the validation set of the XGBoost model predicting patient death at five years. (K) ROC curves for the test set of the XGBoost model predicting patient death at five years. (L) External validation of the XGBoost model predicting patient death at five years.
For the prediction of three-year mortality, XGBoost attained an AUC of 0.8596 ± 0.0189 in the validation set and 0.8613 in the test set, with an accuracy of 0.7991 (Figures 3E–G). Conversely, RF exhibited an AUC of 0.7366 ± 0.0313 in the validation set and 0.7549 in the test set, with an accuracy of 0.7056. KNN provided an AUC of 0.8096 ± 0.0202 in the validation set and 0.8102 in the test set, with an accuracy of 0.7850.
The performance of the three models in predicting five-year mortality was as follows: XGBoost achieved an AUC of 0.9465 ± 0.0144 in the validation set and 0.9385 in the test set, with an accuracy of 0.8832 (Figures 3I–K). Random Forest (RF) yielded an AUC of 0.7677 ± 0.0634 in the validation set and 0.7977 in the test set, with an accuracy of 0.7523, while k-nearest neighbor (KNN) attained an AUC of 0.9076 ± 0.0197 in the validation set and 0.9207 in the test set, with an accuracy of 0.8458. After a thorough comparison, XGBoost was selected for model construction in this study.
Model external validation
The AUC values for the external validation set in predicting one-year, three-year, and five-year mortality were 0.70, 0.73, and 0.75, respectively. These values underscore the high accuracy of the prediction model in assessing disease outcomes (Figures 3D, H, L).
Model explanation
According to the SHAP summary plot results, the risk factors associated with one-year mortality in patients who underwent gastrectomy and developed anastomotic fistula were ranked as follows: low intraoperative SPO2, tumor lymph node invasion, hypoproteinemia, advanced age, history of anemia, NRS2002 score, history of hypertension, tumor peripheral nerve invasion (PNI), high intraoperative bleeding, tumors at T3 and T4 stages, and prolonged operative time. The SHAP summary plot results indicated that the risk factors for three-year patient mortality in those with AL after gastrectomy were ranked as follows: lower intraoperative SPO2, tumor lymph node invasion, tumors in T3 and T4, hypoproteinemia, advanced age, longer operative time, history of anemia, higher intraoperative bleeding, history of hypertension, surgical approach, and tumor PNI. The SHAP summary plot results indicated that the risk factors for patient mortality at five years in patients with AL after gastrectomy were ranked as follows: hypoproteinemia, advanced age, low intraoperative SPO2, history of anemia, tumors in T3 and T4, higher intraoperative bleeding, longer operative time, tumor lymph node invasion, sex, surgical approach, history of hypertension, intraoperative blood transfusion, and tumor PNI (Figures 4A–C).
Figure 4. SHAP summary plot. Risk factors are arranged along the y-axis based on their importance, which is given by the mean of their absolute Shapley values. The higher the risk factor is positioned in the plot, the more important it is for the model. (A) SHAP summary plot of models predicting patient death at one year. (B) SHAP summary plot of models predicting patient death at three years. (C) SHAP summary plot of models predicting patient death at five years.
Common factors that contribute to patient mortality over one, three, and five years include advanced age, hypoproteinemia, previous instances of anemia and hypertension, prolonged surgical intervention, heightened intraoperative hemorrhage, suboptimal intraoperative blood oxygen saturation, malignancies in T3 and T4 stages, tumor infiltration in regional lymph nodes, and involvement of peripheral nerves by the tumor.
Discussion
This study assessed risk prediction models constructed using three machine learning algorithms, with XGBoost emerging as the most accurate. Unlike the RF algorithm, XGBoost employs an adaptive gradient boosting technique that autonomously identifies optimal splitting points and tree depths, thereby enhancing predictive performance. Furthermore, XGBoost effectively mitigates regularization challenges, reducing the risk of overfitting (13, 14). Although the KNN algorithm is lauded for its precision and capacity to minimize overfitting, it demands computationally intensive searches for the K nearest neighbors and distance calculations for each test instance, resulting in significant computational complexity. Moreover, KNN shows diminished robustness and efficiency when dealing with complex scenarios involving numerous features and large datasets (15). In contrast, XGBoost excels in handling multidimensional analyses, reduces computational burden and training time, and offers a feature importance evaluation function that enhances model interpretability. Thus, following a comprehensive comparison of the three algorithms, XGBoost was chosen for developing a model to predict postoperative mortality in patients with AL.
At the outset of the study, we also considered employing other machine learning algorithms for feature selection, such as neural networks, logistic regression, or Bayesian classifiers. However, logistic regression, being a linear model, assumes a linear relationship between features and target variables. In our dataset, the factors influencing mortality in patients with AL encompass numerous complex preoperative and intraoperative variables, potentially involving nonlinear and interactive effects, which logistic regression may not sufficiently capture. Moreover, logistic regression is more sensitive to the distribution of input data and may require extensive feature transformations and preprocessing (e.g., polynomial features, interaction terms) to perform optimally. Instead, we sought algorithms better equipped to handle nonlinear relationships in complex datasets, such as XGBoost and Random Forest, which are more adept at addressing nonlinear problems. While neural networks possess considerable learning capacity, they are susceptible to overfitting due to their large number of parameters, especially when applied to relatively small datasets (e.g., our cohort of 906 patients), where the model may overfit the training set and underperform on the validation set. In contrast, XGBoost and Random Forest are more effective at preventing overfitting and are particularly well-suited for managing the intricacies of clinical data.
Clinical studies often reveal nonlinear effects of various risk factors on patient prognosis, especially in cancer research, where conventional models may struggle to provide accurate predictions. Machine learning, however, excels in training algorithms to recognize complex patterns and adapt to intricate nonlinear relationships, potentially outperforming traditional models in medical research. Liao et al. (16, 17) demonstrated the effectiveness of machine learning algorithms in clinical diagnosis and prognosis, showing that this artificial intelligence technique can accurately predict adverse outcomes in disease progression. This study also leveraged machine learning to construct a predictive model, which can aid clinical decision-makers in accurately identifying high-risk patients and implementing timely interventions to enhance patient prognosis. Moreover, the model can assist medical institutions in the efficient allocation of resources, monitoring vital signs of high-risk patients, and improving the survival rate of gastric cancer patients.
The present study highlighted a higher mortality rate among patients with AL and hypertension. Hypertensive patients often have prolonged high vascular pressure, characterized by reduced elastic fibers and increased collagen fibers in the vessel walls, which elevates the risk of intraoperative bleeding and impairs recovery (18). Afshin (19) observed that hypertensive individuals experience varying degrees of edema in the intestinal wall due to suboptimal cardiovascular system regulation, which undermines the anastomotic site and increases the likelihood of leakage recurrence. Furthermore, fluid compression can lead to insufficient blood supply to the intestinal wall, hindering the healing of the anastomotic segment. Hypertensive patients may also exhibit reduced healing capacity due to their heightened stress levels, which can foster conditions conducive to microbial invasion and proliferation, thereby escalating the risk of inflammatory reactions and adverse prognoses (20, 21). This underscores the need for rigorous monitoring and regular medication during the perioperative period for patients with underlying conditions such as hypertension and diabetes mellitus to manage blood pressure and glucose levels effectively. Clinicians should also offer appropriate counseling to prevent fluctuations in these parameters due to sympathetic excitation, and administer prophylactic antibiotics to avert postoperative infections and complications.
Moreover, research has underscored that the nutritional status of oncology patients is pivotal in determining their prognosis. Patients suffering from anemia and hypoproteinemia exhibit an elevated risk of mortality. Plasma albumin, although a small molecular weight protein, is significantly more abundant than other plasma proteins and plays a critical role in sustaining blood and tissue fluid osmotic pressure. Hypoalbuminemia leads to decreased plasma osmolarity, resulting in intestinal edema and impeding anastomotic healing (21). Additionally, a sufficient blood supply is crucial for the healing of anastomoses, and anemia impairs the delivery of essential nutrients and oxygen, thereby exacerbating the risk of poor outcomes. Preoperative levels of albumin and hemoglobin are also vital for tumor cell immune responses. Patients with compromised nutritional status possess fewer and less active enzymes for antibody synthesis, which heightens the risk of complications such as postoperative infections and AL recurrence (22, 23). Clinicians should regularly assess all nutritional indicators and enhance parenteral nutrition as needed. When patients are able to eat, it is advisable to supplement their diet with high-protein foods.
The findings of this study highlight that extended operative time and heightened intraoperative bleeding are significant risk factors for mortality in patients with postoperative AL. These factors are likely to exacerbate the inflammatory response in patients with compromised physical condition. Additionally, increased apoptosis of macrophages in the internal environment can disrupt normal immune function (24, 25). Such disruptions elevate the risk of complications, including anastomotic infection and AL. Moreover, excessive intraoperative bleeding further diminishes blood supply to the anastomotic segment, impeding its healing. It is advisable for the surgical team to formulate a well-considered surgical plan preoperatively and to collaborate effectively during the procedure to enhance operational efficiency, reduce operative time, and minimize intraoperative bleeding.
Similar to previous studies, the current study has also demonstrated that tumors with higher invasiveness, lymph node metastasis, and PNI are associated with a higher risk of poor prognosis in patients. Such tumors exhibit a high rate of proliferation and low degree of differentiation and possess various protein hydrolases that allow them to degrade the extracellular matrix and basement membrane, facilitating detachment from the primary site. Some of the detached tumor cells invade the surrounding healthy tissues, while others migrate to nearby lymph nodes. The gastric plasma membrane layer, which is abundant in blood vessels, makes it easier for gastric cancer cells to invade the surrounding lymph nodes and cause vascular invasion. Consequently, tumor cells may spread through the portal vein system to the liver, forming distant metastatic foci (26, 27). In contrast, the presence of lymph node metastasis in gastric cancer poses a challenge for achieving complete resection during radical surgery. The abundant lymph node network within the large omentum surrounding the tumor can facilitate ongoing tumor spread following invasion. The extent of tumor spread cannot be identified with the naked eye, complicating the determination of the appropriate scope for surgical resection. Additionally, tumor cells often metastasize to retroperitoneal organs via lymph nodes, with clinical manifestations in patients frequently being subtle and imaging examinations lacking specificity, which exacerbates the mortality risk of gastric cancer patients following surgery (28).
Furthermore, this investigation revealed that SPO2 levels below 90% constitute a high-risk factor for mortality in patients with postoperative AL. We hypothesize that the preoperative physical condition of these patients, combined with insufficient oxygen supply during surgery, may impair cardiomyocyte function, potentially compromising cardiac contractility and leading to cardiovascular complications, such as heart failure. Moreover, low SPO2 levels may increase blood viscosity, obstruct normal blood flow, and further strain the heart and blood vessels (29). Additionally, compromised metabolic and reparative capacities of the patient’s tissues may result in heightened production and release of cytokines and growth factors, thereby increasing the risk of postoperative AL recurrence (30).
In clinical practice, for patients with AL following gastric cancer surgery, patient monitoring and the use of multiple imaging modalities are commonly employed to diagnose and evaluate the occurrence and severity of the fistula. For instance, patients may be given oral water-soluble contrast agents, followed by X-ray imaging to detect contrast agent extravasation, which indicates the presence of an AL. Alternatively, an enhanced CT scan of the abdomen may be used to help clinicians identify localized leakage around the anastomosis, fluid accumulation, abscesses, or gas buildup in the abdominal cavity. CT scans are particularly valuable in assessing the extent and severity of the AL, especially in complex cases. In certain situations, invasive upper gastrointestinal endoscopy may be utilized to detect fissures or ulcers, guiding subsequent therapeutic interventions.
While these diagnostic tools are crucial for early detection and timely intervention, they present a twofold challenge: on one hand, they contribute to the financial burden on patients; on the other, invasive procedures may exacerbate patient stress and physical discomfort. In regions with limited health insurance coverage or countries where out-of-pocket healthcare expenses are high, these additional costs can impose severe financial strain on patients and their families. This financial pressure may compel some to delay or forgo necessary diagnostic tests and treatments, adversely affecting their prognosis. Moreover, patients who have recently undergone radical gastric cancer surgery are often in a weakened state, and further invasive procedures may trigger stress responses, manifesting as elevated blood pressure, increased heart rate, and heightened pain. Repeated invasive interventions may also increase the risk of secondary complications, such as infection or bleeding, thereby hindering the patient’s recovery.
This study has identified the key high-risk factors influencing patient prognosis. For such high-risk individuals, we will prioritize close monitoring in future clinical practice, utilizing imaging tests as needed to assist with diagnosis and treatment. Conversely, for asymptomatic and low-risk patients, we will employ auxiliary tests more judiciously, thereby alleviating the financial burden on patients and their families while ensuring optimal care.
The present study undertook a thorough evaluation of the model concerning discrimination, calibration, and clinical utility; however, it possesses certain limitations. While a range of risk factors was included, imaging aspects were not considered. Additionally, despite the higher precision of machine learning algorithms, their models are complex and less interpretable. The computational and decision-making processes of the model function within a “black box,” lacking the transparency and intuitiveness of traditional logistic regression models (31, 32). The risk factors identified in this study are not only linked to the development of AL but also serve as crucial determinants of long-term patient prognosis. In future research, we aim to further validate and refine the specific roles of these risk factors across varied clinical contexts by leveraging larger patient cohorts and conducting more detailed analyses in conjunction with treatment regimens, such as chemotherapy duration and dosage. This approach will help to deepen our understanding of how these factors influence outcomes and inform more personalized treatment strategies. Furthermore, as a retrospective study, it is vulnerable to selection bias, distribution bias, and retrospective bias. Therefore, it is crucial to validate the reliability of these findings through subsequent international, multicenter, large-scale studies.
This study demonstrated the exceptional predictive performance of machine learning algorithms such as XGBoost and highlighted its robust interpretability. By utilizing XGBoost models, we confirmed that factors such as advanced age, hypoproteinemia, and a history of anemia were significantly correlated with the prognosis of patients experiencing AL after radical gastric cancer surgery. These models not only accurately forecast patients’ short- and long-term mortality risk but also provide clinicians with a valuable tool to pinpoint key prognostic factors. In future research, we intend to integrate the machine learning models developed in this study into the hospital’s electronic health record (EHR) systems. This integration aims to enhance post-surgical management and safety for gastric cancer patients through automated prediction and real-time risk assessment. By optimizing individualized risk assessment and providing clinicians with more reliable tools for early identification of high-risk patients, we expect to enable timely interventions, ultimately improving patient outcomes.
Conclusion
TIn conclusion, this study successfully developed an XGBoost-based machine learning model for predicting mortality risk in patients undergoing radical gastrectomy with AL. The model demonstrated robust predictive accuracy and clinical utility, offering surgeons a valuable tool for timely diagnosis. Key predictors of mortality identified included advanced age, hypoproteinemia, a history of anemia, a history of hypertension, prolonged operative duration, substantial intraoperative blood loss, low intraoperative SPO2, tumors classified as T3 and T4, lymph node metastasis, and PNI.
Data availability statement
The original contributions presented in the study are included in the article/Supplementary Material. Further inquiries can be directed to the corresponding authors.
Ethics statement
The studies involving humans were approved by The ethics committees of the Affiliated Wuxi People’s Hospital of Nanjing Medical University, Wuxi Second People’s Hospital, and Shandong Provincial Hospital affiliated with Shandong First Medical University. The studies were conducted in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study. Written informed consent was obtained from the individual(s) for the publication of any potentially identifiable images or data included in this article.
Author contributions
YL: Conceptualization, Data curation, Investigation, Methodology, Project administration, Software, Supervision, Validation, Writing – original draft, Writing – review & editing. SZ: Conceptualization, Data curation, Investigation, Methodology, Project administration, Supervision, Writing – original draft, Writing – review & editing. XS: Data curation, Formal analysis, Investigation, Methodology, Project administration, Software, Supervision, Validation, Writing – review & editing. WS: Funding acquisition, Investigation, Methodology, Project administration, Resources, Software, Supervision, Validation, Visualization, Writing – review & editing. WD: Conceptualization, Formal analysis, Funding acquisition, Investigation, Project administration, Resources, Software, Validation, Visualization, Writing – review & editing. NZ: Data curation, Funding acquisition, Investigation, Methodology, Project administration, Resources, Software, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing.
Funding
The author(s) declare financial support was received for the research, authorship, and/or publication of this article. This work was supported by the Top Talent Support Program for young and middle-aged people of Wuxi Health Committee (Grant No. HB2020007).
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fonc.2024.1471137/full#supplementary-material
Supplementary Table 1 | Raw Data.
Supplementary Table 2 | The baseline characteristics of the internal validation set with the external validation set.
Supplementary Table 3 | The baseline characteristics of the training set with the test set.
References
1. Navashenaq JG, Shabgah AG, Banach M, Jamialahmadi T, Penson PE, Johnston TP, et al. The interaction of Helicobacter pylori with cancer immunomodulatory stromal cells: New insight into gastric cancer pathogenesis. Semin Cancer Biol. (2022) 86:951–9. doi: 10.1016/j.semcancer.2021.09.014
2. Melloni M, Bernardi D, Asti E, Bonavina L. Perforated gastric cancer: A systematic review. J Laparoendosc Adv Surg Tech A. (2020) 30:156–62. doi: 10.1089/lap.2019.0507
3. Huang L, Guo J, Yin B, Zeng Y, Li N. Clinical effect analysis of laparoscopic surgery for gastric tumor under data mining. J Healthc Eng. (2021) 2021:7779693. doi: 10.1155/2021/7779693
4. Kakinuma D, Arai H, Yasuda T, Kanazawa Y, Matsuno K, Sakurazawa N, et al. Treatment of gastric cancer in Japan. J Nippon Med Sch. (2021) 88:156–62. doi: 10.1272/jnms.JNMS.2021_88-315
5. Makuuchi R, Irino T, Tanizawa Y, Bando E, Kawamura T, Terashima M. Esophagojejunal anastomotic leakage following gastrectomy for gastric cancer. Surg Today. (2019) 49:187–96. doi: 10.1007/s00595-018-1726-8
6. Li XP, Wang YY, Sun YS, Zhang LJ, Zhao XY, Liu ZQ, et al. Preoperative and postoperative clinical signatures of postgastrectomy venous thromboembolism (VTE) in patients with gastric cancer: A retrospective cohort study. Asian J Surg. (2022).
7. Vetter D, Gutschow CA. Strategies to prevent anastomotic leakage after esophagectomy and gastric conduit reconstruction. Langenbecks Arch Surg. (2020) 405:1069–77. doi: 10.1007/s00423-020-01926-8
8. Liu X, Lei S, Wei Q, Wang Y, Liang H, Chen L. Machine learning-based correlation study between perioperative immunonutritional index and postoperative anastomotic leakage in patients with gastric cancer. Int J Med Sci. (2022) 19:1173–83. doi: 10.7150/ijms.72195
9. Liu D, Wang X, Li L, Jiang Q, Li X, Liu M, et al. Machine learning-based model for the prognosis of postoperative gastric cancer. Cancer Manag Res. (2022) 14:135–55. doi: 10.2147/CMAR.S342352
10. Arai J, Aoki T, Sato M, Niikura R, Suzuki N, Ishibashi R, et al. Machine learning-based personalized prediction of gastric cancer incidence using the endoscopic and histologic findings at the initial endoscopy. Gastrointest Endosc. (2022) 95:864–72. doi: 10.1016/j.gie.2021.12.033
11. Sundar R, Barr Kumarakulasinghe N, Huak Chan Y, Yoshida K, Yoshikawa T, Miyagi Y, et al. Machine-learning model derived gene signature predictive of paclitaxel survival benefit in gastric cancer: results from the randomised phase III SAMIT trial. Gut. (2022) 71:676–85. doi: 10.1136/gutjnl-2021-324060
12. Low DE, Alderson D, Cecconello I, Chang AC, Darling GE, DʼJourno XB, et al. International consensus on standardization of data collection for complications associated with esophagectomy: esophagectomy complications consensus group (ECCG). Ann Surg. (2015) 262:286–94. doi: 10.1097/SLA.0000000000001098
13. Wang L, Wang X, Chen A, Jin X, Che H. Prediction of type 2 diabetes risk and its effect evaluation based on the XGBoost model. Healthcare (Basel). (2020) 8. doi: 10.3390/healthcare8030247
14. Kumar A, Arora HC, Kapoor NR, Kumar K, Hadzima-Nyarko M, Radu D. Machine learning intelligence to assess the shear capacity of corroded reinforced concrete beams. Sci Rep. (2023) 13:2857. doi: 10.1038/s41598-023-30037-9
15. Zhou X, Wang H, Xu C, Peng L, Xu F, Lian L, et al. Application of kNN and SVM to predict the prognosis of advanced schistosomiasis. Parasitol Res. (2022) 121:2457–60. doi: 10.1007/s00436-022-07583-8
16. Liao KM, Liu CF, Chen CJ, Feng JY, Shu CC, Ma YS. Using an artificial intelligence approach to predict the adverse effects and prognosis of tuberculosis. Diagnostics (Basel). (2023) 13. doi: 10.3390/diagnostics13061075
17. Xie W, Li Y, Meng X, Zhao M. Machine learning prediction models and nomogram to predict the risk of in-hospital death for severe DKA: A clinical study based on MIMIC-IV, eICU databases, and a college hospital ICU. Int J Med Inform. (2023) 174:105049. doi: 10.1016/j.ijmedinf.2023.105049
18. Ejaz A, Spolverato G, Kim Y, Poultsides GA, Fields RC, Bloomston M, et al. Impact of body mass index on perioperative outcomes and survival after resection for gastric cancer. J Surg Res. (2015) 195:74–82. doi: 10.1016/j.jss.2014.12.048
19. Afshin A, Forouzanfar MH, Reitsma MB, Sur P, Estep K, Lee A, et al. Health effects of overweight and obesity in 195 countries over 25 years. N Engl J Med. (2017) 377:13–27. doi: 10.1056/NEJMoa1614362
20. Cong ZJ, Fu CG, Wang HT, Liu LJ, Zhang W, Wang H. Influencing factors of symptomatic anastomotic leakage after anterior resection of the rectum for cancer. World J Surg. (2009) 33:1292–7. doi: 10.1007/s00268-009-0008-4
21. Barlow R, Price P, Reid TD, Hunt S, Clark GW, Havard TJ, et al. Prospective multicentre randomised controlled trial of early enteral nutrition for patients undergoing major upper gastrointestinal surgical resection. Clin Nutr. (2011) 30:560–6. doi: 10.1016/j.clnu.2011.02.006
22. Portanova M. Successful enteral nutrition in the treatment of esophagojejunal fistula after total gastrectomy in gastric cancer patients. World J Surg Oncol. (2010) 8:71. doi: 10.1186/1477-7819-8-71
23. Rudin C. Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nat Mach Intell. (2019) 1:206–15. doi: 10.1038/s42256-019-0048-x
24. Zarnescu EC, Zarnescu NO, Costea R. Updates of risk factors for anastomotic leakage after colorectal surgery. Diagnostics (Basel). (2021) 11. doi: 10.3390/diagnostics11122382
25. Sciuto A, Merola G, De Palma GD, Sodo M, Pirozzi F, Bracale UM, et al. Predictive factors for anastomotic leakage after laparoscopic colorectal surgery. World J Gastroenterol. (2018) 24:2247–60. doi: 10.3748/wjg.v24.i21.2247
26. Yu D, Yang J, Jin M, Zhou B, Shi L, Zhao L, et al. Fecal streptococcus alteration is associated with gastric cancer occurrence and liver metastasis. mBio. (2021) 12:e0299421. doi: 10.1128/mBio.02994-21
27. Luo Z, Rong Z, Huang C. Surgery strategies for gastric cancer with liver metastasis. Front Oncol. (2019) 9:1353. doi: 10.3389/fonc.2019.01353
28. Xiaobin C, Zhaojun X, Tao L, Tianzeng D, Xuemei H, Fan Z, et al. Analysis of related risk factors and prognostic factors of gastric cancer with bone metastasis: A SEER-based study. J Immunol Res. (2022) 2022:3251051. doi: 10.1155/2022/3251051
29. Mutsuyoshi Y, Ito K, Ookawara S, Uchida T, Morishita Y. Difference in cerebral and hepatic oxygenation in response to ultrafiltration in a hemodialysis patient with congestive heart failure. Cureus. (2021) 13:e13023. doi: 10.7759/cureus.13023
30. Ishikawa S, Akune T, Ishibashi T, Makita K. A case of unexpected impaired oxygenation due to intraoperative pneumothorax: an adverse event associated with respiratory management with spontaneous respiration in a patient with esophagobronchial fistulae. JA Clin Rep. (2017) 3:31. doi: 10.1186/s40981-017-0102-9
31. Nohara Y, Iihara K, Nakashima N. Interpretable machine learning techniques for causal inference using balancing scores as meta-features. Annu Int Conf IEEE Eng Med Biol Soc. (2018) 2018:4042–5. doi: 10.1109/EMBC.2018.8513026
Keywords: gastric tumor, gastrectomy, anastomotic leakage, prognosis, risk factor, machine learning
Citation: Liu Y, Zhao S, Shang X, Shen W, Du W and Zhou N (2024) Identification of intraoperative hypoxemia and hypoproteinemia as prognostic indicators in anastomotic leakage post-radical gastrectomy: an 8-year multicenter study utilizing machine learning techniques. Front. Oncol. 14:1471137. doi: 10.3389/fonc.2024.1471137
Received: 26 July 2024; Accepted: 12 November 2024;
Published: 27 November 2024.
Edited by:
Pradeep Kumar Shukla, University of Tennessee Health Science Center (UTHSC), United StatesReviewed by:
Christian Cotsoglou, IRCCS San Gerardo dei Tintori Foundation, ItalyWencai Liu, Shanghai Jiao Tong University, China
Copyright © 2024 Liu, Zhao, Shang, Shen, Du and Zhou. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Wenyi Du, MjAyMTEyMjE4M0BzdHUubmptdS5lZHUuY24=; Ning Zhou, dXJzdWxhMWE1Ym9zQGhvdG1haWwuY29t
†These authors have contributed equally to this work