Skip to main content

ORIGINAL RESEARCH article

Front. Surg., 11 June 2024
Sec. Surgical Oncology

Comparison of the predictive performance of three lymph node staging systems for late-onset gastric cancer patients after surgery

\r\nSheng ChenSheng Chen1Ping&#x;an Ding,,Ping’an Ding2,3,4Qun Zhao,,
\r\nQun Zhao2,3,4*
  • 1Affiliated Hospital of Hebei University, Baoding, Hebei, China
  • 2The Third Department of Surgery, The Fourth Hospital of Hebei Medical University, Shijiazhuang, Hebei, China
  • 3Hebei Key Laboratory of Precision Diagnosis and Comprehensive Treatment of Gastric Cancer, Shijiazhuang, Hebei, China
  • 4Big Data Analysis and Mining Application for Precise Diagnosis and Treatment of Gastric Cancer Hebei Provincial Engineering Research Center, Shijiazhuang, Hebei, China

Introduction: Lymph node (LN) status is a vital prognostic factor for patients. However, there has been limited focus on predicting the prognosis of patients with late-onset gastric cancer (LOGC). This study aimed to investigate the predictive potential of the log odds of positive lymph nodes (LODDS), lymph node ratio (LNR), and pN stage in assessing the prognosis of patients diagnosed with LOGC.

Methods: The LOGC data were obtained from the Surveillance, Epidemiology, and End Results database. This study evaluated and compared the predictive performance of three LN staging systems. Univariate and multivariate Cox regression analyses were carried out to identify prognostic factors for overall survival (OS). Three machine learning methods, namely, LASSO, XGBoost, and RF analyses, were subsequently used to identify the optimal LN staging system. A nomogram was built to predict the prognosis of patients with LOGC. The efficacy of the model was demonstrated through receiver operating characteristic (ROC) curve analysis and decision curve analysis.

Results: A total of 4,743 patients with >16 removed lymph nodes were ultimately included in this investigation. Three LN staging systems demonstrated significant performance in predicting survival outcomes (P < 0.001). The LNR exhibited the most important prognostic ability, as evidenced by the use of three machine learning methods. Utilizing independent factors derived from multivariate Cox regression analysis, a nomogram for OS was constructed.

Discussion: The calibration, C-index, and AUC revealed their excellent predictive performance. The LNR demonstrated a more powerful performance than other LN staging methods in LOGC patients after surgery. Our novel nomogram exhibited superior clinical feasibility and may assist in patient clinical decision-making.

Introduction

Gastric cancer (GC), a primary global health concern, has become the fifth most diagnosed malignancy and the fourth leading cause of cancer-related mortality worldwide. According to the Global Cancer Statistics, it is estimated that 1,089,103 new GC cases were diagnosed, resulting in 768,793 deaths worldwide in 2020 (1). Projected estimates suggest that by 2040, the number of new cases may increase to 1.77 million, with the number of deaths potentially reaching 1.27 million (2). In recent decades, with the advancement of screening and therapeutic strategies, the incidence and mortality of GC have decreased substantially in most parts of the world, especially in some Western countries (2, 3). However, with the aging of the population, the disease burden on middle-aged and elderly people has increased (4). The number of middle-aged and elderly GC patients who are diagnosed is expected to increase gradually (5). According to research findings, the incidence, mortality and disability-adjusted life-years burden of patients with late-onset gastric cancer (LOGC) are greater than those of patients with early-onset GC in China (6). Therefore, finding a precise, convenient, accurate, and effective risk model is vital for predicting the clinical prognosis of these patients and selecting the optimal treatment.

Lymph node metastasis (LNM) is the site of disease spread in >50% of GC patients and is closely related to early recurrence and poor prognosis (7, 8). The regional lymph node (LN) status is a valid criterion for considering perioperative chemotherapy (9). Postoperative therapy is typically recommended for patients with advanced disease, such as N1 or N2 (10). The number of metastatic LNs in GC patients is a great indicator of prognosis and recurrence (11). Accurate LN staging plays a critical role in the selection of treatment strategies and the determination of prognosis for LOGC patients after surgery. Currently, the N-stage classification scheme of the tumor–node–metastasis (TNM) system is widely recommended for classifying LN status (12). However, due to some clinical limitations, the use of the pN staging system, such as stage migration, has been disputed by some researchers (13, 14), which may cause the misorientation of treatment selection and the inaccuracy of prognosis prediction (15). In the last decade, several LN classification factors, including the lymph node ratio (LNR) and log odds ratio of positive lymph nodes (LODDS), have been applied to illustrate LN status as a substitution for the pN staging system. The LNR and LODDS have been demonstrated to be prognostic markers for numerous malignancies, such as lung carcinoma (16), esophageal carcinoma (17), breast cancer (18), rectal cancer (19, 20), and GC (21, 22). However, there are some controversies in which the nodal staging system is the most applicable for evaluating the accuracy of LN status, and there is insufficient evidence for screening the most appropriate nodal staging system for LOGC patients. Therefore, it is essential to explore a more efficacious and accurate LN scheme for LOGC patients to improve prognosis and guide therapeutic strategy decisions.

Thus, this study aimed to assess the appropriate nodal staging system by comparing the predictive prognostic ability of the pN, LNR, and LODDS nodal staging systems among the LOGC group and utilized the most optimal scheme to construct a nomogram model for predicting survival in cases with LOGC after surgery.

Materials and methods

Database and population selection

The data utilized in this study were collected from the Incidence—SEER 17 Registries Research Data, November 2022 Sub (2000–2020) dataset in the SEER database (available at https://seer.cancer.gov/). Clinical data of GC patients selected from 2010 to 2020 were downloaded from the SEER*Stat software (version 8.4.2).

The age threshold of the LOGC did not coincide with the studies. Most scholars have defined the age limits for the LOGC and EOGC as above 40 or 50 years, respectively (2325), while some scholars have used 55 or 60 years as the cutoff age (26, 27). According to the previous studies, 50 years was used as the dividing variable in our study.

Eligible patients were selected according to the following criteria: patients diagnosed with GC confirmed by pathology (ICD-O-3 code: histological type recodes 8010–8231 and 8255–8576 and tumor site recodes C16.0–C16.6 and C16.8–C16.9). The patient exclusion criteria were the following: (1) patients with a history of cancer or distant metastasis, (2) who are under the age of 50 years at diagnosis, (3) without surgical treatment, (4) without complete clinical information (such as gender, diagnosis age, tumor size, TNM stage, and surgery recode), (5) who are involving other pathological types, (6) with a total score of dissection LNs of <16, and (7) with a follow-up or survival time of <30 days. The flowchart of the study selection process is depicted in Figure 1. Subsequently, 4,743 LOGC patients were selected for the subsequent analyses. The data were randomly divided into a training set (n = 3,321) and a validation set (n = 1,422) via the “caret” R package at a ratio of 7:3.

Figure 1
www.frontiersin.org

Figure 1. Flowchart of selecting the individuals with LOGC in this study.

Collections of variables and outcomes

Several demographic characteristics, such as age, sex, race, and marital status, were included. The clinical variables such as T stage, N stage, histological type, tumor grade, tumor size, number of removed LNs, number of positive LNs, follow-up time, and follow-up status were extracted from the SEER database. The LNR was calculated by dividing the number of metastatic LNs by the total number of nodes examined. The LODDS was calculated by the following formula from previous studies (28): log [(the total number of removed LNs +0.05)/(the number of metastatic LNs +0.05)]. According to the ICD-O-3 codes, the cases were divided into three types: intestinal type (8140, 8144, 8210–8211, 8260, and 8480–8481), diffuse type (8020–8022, 8142, 8145, and 8490), and other. For primary tumor sites, C16.0 recodes were allotted into the cardia, while C16.1–C16.2 and C16.5–C16.6 recoded into the middle site, C16.3–C16.4 into the distal site, and C16.8–C16.9 into the other site. The optimal cutoff values for successive LNR and LODDS were defined by X-Tile software. LNR was divided into <0.05, 0.05–0.43, and >0.43, while LODDS was divided into less than −4.26, −4.26–1.23, and greater than −1.23.

The endpoint was overall survival (OS). The OS was obtained from the “vital status recode” column in the SEER dataset.

Prognosis-related feature screening

In the framework of this investigation, a univariate Cox regression analysis was conducted to scrutinize the influence of clinical factors on survival duration within the training cohort via the “survival” package in R software. The dataset comprised 13 subjects, including age, sex, race, marital status, T stage, N stage, tumor stage, successive LNR and LODDS, classification LNR and LODDS, primary tumor site, tumor size, histologic grade, and chemotherapy. Those with statistically significant features in the univariate Cox analysis were imported into the multivariate Cox regression analysis to further screen prognosis-related features.

The optimal LN system selection

For optimal LN system selection, first, the ability of three LN staging systems to predict patient prognosis was compared via the C-index, Akaike information criterion (AIC), and Bayesian information criterion (BIC). Furthermore, receiver operating characteristic (ROC) curves and areas under the curve (AUCs) were generated to evaluate the predictive value of the three LN systems.

Finally, three machine learning algorithms, namely, least absolute shrinkage (LASSO) regression (29), random forest (30), and Extreme Gradient Boosting (31) (XGBoost), were applied to various dimensions. All three methods involve direct selection of the original features without any linear combination or transformation, and the selected features are consistent with the original features. It can calculate feature importance scores, allowing users to understand the contribution of each feature to the model's prediction. This insight can be valuable for feature selection and model interpretation. The LASSOCV module of the “glmnet” R package was utilized to conduct LASSO regression (32). XGBoost analysis was used to extract and analyze the importance of each feature with the “XGBoost” R package (33). The random forest classifier was trained on the training cohort generated by the “randomForestSRC” R package (34). The feature importance was extracted via the function of “feature importance”.

Construction of a nomogram

A nomogram is a graphical representation of mathematical relationships and is usually used to estimate the results of a formula via graphical means. In this study, a nomogram for OS was created to estimate the prognosis of LOGC patients based on the optimal LN system. The calibration plot, concordance index, ROC curve, and decision curve analysis were plotted to evaluate the accuracy of the prognostic nomogram in both the training and validation cohorts.

Statistical analysis

R software (version 4.3.1) and IBM SPSS (version 26) were utilized to perform all analyses. A P-value of <0.05 was considered to indicate statistical significance. The χ2 test and t-test were used to compare the relationships between the categorical variables, and the means and medians were calculated to present the descriptive variables. A P-value of <0.05 was considered to indicate statistical significance. The dummy variables were applied to account for the multinomial variable data via one-hot encoding. The ordinal and interval variable data were substituted for numeric variables. The TNM stages of the patients were redetermined based on the eighth edition TNM staging system of the AJCC.

Results

Patient demographic and clinical characteristics

A total of 4,743 LOGC participants were included in this study and were randomly classified into the training group (n = 3,321) and the validation group (n = 1,422) via the “caret” package in R software at a ratio of 7:3. All the participants aged >50 years at the time of the initial diagnosis, with a median age of 68.5 (SD 9.84) years, while the median ages in the training and validation groups were 65.9 (SD 9.86) and 65.6 (SD 9.8) years, respectively. Interestingly, most patients were diagnosed at 60–69 years of age. In addition, the number of dissected LNs in each patient was no less than 16, and the median was 22.4 (SD 12.2). The median LNR was 0.187 (SD 0.261), while the median LODDS was −3.15 (SD 2.94). There were no significant differences between the two groups regarding any of the clinical factors, and further details are presented in Table 1.

Table 1
www.frontiersin.org

Table 1. Baseline demographic and clinicopathological features of the patients.

Identification of prognosis-related clinical factors for OS

The results of univariate Cox regression revealed significant associations between survival time and certain clinical variables, including marital status, T stage, N stage, tumor stage, histological type, age at diagnosis, successive LNR and LODDS, and classification of LNR and LODDS. The estimated regression coefficients and hazard ratios (HRs) for each variable are presented in Table 2. Notably, successive LNR and LODDS exhibited statistically significant HRs of 10.32 (95% CI: 8.82–12.07, p < 0.05] and 1.28 (95% CI: 1.26–1.30, p < 0.05], respectively, indicating that both parameters were related to prognosis. Cox multivariate regression analyses were performed to further determine the associations between pN stage, LODDS, and LNR and OS in LOGC patients. The results showed that the LODDS, LNR, and pN status significantly impacted OS in the LOGC patients (Table 3).

Table 2
www.frontiersin.org

Table 2. Univariate analysis of overall survival in the training cohort.

Table 3
www.frontiersin.org

Table 3. Association of pN stage, LNR, and LODDS with OS in the training cohort.

Selection of the optimal LN system

The predictive prognostic capability of the three LN systems was similar in the training and validation cohorts (Table 4). In the training cohort, the C-indexes for the LNR, LODDS, and pN were 0.679, 0.682, and 0.681, respectively, while in the validation cohort, the C-indexes were 0.664, 0.672, and 0.676, respectively. In addition, the AIC values of each system were 24,112.03, 24,133.89, and 24,174.96 in the training cohort and 9,227.21, 9,217.83, and 9,207.59 in the validation cohort, respectively. To further explore the ability of the nomogram to predict patient prognosis, the area under the curve (AUC) curves were plotted, as shown in Figure 2. In the training cohort, the time-dependent 1-year AUC values for the LNR, LODDS, and pN were 0.696 (95% CI: 0.672–0.720), 0.697 (95% CI: 0.673–0.721), and 0.696 (95% CI: 0.672–0.720), respectively. The 3-year AUC values were 0.736 (95% CI: 0.718–0.753), 0.740 (95% CI: 0.723–0.756), and 0.739 (95% CI: 0.721–0.757), and the 5-year AUC values were 0.735 (95% CI: 0.717–0.753), 0.737 (95% CI: 0.718–0.756), and 0.740 (95% CI: 0.720–0.759), respectively. These findings suggested that the differences in the discrimination qualities of the three systems were less significant, which aligned with the aforementioned conclusions. For this reason, the machine learning methods LASSO, XGBoost, and RF were used to further identify the optimal LN system in terms of predictive ability. The following variables were incorporated into this analysis: successive LNR and LODDS, pN, marital status, tumor grade, histological type, age, primary tumor site, tumor size, clinical stage, and sex.

Table 4
www.frontiersin.org

Table 4. Prediction performance of the three lymph nodal staging systems.

Figure 2
www.frontiersin.org

Figure 2. Comparison of the three LN systems in the training and validation cohorts. (A–C) ROC curves for predicting 1-, 3-, and 5-year overall survival (OS) in the training cohort. (D–F) ROC curves for predicting 1-, 3-, and 5-year OS in the validation cohort.

For the LASSO regression analysis, after 10-fold cross-validation and adjustment of the optimal α parameter value (α = 0.003) to control the strength of regularization, features with 0 values of the coefficient parameter variables were excluded (Figures 3A,B). Then, the importance of features was determined by the absolute values of the coefficients obtained from the final output Lasso model in the training cohort (Figure 3C). The importance of features in a Lasso model can be inferred from the magnitude of the coefficients. We found that the coefficient of the LNR was the largest, which may indicate that the LNR is one of the most important features. Subsequently, XGBoost was performed on the training dataset. The importance values for each variable are shown in Figure 4A. LNR showed the highest importance. The significance of each feature from the random forest analysis is shown in Figure 4B. The finding that the LNR system was the most relevant, and influential feature for prediction was consistent with the abovementioned findings.

Figure 3
www.frontiersin.org

Figure 3. LASSO regression analysis. (A,B) LASSO regression to identify the optimal variable. (C) The coefficients of each variable in LASSO analysis.

Figure 4
www.frontiersin.org

Figure 4. The results of XGBoost and RF analyses. (A) The feature importance in XGBoost analysis. (B) the importance score of features in RF analysis.

Based on the results of three machine learning methods, the LNR system was selected in this study as the optimal system for evaluating the status of LNs in patients with LOGC.

Development and validation of a nomogram based on the LNR

The LNR was selected as the optimal LN staging system to construct a novel nomogram for estimating the outcome of patients with LOGC (Figure 5A). Other predictive variables, including sex, marital status, chemotherapy, and T stage, were included. In the nomogram, each variable has a vertical scale line representing its range of values. By aligning the values of these variables and observing the intersection points on the nomogram, we can determine the estimated values of the 1-year, 3-year, and 5-year survival probabilities. Then, the calibration curves, ROC curves, DCA curves, and time-dependent C-index curves were plotted to evaluate the prediction performance of the nomogram (Figures 5B–E and Supplementary Figure S1), which suggested that the nomogram had good applicability and accuracy. The AUC of the nomogram in the training set was superior to that of the other variables at 1 year (AUC = 0.741), 3 years (AUC = 0.782), and 5 years (AUC = 0.783) and at 1 year (AUC = 0.731), 3 years (AUC = 0.772), and 5 years (AUC = 0.774) in the validation set (Figures 6D–F). The C-index of the nomogram was 0.721, which was greater than those of the LNR (C-index = 0.679) and tumor stage (C-index = 0.667) (Figures 6A–C). Moreover, according to the median risk score calculated from the nomogram, the patients in the training set were divided into high-risk and low-risk groups. The patients with a high nomogram risk score had a shorter survival time than those with a low nomogram risk score (Figure 7A). The nomogram risk scores of patients with different survival statuses are presented in Figures 7C–D. This indicated that as the nomogram risk score increased, the mortality of LOGC patients increased. Next, the risk scores were acquired from the same formula used for this nomogram. The patients in the validation set with low nomogram risk scores had better outcomes than the patients with high nomogram risk scores (Figure 7B). These results suggested that this nomogram could accurately and conveniently predict the prognosis of LOGC patients.

Figure 5
www.frontiersin.org

Figure 5. A nomogram based on LNR staging. (A) The nomogram was built based on four clinical variables in the training cohort. (B,C) The calibration curves and C-index values for predicting OS at 1-, 3-, and 5-year overall survival (OS) in the training and validation cohorts. (D,E) ROC curves showed good performance for predicting 1-, 3-, and 5-year OS in training and validation cohorts.

Figure 6
www.frontiersin.org

Figure 6. Comparing the predictive performance of nomogram with other clinical factors. (A–C) ROC curves for predicting 1-, 3-, and 5-year overall survival (OS) in the training cohort. (D–F) ROC curves for predicting 1-, 3-, and 5-year OS in the validation cohort.

Figure 7
www.frontiersin.org

Figure 7. Predictive performance of nomogram. (A,B) Kaplan–Meier survival curves of LOGC patients with high and low risk in the training and validation cohorts, respectively. (C,D) Distribution of risk score and survival status of LOGC patients in the training and validation cohorts, respectively.

Discussion

Over the past few decades, there has been a consistent decline in the occurrence of GC among middle-aged and elderly individuals (35, 36). However, compared with EOGC patients, LOGC patients presented significantly poor outcomes, especially those who underwent curative surgery (37). Therefore, it is necessary to pay more attention to the prognosis of patients with LOGC. Accurate survival prediction for LOGC patients is essential for determining their prognosis and making individualized treatment decisions. In this study, we explored the relationship between clinical features and the outcome of LOGC patients and confirmed the optimal LN staging system for patients with LOGC from the SEER database. This is the first study to identify a suitable LN system for LOGC patients via machine learning analysis and construct a nomogram for prognosis prediction.

LNM is a pivotal prognostic factor in GC patients (38, 39). Precise LN staging plays a critical role in treatment strategy selection and accurate prognosis prediction in cancer patients. The LNR and LODDS are alternative methods used to assess LN involvement in GC, refine the staging system, and provide more accurate prognostic information (4042). The metastatic LNR was introduced in 2002 as a substitution method to initially forecast the prognosis of GC patients (43). We revealed the correlations between the LODDS, LNR, and pN stage and OS among patients with LOGC in the SEER database. The prediction abilities of the three LN systems, namely, LNR, LODDS, and pN, were compared via the AUCs, AICs, BICs, and C-indexes. However, there were fewer differences between them. Considering this situation, three machine learning methods, namely, LASSO, Xgboost, and RF analyses, were used to select the most important feature as the optimal LN system. Compared to the LODDS and pN stage, the LNR had a better ability to predict prognosis in LOGC patients when the total number of nodes examined was no less than 15, and the LNR was defined as the appropriate LN system in our study.

Sufficient perioperative LN retrieval is essential for the precise assessment of LN status (44, 45). Currently, three guidelines, namely, the Eighth Edition AJCC Cancer Staging Manual (46), the Chinese Society of Clinical Oncology (47), and the National Comprehensive Cancer Network (48), for GC patient management and treatment strategies recommend that no less than 15 LNs be acquired during surgery. With the increase in surgical management of GC, the proportion of patients with inadequate LNs will gradually decrease. Considering that inadequate LNs may misguide the judgment of the prognosis, only patients who had >16 LNs retrieved were included in our study.

In this study, we explored whether the pN stage, LNR, LODDS, T stage, marital status, and age at diagnosis were found to be independent prognostic factors for LOGC outcomes via multivariate regression. These results were similar to those of previous studies (49, 50). Marital status, an infrequently considered variable in GC research, exhibited a moderate impact on survival in our study. We found that patients who were married or ever married had better outcomes than those who were unmarried. This may be because married individuals possess higher subjective health perceptions, encounter fewer mental and physical health ailments, and exhibit extended life expectancy (51, 52).

Moreover, a promising nomogram was constructed to predict OS for LOGC patients based on the optimal LN system. Three variables, namely, marital status, age at diagnosis, and T stage, were also incorporated into the nomogram. The LOGC patients were assigned to high- or low-risk groups according to the nomogram. The survival rate analysis revealed that patients with higher risk scores had shorter survival times. The nomogram that we constructed demonstrated notably enhanced risk stratification abilities for LOGC patients compared to the stage from the AJCC eighth edition via ROC and DCA analyses. It can effectively aid in patient consultations regarding survival information, offering valuable guidance for clinical decision-making and the allocation of appropriate treatments. Despite the absence of a currently established optimal threshold for the LNR, it has been demonstrated to be the most reliable LN staging system. As attention to the LNR continues to grow, there is a prevailing belief that it will gain widespread acknowledgment in clinical settings in the foreseeable future.

In our study, we showed that the LNR was a more appropriate LN system for assessing patient prognosis. Despite similar findings reported in prior studies (5359), some of which also utilized data from the SEER database (54, 58), our study possesses some distinct characteristics that differentiate it from earlier research. We collected SEER data from 2010 to 2020. Moreover, only patients who underwent curative surgery and had >16 LNs retrieved were selected, and follow-up analyses were conducted. This could partially explain the variance in the definition of the optimal LN system between this study and Che's study (60) and Aurello's study (61), in which LODDS was regarded as the best. The LODDS in these cases with a total number of nodes examined less than 16, which is not a minimum percentage, may hold greater importance than the LNR. Another peculiarity of our study involves the exclusive enrollment of GC patients who were diagnosed at over 50 years of age. Most middle-aged and elderly patients are diagnosed with stomach cancer (1). With the dramatic increase in the aging population, the average age of GC patients has increased at the same time (62). Finally, there are several limitations to this study. First, the study design employed here is retrospective and relies on data obtained from the SEER database, which may introduce some inherent bias. Some information, such as the location of metastatic LNs, was not recorded. Patients with metastatic LNs in the 8p, 12b/p, and 13 anatomical locations had a poorer prognosis than those without metastasis (63). Second, most of the patients in this study were white, and more extensive research involving diverse populations is necessary to corroborate and strengthen these findings.

Conclusion

The LNR demonstrated a more powerful performance than other LN staging systems in LOGC patients after surgery. Our novel nomogram has better predictive accuracy in both the training and validation cohorts, which may aid in patient clinical decision-making.

Data availability statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics statement

Ethical approval was not required for the study involving humans in accordance with the local legislation and institutional requirements. Written informed consent to participate in this study was not required from the participants or the participants’ legal guardians/next of kin in accordance with the national legislation and the institutional requirements.

Author contributions

SC: Data curation, Writing – original draft. PD: Methodology, Writing – review & editing. QZ: Supervision, Writing – review & editing.

Funding

The authors declare that financial support was received for the research, authorship, and/or publication of this article.

This work was supported by Hebei Provincial Major Science and Technology Special Project (23297701Z); Beijing-Tianjin-Hebei Basic Research Cooperation Special Project (22JCZXJC00140) and Hebei Provincial Government-funded Clinical Talent Project (ZF2023047).

Acknowledgments

The authors wish to express their gratitude to all patients and institutions who contributed to this study, emphasizing their appreciation for the invaluable opportunity to access the SEER database openly.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fsurg.2024.1376702/full#supplementary-material

Supplementary Figure S1
Predictive performance of nomogram (A,B) The DCA curves for predicting OS in training and validation cohorts. (C,D) The time C-index curves of nomogram to predict the OS of LOGC patients in training and validation cohorts.

References

1. Sung H, Ferlay J, Siegel RL, Laversanne M, Soerjomataram I, Jemal A, et al. Global Cancer Statistics 2020: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin. (2021) 71(3):209–49. doi: 10.3322/caac.21660

PubMed Abstract | Crossref Full Text | Google Scholar

2. Morgan E, Arnold M, Camargo MC, Gini A, Kunzmann AT, Matsuda T, et al. The current and future incidence and mortality of gastric cancer in 185 countries, 2020–40: a population-based modelling study. EClinicalMedicine. (2022) 47:101404. doi: 10.1016/j.eclinm.2022.101404

PubMed Abstract | Crossref Full Text | Google Scholar

3. Wang X, Dong Y, Zhang H, Zhao Y, Miao T, Mohseni G, et al. DNA methylation drives a new path in gastric cancer early detection: current impact and prospects. Genes Dis. (2023) 11(2):847–60. doi: 10.1016/j.gendis.2023.02.038

PubMed Abstract | Crossref Full Text | Google Scholar

4. Ju W, Zheng R, Zhang S, Zeng H, Sun K, Wang S, et al. Cancer statistics in Chinese older people, 2022: current burden, time trends, and comparisons with the US, Japan, and the Republic of Korea. Sci China Life Sci. (2023) 66(5):1079–91. doi: 10.1007/s11427-022-2218-x

PubMed Abstract | Crossref Full Text | Google Scholar

5. Joharatnam-Hogan N, Shiu KK, Khan K. Challenges in the treatment of gastric cancer in the older patient. Cancer Treat Rev. (2020) 85:101980. doi: 10.1016/j.ctrv.2020.101980

PubMed Abstract | Crossref Full Text | Google Scholar

6. He MJ, Ji LD, Lian L, Ma ZF, Luo YT, Lai JL, et al. Epidemiological trend of early-onset gastric cancer and late-onset gastric cancer in China from 2000 to 2019. Zhonghua Liu Xing Bing Xue Za Zhi. (2023) 44(8):1198–202. doi: 10.3760/cma.j.cn112338-20230302-00117

PubMed Abstract | Crossref Full Text | Google Scholar

7. Zhu KG, Yang J, Zhu Y, Zhu Q, Pan W, Deng S, et al. The microprotein encoded by exosomal lncAKR1C2 promotes gastric cancer lymph node metastasis by regulating fatty acid metabolism. Cell Death Dis. (2023) 14(10):708. doi: 10.1038/s41419-023-06220-1

PubMed Abstract | Crossref Full Text | Google Scholar

8. Deng JY, Liang H. Clinical significance of lymph node metastasis in gastric cancer. World J Gastroenterol. (2014) 20(14):3967–75. doi: 10.3748/wjg.v20.i14.3967

PubMed Abstract | Crossref Full Text | Google Scholar

9. Smyth EC, Verheij M, Allum W, Cunningham D, Cervantes A, Arnold D, et al. Gastric cancer: ESMO clinical practice guidelines for diagnosis, treatment and follow-up. Ann Oncol. (2016) 27(suppl 5):v38–49. doi: 10.1093/annonc/mdw350

PubMed Abstract | Crossref Full Text | Google Scholar

10. Riascos MC, Greenberg JA, Palacardo F, Edelmuth R, Lewis VC, An A, et al. Timing to surgery and lymph node upstaging in gastric cancer: an NCDB analysis. Ann Surg Oncol. (2023) 31(3):1714–24. doi: 10.1245/s10434-023-14536-7.38006526

PubMed Abstract | Crossref Full Text | Google Scholar

11. Loch FN, Beyer K, Kreis ME, Kamphues C, Rayya W, Schineis C, et al. Diagnostic performance of node reporting and data system (node-RADS) for regional lymph node staging of gastric cancer by CT. Eur Radiol. (2023) 34(5):3183–93. doi: 10.1007/s00330-023-10352-5

PubMed Abstract | Crossref Full Text | Google Scholar

12. Sano T, Coit DG, Kim HH, Roviello F, Kassab P, Wittekind C, et al. Proposal of a new stage grouping of gastric cancer for TNM classification: international gastric cancer association staging project. Gastric Cancer. (2017) 20(2):217–25. doi: 10.1007/s10120-016-0601-9

PubMed Abstract | Crossref Full Text | Google Scholar

13. Lee HK, Yang HK, Kim WH, Lee KU, Choe KJ, Kim JP. Influence of the number of lymph nodes examined on staging of gastric cancer. Br J Surg. (2001) 88(10):1408–12. doi: 10.1046/j.0007-1323.2001.01875.x

PubMed Abstract | Crossref Full Text | Google Scholar

14. Bunt AM, Hermans J, Smit VT, van de Velde CJ, Fleuren GJ, Bruijn JA. Surgical/pathologic-stage migration confounds comparisons of gastric cancer survival rates between Japan and Western countries. J Clin Oncol. (1995) 13(1):19–25. doi: 10.1200/JCO.1995.13.1.19

PubMed Abstract | Crossref Full Text | Google Scholar

15. Hou Y, Wang X, Chen J. Prognostic significance of metastatic lymph node ratio: the lymph node ratio could be a prognostic indicator for patients with gastric cancer. World J Surg Oncol. (2018) 16(1):198. doi: 10.1186/s12957-018-1504-5

PubMed Abstract | Crossref Full Text | Google Scholar

16. Qiu C, Dong W, Su B, Liu Q, Du J. The prognostic value of ratio-based lymph node staging in resected non-small-cell lung cancer. J Thorac Oncol. (2013) 8(4):429–35. doi: 10.1097/JTO.0b013e3182829c16

PubMed Abstract | Crossref Full Text | Google Scholar

17. Bolger JC, Castro PP, Marwah A, Tavakoli I, Espin-Garcia O, Darling GE, et al. Nodal yield <15 is associated with reduced survival in esophagectomy and is a quality metric. Ann Thorac Surg. (2023) 116(1):130–6. doi: 10.1016/j.athoracsur.2023.02.053

PubMed Abstract | Crossref Full Text | Google Scholar

18. Huang X, Xu X, Xu A, Luo Z, Li C, Wang X, et al. Exploring the most appropriate lymph node staging system for node-positive breast cancer patients and constructing corresponding survival nomograms. J Cancer Res Clin Oncol. (2023) 149(16):14721–30. doi: 10.1007/s00432-023-05283-z

PubMed Abstract | Crossref Full Text | Google Scholar

19. Scarinci A, Di Cesare T, Cavaniglia D, Neri T, Colletti M, Cosenza G, et al. The impact of log odds of positive lymph nodes (LODDS) in colon and rectal cancer patient stratification: a single-center analysis of 323 patients. Updates Surg. (2018) 70(1):23–31. doi: 10.1007/s13304-018-0519-3

PubMed Abstract | Crossref Full Text | Google Scholar

20. Huang B, Chen C, Ni M, Mo S, Cai G, Cai S. Log odds of positive lymph nodes is a superior prognostic indicator in stage III rectal cancer patients: a retrospective analysis of 17,632 patients in the SEER database. Int J Surg. (2016) 32:24–30. doi: 10.1016/j.ijsu.2016.06.002

PubMed Abstract | Crossref Full Text | Google Scholar

21. Gu P, Deng J, Sun Z, Wang Z, Wang W, Liang H, et al. Superiority of log odds of positive lymph nodes (LODDS) for prognostic prediction after gastric cancer surgery: a multi-institutional analysis of 7620 patients in China. Surg Today. (2021) 51(1):101–10. doi: 10.1007/s00595-020-02091-7

PubMed Abstract | Crossref Full Text | Google Scholar

22. Zhou R, Zhang J, Sun H, Liao Y, Liao W. Comparison of three lymph node classifications for survival prediction in distant metastatic gastric cancer. Int J Surg. (2016) 35:165–71. doi: 10.1016/j.ijsu.2016.09.096

PubMed Abstract | Crossref Full Text | Google Scholar

23. Zhou QP, Ge YH, Liu CY. Comparison of metastasis between early-onset and late-onset gastric signet ring cell carcinoma. BMC Gastroenterol. (2020) 20(1):380. doi: 10.1186/s12876-020-01529-z

PubMed Abstract | Crossref Full Text | Google Scholar

24. Ugai T, Sasamoto N, Lee HY, Ando M, Song M, Tamimi RM, et al. Is early-onset cancer an emerging global epidemic? Current evidence and future implications. Nat Rev Clin Oncol. (2022) 19(10):656–73. doi: 10.1038/s41571-022-00672-8

PubMed Abstract | Crossref Full Text | Google Scholar

25. Huang Q, Zheng X, Jiao Y, Lei Y, Li X, Bi F, et al. A distinct clinicopathological feature and prognosis of young gastric cancer patients aged ≤45 years old. Front Oncol. (2021) 11:674224. doi: 10.3389/fonc.2021.674224

PubMed Abstract | Crossref Full Text | Google Scholar

26. Chen C, Du Y, Liu Y, Shi Y, Niu Y, Jin G, et al. Characteristics of gastric cancer gut microbiome according to tumor stage and age segmentation. Appl Microbiol Biotechnol. (2022) 106(19-20):6671–87. doi: 10.1007/s00253-022-12156-x

PubMed Abstract | Crossref Full Text | Google Scholar

27. Zhao LY, Hu JK. Early-onset gastric cancer is quite distinct from late-onset gastric cancer. Surgery. (2020) 167(5):883. doi: 10.1016/j.surg.2019.08.018

PubMed Abstract | Crossref Full Text | Google Scholar

28. Li Y, Wu G, Liu J, Zhang Y, Yang W, Wang X, et al. Log odds of positive lymph nodes as a novel prognostic predictor for gastric cancer: a systematic review and meta-analysis. BMC Cancer. (2023) 23(1):523. doi: 10.1186/s12885-023-10805-6

PubMed Abstract | Crossref Full Text | Google Scholar

29. Zhu J, Lu Q, Liang T, JieJiang , Li H, Zhou C, Wu S, et al. Development and validation of a machine learning-based nomogram for prediction of ankylosing spondylitis. Rheumatol Ther. (2022) 9(5):1377–97. doi: 10.1007/s40744-022-00481-6

PubMed Abstract | Crossref Full Text | Google Scholar

30. Brunyé TT, Booth K, Hendel D, Kerr KF, Shucard H, Weaver DL, et al. Machine learning classification of diagnostic accuracy in pathologists interpreting breast biopsies. J Am Med Inform Assoc. (2023) 31(3):552–62. doi: 10.1093/jamia/ocad232

Crossref Full Text | Google Scholar

31. Zheng J, Li J, Zhang Z, Yu Y, Tan J, Liu Y, et al. Clinical data based XGBoost algorithm for infection risk prediction of patients with decompensated cirrhosis: a 10-year (2012–2021) multicenter retrospective case-control study. BMC Gastroenterol. (2023) 23(1):310. doi: 10.1186/s12876-023-02949-3

PubMed Abstract | Crossref Full Text | Google Scholar

32. Friedman J, Hastie T, Tibshirani R. Regularization paths for generalized linear models via coordinate descent. J Stat Softw. (2010) 33(1):1–22. doi: 10.18637/jss.v033.i01

PubMed Abstract | Crossref Full Text | Google Scholar

33. Zuo D, Yang L, Jin Y, Qi H, Liu Y, Ren L. Machine learning-based models for the prediction of breast cancer recurrence risk. BMC Med Inform Decis Mak. (2023) 23(1):276. doi: 10.1186/s12911-023-02377-z

PubMed Abstract | Crossref Full Text | Google Scholar

34. Hwangbo S, Kim Y, Lee C, Lee S, Oh B, Moon MK, et al. Machine learning models to predict the maximum severity of COVID-19 based on initial hospitalization record. Front Public Health. (2022) 10:1007205. doi: 10.3389/fpubh.2022.1007205

PubMed Abstract | Crossref Full Text | Google Scholar

35. Sankarapillai J, Krishnan S, Ramamoorthy T, Sudarshan KL, Das P, Chaturvedi M, et al. Epidemiology of cancers among older adults in India: findings from the National Cancer Registry Programme. Public Health. (2023) 223:230–9. doi: 10.1016/j.puhe.2023.08.002

PubMed Abstract | Crossref Full Text | Google Scholar

36. Qi J, Li M, Wang L, Hu Y, Liu W, Long Z, et al. National and subnational trends in cancer burden in China, 2005–2020: an analysis of national mortality surveillance data. Lancet Public Health. (2023) 8(12):e943–55. doi: 10.1016/S2468-2667(23)00211-6

PubMed Abstract | Crossref Full Text | Google Scholar

37. Kist M, Thomaschewski M, Keck Y, Abdalla TSA, Zeissig SR, Kleihues-van Tol K, et al. Specifics of young gastric cancer patients: a population-based analysis of 46,110 patients with gastric cancer from the German Clinical Cancer Registry Group. Cancers. (2022) 14(23):5927. doi: 10.3390/cancers14235927

PubMed Abstract | Crossref Full Text | Google Scholar

38. Pham H, Richardson AJ. The prognostic importance of lymph node metastasis in patients with gastric cancer and identifying those suitable for middle segmental gastrectomy. JAMA Network Open. (2021) 4(3):e211877. doi: 10.1001/jamanetworkopen.2021.1877

PubMed Abstract | Crossref Full Text | Google Scholar

39. Kinami S, Saito H, Takamura H. Significance of lymph node metastasis in the treatment of gastric cancer and current challenges in determining the extent of metastasis. Front Oncol. (2022) 11:806162. doi: 10.3389/fonc.2021.806162

PubMed Abstract | Crossref Full Text | Google Scholar

40. Yang B, Liu T, Cui H, Lu Z, Fang G, Xue X, et al. The value of lymph nodes ratios in the prognosis of resectable remnant gastric cancer through the retrospective propensity score matching analysis. World J Surg Oncol. (2023) 21(1):245. doi: 10.1186/s12957-023-03137-z

PubMed Abstract | Crossref Full Text | Google Scholar

41. Rawicz-Pruszyński K, Ciseł B, Mlak R, Mielko J, Skórzewska M, Kwietniewska M, et al. The role of the lymph node ratio in advanced gastric cancer after neoadjuvant chemotherapy. Cancers. (2019) 11(12):1914. doi: 10.3390/cancers11121914

Crossref Full Text | Google Scholar

42. Sun Z, Xu Y, Li DM, Wang ZN, Zhu GL, Huang BJ, et al. Log odds of positive lymph nodes: a novel prognostic indicator superior to the number-based and the ratio-based N category for gastric cancer patients with R0 resection. Cancer. (2010) 116(11):2571–80. doi: 10.1002/cncr.24989

PubMed Abstract | Crossref Full Text | Google Scholar

43. Inoue K, Nakane Y, Iiyama H, Sato M, Kanbara T, Nakai K, et al. The superiority of ratio-based lymph node staging in gastric carcinoma. Ann Surg Oncol. (2002) 9(1):27–34. doi: 10.1245/aso.2002.9.1.27

PubMed Abstract | Crossref Full Text | Google Scholar

44. Wang W, Yang YJ, Zhang RH, Deng JY, Sun Z, Seeruttun SR, et al. Standardizing the classification of gastric cancer patients with limited and adequate number of retrieved lymph nodes: an externally validated approach using real-world data. Mil Med Res. (2022) 9(1):15. doi: 10.1186/s40779-022-00375-2

PubMed Abstract | Crossref Full Text | Google Scholar

45. Smith DD, Schwarz RR, Schwarz RE. Impact of total lymph node count on staging and survival after gastrectomy for gastric cancer: data from a large US-population database. J Clin Oncol. (2005) 23(28):7114–24. doi: 10.1200/JCO.2005.14.621

PubMed Abstract | Crossref Full Text | Google Scholar

46. Amin MB, Greene FL, Edge SB, Compton CC, Gershenwald JE, Brookland RK, et al. The Eighth Edition AJCC Cancer Staging Manual: continuing to build a bridge from a population-based to a more “personalized” approach to cancer staging. CA Cancer J Clin. (2017) 67(2):93–9. doi: 10.3322/caac.21388

PubMed Abstract | Crossref Full Text | Google Scholar

47. Wang FH, Zhang XT, Li YF, Tang L, Qu XJ, Ying JE, et al. The Chinese Society of Clinical Oncology (CSCO): clinical guidelines for the diagnosis and treatment of gastric cancer, 2021. Cancer Commun. (2021) 41(8):747–95. doi: 10.1002/cac2.12193

Crossref Full Text | Google Scholar

48. Ajani JA, D’Amico TA, Bentrem DJ, Chao J, Cooke D, Corvera C, et al. Gastric Cancer, Version 2.2022, NCCN Clinical Practice Guidelines in Oncology. J Natl Compr Cancer Netw. (2022) 20(2):167–92. doi: 10.6004/jnccn.2022.0008

Crossref Full Text | Google Scholar

49. Jin JJ, Wang W, Dai FX, Long ZW, Cai H, Liu XW, et al. Marital status and survival in patients with gastric cancer. Cancer Med. (2016) 5(8):1821–9. doi: 10.1002/cam4.758

PubMed Abstract | Crossref Full Text | Google Scholar

50. Wu J, Wang H, Yin X, Wang Y, Lu Z, Zhang J, et al. Normalization weighted combination scores re-evaluate TNM staging of gastric cancer: a retrospective cohort study based on a multicenter database. Int J Surg (London, England). (2023) 110(1):11–22. doi: 10.1097/JS9.0000000000000726

Crossref Full Text | Google Scholar

51. Thompson T, Rodebaugh TL, Pérez M, Struthers J, Sefko JA, Lian M, et al. Influence of neighborhood-level factors on social support in early-stage breast cancer patients and controls. Soc Sci Med. (2016) 156:55–63. doi: 10.1016/j.socscimed.2016.03.023

PubMed Abstract | Crossref Full Text | Google Scholar

52. Richardson CL, Saeed M, Sharp L, Todd A. The association between marital status and treatment initiation in lung cancer: a systematic review and meta-analysis of observational studies. Cancer Epidemiol. (2023) 87:102494. doi: 10.1016/j.canep.2023.102494

PubMed Abstract | Crossref Full Text | Google Scholar

53. Shen D, Zhou G, Zhao J, Wang G, Jiang Z, Liu J, et al. A novel nomogram based on the prognostic nutritional index for predicting postoperative outcomes in patients with stage I-III gastric cancer undergoing robotic radical gastrectomy. Front Surg. (2022) 9:928659. doi: 10.3389/fsurg.2022.928659

PubMed Abstract | Crossref Full Text | Google Scholar

54. Liu Y, Cui H, Xu X, Liang W. Prognostic value of lymph node density on cancer staging system for gastric cancer without distal metastasis: a population-based analysis of SEER database. World J Surg Oncol. (2022) 20(1):325. doi: 10.1186/s12957-022-02795-9

PubMed Abstract | Crossref Full Text | Google Scholar

55. Chen YR, Wang MQ, Li YT, Li P, Ouyang SS, Xu HW, et al. Prognostic performance of different lymph node classification systems in young gastric cancer. J Gastrointest Oncol. (2021) 12(4):1285–300. doi: 10.21037/jgo-21-185

PubMed Abstract | Crossref Full Text | Google Scholar

56. Hung YS, Chang SC, Liu KH, Hung CY, Kuo YC, Tsai CY, et al. A prognostic model based on lymph node metastatic ratio for predicting survival outcome in gastric cancer patients with N3b subclassification. Asian J Surg. (2019) 42(1):85–92. doi: 10.1016/j.asjsur.2017.10.001

PubMed Abstract | Crossref Full Text | Google Scholar

57. Aoyama T, Komori K, Tamagawa A, Nakazano M, Hara K, Hashimoto I, et al. Clinical influence of the lymph node ratio on lymph node metastasis-positive gastric cancer patients who receive curative treatment. In Vivo. (2022) 36(2):994–1000. doi: 10.21873/invivo.12792

PubMed Abstract | Crossref Full Text | Google Scholar

58. Zeng Y, Cai F, Wang P, Wang X, Liu Y, Zhang L, et al. Development and validation of prognostic model based on extragastric lymph nodes metastasis and lymph node ratio in node-positive gastric cancer: a retrospective cohort study based on a multicenter database. Int J Surg. (2023) 109(4):794–804. doi: 10.1097/JS9.0000000000000308

PubMed Abstract | Crossref Full Text | Google Scholar

59. Lai H, Zheng J, Li Y. Comparison of four lymph node staging systems in gastric adenocarcinoma after neoadjuvant therapy—a population-based study. Front Surg. (2022) 9:918198. doi: 10.3389/fsurg.2022.918198

PubMed Abstract | Crossref Full Text | Google Scholar

60. Che K, Wang Y, Wu N, Liu Q, Yang J, Liu B, et al. Prognostic nomograms based on three lymph node classification systems for resected gastric adenocarcinoma: a large population-based cohort study and external validation. Ann Surg Oncol. (2021) 28(13):8937–49. doi: 10.1245/s10434-021-10299-1

PubMed Abstract | Crossref Full Text | Google Scholar

61. Aurello P, Petrucciani N, Nigri GR, La Torre M, Magistri P, Tierno S, et al. Log odds of positive lymph nodes (LODDS): what are their role in the prognostic assessment of gastric adenocarcinoma? J Gastrointest Surg. (2014) 18(7):1254–60. doi: 10.1007/s11605-014-2539-8

PubMed Abstract | Crossref Full Text | Google Scholar

62. Yang W, Fang Y, Niu Y, Sun Y. A predictive model for early death in elderly patients with gastric cancer: a population-based study. Front Oncol. (2022) 12:972639. doi: 10.3389/fonc.2022.972639

PubMed Abstract | Crossref Full Text | Google Scholar

63. Zeng Y, Wei S, Chen S, Zhan Z, Wang Y, Wang Z, et al. The influence of group no.8p lymph node dissection on the prognosis of advanced gastric cancer. J Gastrointest Surg. (2023) 27(5):887–94. doi: 10.1007/s11605-023-05599-8

PubMed Abstract | Crossref Full Text | Google Scholar

Keywords: XGBoost, late-onset gastric cancer, log odds of positive lymph nodes, lymph node stage, nomogram

Citation: Chen S, Ding P and Zhao Q (2024) Comparison of the predictive performance of three lymph node staging systems for late-onset gastric cancer patients after surgery. Front. Surg. 11:1376702. doi: 10.3389/fsurg.2024.1376702

Received: 26 January 2024; Accepted: 27 May 2024;
Published: 11 June 2024.

Edited by:

Luca Nespoli, University of Milano-Bicocca, Italy

Reviewed by:

Paolo Aurello, Sapienza University of Rome, Italy
Marco Clementi, University of L’Aquila, Italy

© 2024 Chen, Ding and Zhao. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Qun Zhao, emhhb3F1bkBoZWJtdS5lZHUuY24=

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.