A modified survival model for patients with esophageal squamous cell carcinoma based on lymph nodes: A study based on SEER database and external validation

Background: The counts of examined lymph nodes (ELNs) in predicting the prognosis of patients with esophageal squamous cell carcinoma (ESCC) is a controversial issue. We conducted a retrospective study to develop an ELNs-based model to individualize ESCC prognosis.

Methods: Patients with ESCC from the SEER database and our center were strictly screened. The optimal threshold value was determine by the X-tile software. A prognostic model for ESCC patients was developed and validated with R. The model’s efficacy was evaluated by C-index, ROC curve, and decision curve analysis (DCA).

Results: 3,629 cases and 286 cases were screened from the SEER database and our center, respectively. The optimal cut-off value of ELNs was 10. Based on this, we constructed a model with a favorable C-index (training group: 0.708; external group 1: 0.687; external group 2: 0.652). The model performance evaluated with ROC curve is still reliable among the groups. 1-year AUC for nomogram in three groups (i.e., 0.753, 0.761, and 0.686) were superior to that of the TNM stage (P < 0.05). Similarly, the 3-year AUC and the 5-year AUC results for the model were also higher than that of the 8th TNM stage. By contrast, DCA showed the benefit of this model was better in the same follow-up period.

Conclusion: More than 10 ELNs are helpful to evaluate the survival of ESCC patients. Based on this, an improved model for predicting the prognosis of ESCC patients was proposed.

Introduction

Esophageal squamous cell carcinoma (ESCC) is the most common histological form of esophageal cancer, which has made a major contribution to cancer-related mortality worldwide (1, 2). Remarkably, ESCC is mainly characterized by lymph node metastasis (LNM). Less than one-third of ESCC patients are able to cross the 5-year survival period (3–5). Due to the complex lymphatic network in and around the esophagus, the possible LNM of ESCC involves multiple fields, including the neck, chest, or/and abdomen (6–8). Therefore, radical lymphadenectomy for ESCC is regarded as an important method to improve the survival rate.

The lymph node resection during cancer surgery is generally performed for 2 main reasons, (a) staging and (b) dissemination prevention. Thus, the counts of resected nodes increases with the counts of suspicious nodes (up to a certain limit) and with the striving for dissemination prevention. In the first case, more nodes might indicate a bad prognosis, while in the latter, better dissemination prevention might be achieved by exciding more nodes. However, the counts of examined lymph nodes (ELNs) in predicting prognosis remains controversial (9–11). In addition, the American Joint Committee on Cancer indicated the number of ELNs was beneficial as many as possible (12–16).

Although ELNs were an independent factor for survival, there remained to be no associated study that reported the precision of the survival model for patients with ESCC based on the optimal threshold of ELNs. Factors such as age, grade, and tumor size may also significantly affect the prognosis of ESCC patients. Regarding these divergences and lack of relevant research, this study aimed to identify the optimal number of ELNs and build a nomogram model based on the grouping of ELNs by SEER database and data from our hospital. The optimal threshold value of ELNs was made out by X-tile software which was extensively used and credible for figuring out optimal cut-off values (17, 18). Through the SEER database and data collected from our hospital, we built and validated a nomogram model according to the results of multivariate cox analysis to predict the survival of ESCC patients. Combined with Cox analysis results of the data collected from SEER database and our hospital, a prediction model for patients with ESCC based on lymph nodes was established and verified.

Material and methods

Research material

The SEER database and the cases from our hospital were used to enroll patients. The SEER database the information was collected by SEER*Stat software (version 8.3.6), tumors with codes 8,070, 8,071, 8,072, 8,073, 8,074, 8,075, 8,076, and 8,078 were set as ESCC according to the ICD-O-3 criteria (19, 20).

We made the inclusion criteria for the SEER database: (1) patients aged over 20 years old and diagnosed as ESCC by histology; (2) patients who had detailed records of living status; (3) patients with valid information such as race, grading of tumors, ELNs, pathologic findings, and tumor size; (4) chemotherapy free before surgery. The following cases were excluded: the required information is missing or incomplete.

Cases were also selected from our center. Patients diagnosed from January 2016 to December 2019 were selected to analysis their information of diagnosis and treatment for ESCC. The criteria for including patients were: (1) Patients over 20 years of age with ESCC; (2) without preoperative adjuvant therapy. The exclusion criteria were: (1) no information on tumor progression or stage was available; (2) with chronic disease or organ dysfunction. Patients who did not participate in the follow-up were excluded. Tables 1, 2 show the data feature of SEER database and our center adoptive in this study respectively.

TABLE 1

Table 1. Patients’ demographics, clinical characteristics at diagnosis.

TABLE 2

Table 2. Patients’ demographics, clinical characteristics at diagnosis in our centre.

Variable definition

The clinicopathological variables included demographics, pathology, clinical stage, treatment, ELNs, and 8th TNM stage. In the latest version, some of the data were marked the status of TNM stage according to the 8th AJCC TNM system, while some data remained to be old edition. Therefore, after we abstracted the data, we transformed the old TNM staging system into the 8th AJCC TNM system because the number of positive examined lymph nodes and T stage were provided in the original data. Gender includes male and female. Age was converted to a dichotomous variable: <60 years and ≥60 years. Race mainly includes white, black and other races. The pathology was graded according to the degree of differentiation. LNM was recorded as positive (Y) and negative (N). Also, M1 indicated distant metastasis. The tumors were grouped according to their size as follows: ≤3 cm and >3 cm. While for ELNs, based on the result of X-tile software, the cut-off value was 10(18). Hence, ELNs were categorized into two groups: ≤10 and >10. Chemotherapy was described as Yes or No, as well as smoking. Overall survival (OS) and cancer-specific survival (CSS) were the main indicators.

Statistical analysis

For data from the SEER database was investigated by the association among the categorical variables utilizing Pearson’s Chi-square test. a K-M survival curve was applied to analyze the OS and CSS according to the previous study (21). In addition, Univariate and multivariate Cox regression were used to determine the prognostic risk factors. After that, we build a nomogram model according to the results and validated it internally and externally. The cases from 2004 to 2009 were used as the training group, while the cases from 2010 to 2015 and the cases from our hospital were used as the validation group. C-index value, ROC curves, and decision curve analysis (DCA) were choosed to identify the value of model (22–24). All statistical analyses were performed using R version 4.1.3 and related packages. The difference was considered statistically significant when P-value <0.05.

Results

Basic characteristics

According to the flow chart (Supplementary Figures S1, S2), 3,629 patients diagnosed as ESCC from the SEER database were enrolled. We determined the diagnosis of ESCC based on pathological diagnosis, and then excluded patients with no information about TNM stage and survival status. As shown in Table 1, we included 3,629 patients from the SEER database including 1,732 patients from 2004 to 2009 and 1,897 patients from 2010 through 2015. According to Pearson’s Chi-square analysis, we found patients aged more than 50 years old accounted for a larger ratio than younger patients in ESCC patients, and male patients were more than female patients (P < 0.05). Furthermore, the total LNM rate was 54.42% and the distant metastasis rate was 24.28%. Accordingly, the median survival time was 9 months (range: ranged from 4 to 23 months). Also, we included 268 patients from our centre. The median survival time was 28.9 months (range: ranged from 9 to 43 months). In line with the SEER database, we also found patients with ESCC were inclined to be older people (66.79% vs. 33.21%) and male gender (82.84% vs. 17.16%). However, we found the rate of LNM and metastasis in our patients was lower than that in patients from the SEER database, which could be because our patients were diagnosed from 2016 to 2019 when endoscopy was extensively used.

Grouping of ELNs in ESCC patients

Using X-tile software, we found the optimal cut-off of ELNs was 10 and divided into two groups (<10 vs. ≥10) (Supplementary Figure S3). As shown in Figure 1A, the OS rate between the two groups could be considered significantly different. Consequently, the CSS of patients with less than 10 ELNs was worse than patients with more than 10 ELNs (Figure 1B). Additionally, K–M survival analysis showed patients with >10 examined LNs who were in the different clinical TNM stages had better survival, of which the difference was statistically significant according to the grouping of ELNs (P < 0.0001) (Figure 2). Furthermore, to verify previous results, we analyzed whether the grouping of examined LNs was suitable for our clinical data. As shown in Figure 3, we found that patients with >10 examined LNs in our center had a higher survival rate (P = 0.037).

FIGURE 1

Figure 1. Kaplan-Meier survival analysis based on the number of ELNs. (A) OS, (B) CSS.

FIGURE 2

Figure 2. Kaplan-Meier survival analysis for CSS based on the number of ELNs. (A) Stage I, (B) Stage II, (C) Stage III, (D) Stage IV.

FIGURE 3

Figure 3. Kaplan-Meier survival analysis of patients from our center based on the number of ELNs.

Prediction model of ESCC survival

To determine the most suitable features to build a nomogram, we performed a multivariate cox analysis, and the independent prognostic factors included age, tumor size, TNM stage and ELN (Figure 4). Patients who were aged ≥60, with tumor size >3 cm, or with lymph node metastasis had a worse prognosis, while patients with ELNs >10 have a better prognosis. After multivariate cox analysis, compared to the white race, the black race was a risk factor for survival, however, the other races were not associated with survival. Therefore, the race was excluded. The record of marital status contained much uncertain information, hence it is hard to accurately identify marital status as an independent factor. Then a nomogram predicting prognosis was constructed based on the results above (Figure 5). As shown in the survival model, T stage had the greatest impact on prognosis, followed by ELNs, distant metastasis, tumor size, and age, while LNM did the least effect on prognosis.

FIGURE 4

Figure 4. Multivariate Cox regression analysis.

FIGURE 5

Figure 5. Model predicted 1-, 3- and 5-year CSS based on the number of ELNs.

Nomogram validation

Firstly, in our training cohort, the C-index of the nomogram model has a value of 0.708 which ranged from 0.678 to 0.753, which were better than that of the 8th TNM staging system (Table 3). The external validation cohort also showed our model had a good C-index value (0.687, ranging from 0.601 to 0.734). In line with the training cohort and external validation, the result of analyzing data from our center also demonstrated nomogram model with a C-index value of 0.652 was better than that of the traditional 8th TNM stage of which the C-index was 0.604 (Table 3). For specificity and sensitivity of diagnosis, the model also outperformed TNM stage in both cohorts (P < 0.001, Table 3 and Figures 6A–C) and external cohort (P < 0.001, Table 3 and Figures 6D–F). Finally, we performed DCA to compare the clinical usability, finding nomogram showed a greater benefit compared to the TNM staging system for predicting the CSS with different survival time (Figure 7). Furthermore, the above results were additionally testified by data from our center. As shown in Table 3 and Figures 8A–C, the nomogram model was better than the TNM stage for predicting survival (P < 0.05). However, the difference in predicting 5-year survival had no significance (P = 0.149). The results of DCA also showed nomogram was more favorable for clinical decision and assessment (Figures 8D–F).

FIGURE 6

Figure 6. ROC curve of the nomogram and 8th TNM stage. (A–C) 1-, 3- and 5-year in the 2004–2009 cohort. (D–F) 1-, 3- and 5-year in the 2010–2015 cohort.

FIGURE 7

Figure 7. DCA of the nomogram and the 8th TNM stage. (A–C) 1-, 3- and 5-year points in the 2004–2009 cohort. (D–F) 1-, 3- and 5-year in the 2010–2015 cohort.

FIGURE 8

Figure 8. The ROC curve and DCA of the model from our centre. (A–C) ROC curve for 1-, 3- and 5-year. (D–F) DCA for 1-, 3- and 5-year survival.

TABLE 3

Table 3. Prediction accuracy of modified model vs. TNM stage in survival of ESCC patients.

Discussion

ESCC is the predominant histologic subtype of EC over the world, while adenocarcinoma is mainly distributed in North America and Europe. ESCC was derived from an epithelial cell of the mucosa, which was often stimulated due to alcohol and smoke (5). Radical surgery is considered the preferable therapeutic method, especially for some minimally invasive surgery such as endoscopic surgery (25). However, the long-term survival was still low because of high recurrence or distant metastasis. Therefore, radical resection and adequate lymph node dissection were critical. This study shows that the number of ELNs has a significant impact on the prognosis of ESCC patients. Moreover, we determined the optimal demarcation of ELNs was 10 using X-tile software and divided patients into two groups: ≤10 ELNs and >10 ELNs. At the same time, we performed multivariate regression analysis and built a nomogram model, of which the process was credible and accurate (26). Furthermore, the nomogram was validated by the training cohort and two external cohorts, suggesting it was superior to the traditional 8th TNM staging system as far as clinical usefulness was concerned.

It is well-known that ELNs are one of the important factorsassociated with patients’ prognosis, which was also demonstrated by many previous studies (27, 28). Several studies found the number of ELNs (>15) affects the prognosis of ESCC patient (29). In our study, we found that the best cut-off value of ELNs was 10, which was in line with other studies (15, 30, 31). Considering the AUC value of ROC, the nomogram performed well with a value of 0.7 and was better compared to the 8th TNM staging (32, 33). In addition, some researchers put forward other different views on TNM stage (15, 34, 35). By figuring out the C-index value and performing tdROC and DCA, we demonstrated nomogram was more effective on clinical usability compared to the TNM staging system, which was also tested by many previous studies (32, 33).

In our model, we totally included age, TNM stage, tumor size, and ELNs to build the model. Usually, the pathological grade was considered as an independent factor for patients’ survival. However, we excluded it according to multivariate analysis (36). We thought the main reason was the limited sample of different pathological subtypes. Regarding the cut-off value in our study, of course, different studies reported diversely. As for stage IV of ESCC, a study thought 18 ELNs were necessary for determining accurate staging and improving survival (37), while another study indicated that 15 ELNs at least were favorable r for patients’ survival (38). However, removing lymph nodes and assessing LNM depended on the surgeon and pathological clinicians to some extent (14). Therefore, the differences in studies may be due to the heterogeneity of the study population. Although there were similar studies focused on the cut-off value of ELN (29), our study further constructed a predicting model of survival based on the number of ELN, which made the study more clinically meaningful. To some extent, we could assess the survival of patients after surgery according to the nomogram.

Our study also has some limitations that cannot be ignored. First, we excluded patients with missing data such as the TNM staging and pathological grade, leading to the increased selection bias. Next, our manuscript has not included other characteristics both in the SEER database and in our own data, such as hematological biomarkers and molecular parameters, which made our model limited. Next, in fact, we found the SEER data showed of 85% patients with less than 10 ELN, which was inconsistent with our data, affecting our analysis of survival in general. But we checked other studies about SEER data, we found there was a similar rate of less than 10 ELNs (9). Moreover, the low rate of ELN would underestimate the stage of the tumor, decreasing the reliability of our study. Finally, whether patients from the SEER database received chemotherapy after surgery or radiotherapy was not known to us, which did make a great difference for our analysis. However, in our data, we included the information about chemotherapy, making an explanation to problems to some extent. Also, as for the result of own data, we found the nomogram model was similar to the TNM stage for predicting 5-year survival (P = 0.149). We thought the limited samples of patients with 5-year survival were the main reason because the nomogram model performed well in the internal and external validation group which had sufficient patients with 5-year survival. Of course, this hypothesis needs to be proven by enrolling a larger sample of patients in the future.

Conclusions

In addition to ELNs was an independent protective factor, variables including age, tumor size, and TNM stage were the independent risk factor for CSS according to the results of multiple statistical analyses. The number of ELNs was more favorable when it was more than 10. More than 10 ELNs are helpful to evaluate the survival of ESCC patients. Based on this, an improved model for predicting the prognosis of ESCC patients was constructed and could serve as an assistive tool for survival evaluation compared to the 8th TNM staging system.

Data availability statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics statement

The studies involving human participants were reviewed and approved by the Ethics Committee of the Affiliated Hospital (Group) of Putian University [approval no. PY-KY-2020(2)-0032]. The patients/participants provided their written informed consent to participate in this study.

Author contributions

Study concept and design: WL and YC. Acquisition of data: TY, SH, and BC. Analysis and interpretation of data: TY. Drafting of the manuscript: TY. Critical revision of the manuscript for important: WL and YC. Statistical analysis: TY. Obtained funding: WL and YC. The authors had full access to the data and take full responsibility for the results. All authors contributed to the article and approved the submitted version.

Funding

This work was supported by the Natural Science Foundation of Fujian Province of China (grant number 2020J011091).

Acknowledgments

The authors acknowledge the efforts of the SEER program in the creation of the SEER database (authorized username: 17015-Nov2018).

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fsurg.2022.989408/full#supplementary-material.

References

1. Lin Y, Totsuka Y, He Y, Kikuchi S, Qiao Y, Ueda J, et al. Epidemiology of esophageal cancer in Japan and China. J Epidemiol. (2013) 23:233–42. doi: 10.2188/jea.JE20120162

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Bray F, Ferlay J, Soerjomataram I, Siegel RL, Torre LA, Jemal A. Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin. (2018) 68:394–424. doi: 10.3322/caac.21492

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Reichenbach ZW, Murray MG, Saxena R, Farkas D, Karassik EG, Klochkova A, et al. Clinical and translational advances in esophageal squamous cell carcinoma. Adv Cancer Res. (2019) 144:95–135. doi: 10.1016/bs.acr.2019.05.004

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Napier KJ, Scheerer M, Misra S. Esophageal cancer: a review of epidemiology, pathogenesis, staging workup and treatment modalities. World J Gastrointest Oncol. (2014) 6:112–20. doi: 10.4251/wjgo.v6.i5.112

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Pennathur A, Gibson MK, Jobe BA, Luketich JD. Oesophageal carcinoma. Lancet. (2013) 381:400–12. doi: 10.1016/S0140-6736(12)60643-6

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Hatogai K, Fujii S, Kojima T, Daiko H, Kadota T, Fujita T, et al. Prognostic significance of tumor regression grade for patients with esophageal squamous cell carcinoma after neoadjuvant chemotherapy followed by surgery. J Surg Oncol. (2016) 113:390–6. doi: 10.1002/jso.24151

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Leng X, He W, Yang H, Chen Y, Zhu C, Fang W, et al. Prognostic impact of postoperative lymph node metastases after neoadjuvant chemoradiotherapy for locally advanced squamous cell carcinoma of esophagus: from the results of NEOCRTEC5010, a randomized multicenter study. Ann Surg. (2021) 274:e1022–9. doi: 10.1097/SLA.0000000000003727

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Biau J, Lapeyre M, Troussier I, Budach W, Giralt J, Grau C, et al. Selection of lymph node target volumes for definitive head and neck radiation therapy: a 2019 update. Radiother Oncol. (2019) 134:1–9. doi: 10.1016/j.radonc.2019.01.018

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Groth SS, Virnig BA, Whitson BA, DeFor TE, Li ZZ, Tuttle TM, et al. Determination of the minimum number of lymph nodes to examine to maximize survival in patients with esophageal carcinoma: data from the surveillance epidemiology and end results database. J Thorac Cardiovasc Surg. (2010) 139:612–20. doi: 10.1016/j.jtcvs.2009.07.017

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Peyre CG, Hagen JA, DeMeester SR, Van Lanschot JJ, Hölscher , A , Law S, et al. Predicting systemic disease in patients with esophageal cancer after esophagectomy: a multinational study on the significance of the number of involved lymph nodes. Ann Surg. (2008) 248:979–85. doi: 10.1097/SLA.0b013e3181904f3c

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Rizk NP, Ishwaran H, Rice TW, Chen LQ, Schipper PH, Kesler KA, et al. Optimum lymphadenectomy for esophageal cancer. Ann Surg. (2010) 251:46–50. doi: 10.1097/SLA.0b013e3181b2f6ee

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Rice TW, Ishwaran H, Hofstetter WL, Kelsen DP, Apperson-Hansen C, Blackstone EH. Recommendations for pathologic staging (pTNM) of cancer of the esophagus and esophagogastric junction for the 8th edition AJCC/UICC staging manuals. Dis Esophagus. (2016) 29:897–905. doi: 10.1111/dote.12533

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Ajani JA, D'Amico TA, Bentrem DJ, Chao J, Corvera C, Das P, et al. Esophageal and esophagogastric junction cancers, version 2.2019, NCCN clinical practice guidelines in oncology. J Natl Compr Canc Netw. (2019) 17:855–83. doi: 10.6004/jnccn.2019.0033

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Hu Y, Hu C, Zhang H, Ping Y, Chen LQ. How does the number of resected lymph nodes influence TNM staging and prognosis for esophageal carcinoma? Ann Surg Oncol. (2010) 17:784–90. doi: 10.1245/s10434-009-0818-5

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Peyre CG, Hagen JA, DeMeester SR, Altorki NK, Ancona E, Griffin SM, et al. The number of lymph nodes removed predicts survival in esophageal cancer: an international study on the impact of extent of surgical resection. Ann Surg. (2008) 248:549–56. doi: 10.1097/SLA.0b013e318188c474

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Schwarz RE, Smith DD. Clinical impact of lymphadenectomy extent in resectable esophageal cancer. J Gastrointest Surg. (2007) 11:1384–94; discussion 1393–84. doi: 10.1007/s11605-007-0264-2

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Zhuang W, Chen J, Li Y, Liu W. Valuation of lymph node dissection in localized high-risk renal cell cancer using X-tile software. Int Urol Nephrol. (2020) 52:253–62. doi: 10.1007/s11255-019-02307-x

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Camp RL, Dolled-Filhart M, Rimm DL. X-tile: a new bio-informatics tool for biomarker assessment and outcome-based cut-point optimization. Clin Cancer Res. (2004) 10:7252–9. doi: 10.1158/1078-0432.CCR-04-0713

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Zheng XQ, Huang JF, Lin JL, Chen L, Zhou TT, Chen D, et al. Incidence, prognostic factors, and a nomogram of lung cancer with bone metastasis at initial diagnosis: a population-based study. Transl Lung Cancer Res. (2019) 8:367–79. doi: 10.21037/tlcr.2019.08.16

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Jayarajah U, Fernando A, Samarasekera DN, Seneviratne S. The incidence and histological patterns of oesophageal cancer in Sri Lanka from 2001 to 2010: analysis of national cancer registry data. Eur J Cancer Care (Engl). (2020) 29:e13182. doi: 10.1111/ecc.13182

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Tang CT, Chen Y, Zeng C. Prognostic analysis of gastric signet ring cell carcinoma and mucinous carcinoma: a propensity score-matched study and competing risk analysis. Aging. (2020) 12:22059–77. doi: 10.18632/aging.104048

PubMed Abstract | CrossRef Full Text | Google Scholar

22. JN C SW, Z QW, Tang CT, Zhang XT, Tang MY, et al. A new metastatic lymph node classification-based survival predicting model in patients with small bowel adenocarcinoma: a derivation and validation study. EBioMedicine. (2018) 32:134–41. doi: 10.1016/j.ebiom.2018.05.022

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Hanley JA, McNeil BJ. A method of comparing the areas under receiver operating characteristic curves derived from the same cases. Radiology. (1983) 148:839–43. doi: 10.1148/radiology.148.3.6878708

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Blanche P, Dartigues J-F, Jacqmin-Gadda H. Estimating and comparing time-dependent areas under receiver operating characteristic curves for censored event times with competing risks. Stat Med. (2013) 32:5381–97. doi: 10.1002/sim.5958

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Sun F, Yuan P, Chen T, Hu J. Efficacy and complication of endoscopic submucosal dissection for superficial esophageal carcinoma: a systematic review and meta-analysis. J Cardiothorac Surg. (2014) 9:78. doi: 10.1186/1749-8090-9-78

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Lu S, Zhao R, Ni Y, Ding J, Qiu F, Peng Y, et al. Development and validation of a nomogram for preoperative prediction of cervical lymph node involvement in thyroid microcarcinoma. Aging. (2020) 12:4896–906. doi: 10.18632/aging.102915

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Tian D, Li HX, Yang YS, Yan HJ, Jiang KY, Zheng YB, et al. The minimum number of examined lymph nodes for accurate nodal staging and optimal survival of stage T1-2 esophageal squamous cell carcinoma: A retrospective multicenter cohort with SEER database validation. Int J Surg. (2022) 104:106764. doi: 10.1016/j.ijsu.2022.106764

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Vather R, Sammour T, Kahokehr A, Connolly AB, Hill AG. Lymph node evaluation and long-term survival in Stage II and Stage III colon cancer: a national study. Ann Surg Oncol. (2009) 16:585–93. doi: 10.1245/s10434-008-0265-8

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Giugliano DN, Berger AC, Pucci MJ, Rosato EL, Evans NR, Meidl H, et al. Comparative quantitative lymph node assessment in localized esophageal cancer patients after R0 resection with and without neoadjuvant chemoradiation therapy. J Gastrointest Surg. (2017) 21:1377–84. doi: 10.1007/s11605-017-3478-y

PubMed Abstract | CrossRef Full Text | Google Scholar

30. D’Journo XB. Clinical implication of the innovations of the 8 edition of the TNM classification for esophageal and esophago-gastric cancer. J Thorac Dis. (2018) 10:S2671–81. doi: 10.21037/jtd.2018.03.182

CrossRef Full Text | Google Scholar

31. Bogoevski D, Onken F, Koenig A, Kaifi JT, Schurr P, Sauter G, et al. Is it time for a new TNM classification in esophageal carcinoma? Ann Surg. (2008) 247:633–41. doi: 10.1097/SLA.0b013e3181656d07

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Yu J, Hu W, Yao N, Sun M, Li X, Wang L, et al. Development and validation of a nomogram to predict overall survival of T1 esophageal squamous cell carcinoma patients with lymph node metastasis. Transl Oncol. (2021) 14:101127. doi: 10.1016/j.tranon.2021.101127

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Yang K, Xie W, Zhang X, Wang Y, Shou A, Wang Q, et al. A nomogram for predicting late radiation-induced xerostomia among locoregionally advanced nasopharyngeal carcinoma in intensity modulated radiation therapy era. Aging. (2021) 13:18645–57. doi: 10.18632/aging.203308

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Akutsu Y, Matsubara H. The significance of lymph node status as a prognostic factor for esophageal cancer. Surg Today. (2011) 41:1190–5. doi: 10.1007/s00595-011-4542-y

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Wang N, Jia Y, Wang J, Wang X, Bao C, Song Q, et al. Prognostic significance of lymph node ratio in esophageal cancer. Tumour Biol. (2015) 36:2335–41. doi: 10.1007/s13277-014-2840-x

PubMed Abstract | CrossRef Full Text | Google Scholar

36. Tirumani H, Rosenthal MH, Tirumani SH, Shinagare AB, Krajewski KM, Ramaiya NH. Esophageal carcinoma: current concepts in the role of imaging in staging and management. Can Assoc Radiol J. (2015) 66:130–9. doi: 10.1016/j.carj.2014.08.006

PubMed Abstract | CrossRef Full Text | Google Scholar

37. Greenstein AJ, Litle VR, Swanson SJ, Divino CM, Packer S, Wisnivesky JP. Effect of the number of lymph nodes sampled on postoperative survival of lymph node-negative esophageal cancer. Cancer. (2008) 112:1239–46. doi: 10.1002/cncr.23309

PubMed Abstract | CrossRef Full Text | Google Scholar

38. Bollschweiler E, Baldus SE, Schröder W, Schneider PM, Hölscher AH. Staging of esophageal carcinoma: length of tumor and number of involved regional lymph nodes. Are these independent prognostic factors? J Surg Oncol. (2006) 94:355–63. doi: 10.1002/jso.20569

PubMed Abstract | CrossRef Full Text | Google Scholar