Skip to main content

ORIGINAL RESEARCH article

Front. Oncol., 05 August 2020
Sec. Thoracic Oncology

The Positive Lymph Node Ratio Predicts Survival in T1−4N1−3M0 Non-Small Cell Lung Cancer: A Nomogram Using the SEER Database

  • 1Department of Respiratory and Critical Care Medicine, The Affiliated Hospital of Southwest Medical University, Luzhou, China
  • 2Inflammation & Allergic Diseases Research Unit, The Affiliated Hospital of Southwest Medical University, Luzhou, China

Background: An increasing number of studies have shown that the positive lymph node ratio (pLNR) can be used to evaluate the prognosis of non-small cell lung cancer (NSCLC) patients. To determine the predictive value of the pLNR, we collected data from the Surveillance, Epidemiology, and End Results (SEER) database and performed a retrospective analysis.

Methods: We collected survival and clinical information on patients with T1−4N1−3M0 NSCLC diagnosed between 2010 and 2016 from the SEER database and screened them according to inclusion and exclusion criteria. X-tile software was used to obtain the best cut-off value for the pLNR. Then, we randomly divided patients into a training set and a validation set at a ratio of 7:3. Pearson's correlation coefficient, tolerance and the variance inflation factor (VIF) were used to detect collinearity between variables. Univariate and multivariate Cox regression analyses were used to identify significant prognostic factors, and nomograms was constructed to visualize the results. The concordance index (C-index), calibration curves, and decision curve analysis (DCA) were used to assess the predictive ability of the nomogram. We divided the patient scores into four groups according to the interquartile interval and constructed a survival curve using Kaplan–Meier analysis.

Results: A total of 6,245 patients were initially enrolled. The best cut-off value for the pLNR was determined to be 0.55. The nomogram contained 13 prognostic factors, including the pLNR. The pLNR was identified as an independent prognostic factor for both overall survival (OS) and cancer-specific survival (CSS). The C-index was 0.703 (95% CI, 0.695–0.711) in the training set and 0.711 (95% CI, 0.699–0.723) in the validation set. The calibration curves and DCA also indicated the good predictability of the nomogram. Risk stratification revealed a statistically significant difference among the four groups of patients divided according to quartiles of risk score.

Conclusion: The nomogram containing the pLNR can accurately predict survival in patients with T1−4N1−3M0 NSCLC.

Introduction

As the global population ages, cancer is becoming an increasing burden on human health. The World Health Organization's International Agency for Research on Cancer (IARC) released its broad survey of cancer morbidity and mortality worldwide in 2018 and showed that lung cancer led the list of new cases and deaths worldwide in that year. Among all the pathological types of lung cancer, non-small cell lung cancer (NSCLC) is the most common type, accounting for 80% of all lung cancers (1, 2). In recent years, the death rate of lung cancer patients in the United States has decreased gradually, whereas that in China is still increasing. The incidence of lung cancer among non-smokers in China is significantly higher than that in the United States, especially among women (3). The global cancer situation remains very serious.

Lung cancer, as a heterogeneous disease, should be treated as an individual entity. According to this idea, the latest (8th edition) staging system for tumor lymph node metastasis (TNM) can more accurately predict the prognosis of NSCLC patients than the 7th edition (4). However, the 8th edition of the N staging system, which divides lymph nodes into four groups based on their anatomical area, has changed little since the 7th edition (5). However, staging based solely on the anatomical region of lymph nodes cannot avoid the problem of lymph node heterogeneity and is insufficient for clinical application.

The latest TNM staging system considers the grouping of anatomical regions and the number of positive lymph nodes for partial tumor staging [e.g., gastric cancer (6) and rectal cancer (7)]. With continuous improvements in detection methods, the number of lymph nodes and the positive lymph node ratio (pLNR) as the bases for lymph node staging have attracted increasing attention. In addition, the pLNR has been shown to predict the prognosis of patients with pancreatic cancer (8), breast cancer (9), and laryngeal squamous cell carcinoma (10).

The Surveillance, Epidemiology, and End Results (SEER) database (https://seer.cancer.gov/) is the authoritative cancer statistics database in the United States. The SEER database has a large sample size and samples from multiple populations, which makes studies based on the SEER database of high clinical value. In this study, to investigate whether the pLNR can predict the prognosis of non-advanced NSCLC patients, we collected patient and clinical information from the SEER database and conducted a large-sample retrospective study.

Materials and Methods

Data Collection

Data were extracted from the SEER database with SEER*Stat Software (version 8.3.6; https://seer.cancer.gov/data-software/), and the Incidence SEER 18 Regs Custom Data (with additional treatment fields) and Nov 2018 Sub (1973-2016 varying) datasets were selected for analysis (username for log in: 14112-Nov2018). The NSCLC patients in our limited group were diagnosed with T1−4N1−3M0 between 2010 and 2016. The corresponding selection formula in the software was expressed as follows: {Site and Morphology. TNM 7/CS v0204+ Schema}=“Lung” AND {Stage-American Joint Committee on Cancer (AJCC). Derived AJCC Stage Group, 7th ed. (2010+)}=“I,” “IA,” “IB,” “II,” “IIA,” “IIB,” “III,” “IIIA,” “IIIB” AND {Race, Sex, Year Dx, Registry, County, Year of diagnosis}= “2010,” “2011,” “2012,” “2013,” “2014,” “2015,” “2016.” The extracted clinical information included the following: patient ID, age at diagnosis, sex, grade, laterality, primary site, histologic type, T stage, N stage, surgery at the primary site, scope of regional lymph node surgery radiation recode, radiation sequence with surgery, chemotherapy recode, regional nodes examined, regional nodes positive, survival months, vital status recode, SEER cause-specific death classification, marital status at diagnosis, insurance recode, first malignant primary indicator, sequence number and diagnostic confirmation.

Data Processing

Samples meeting any of the following criteria were excluded: (1) missing or unknown clinical patient information; (2) pathological tumor of type small cell carcinoma, sarcoma or another type not belonging to NSCLC; (3) patient survival time less than or equal to 0 months; (4) fewer than 1 regional nodes examined or operation not involving lymph node removal; (5) patient receipt of preoperative or intraoperative radiotherapy; (6) multiple primary cancers; (7) a first malignant primary indicator entry of “yes” and a sequence number of one (primary only); (8) diagnostic confirmation not obtained via positive histology and diagnosis obtained through a death certificate or autopsy; and (9). AJCC stage not corresponding to T1−4N1−3M0.

After filtering the data, additional classification was performed. Age was treated as a continuous variable, and the other factors were treated as categorical variables. Patients who were widowed, divorced, unmarried or single or had a domestic partner (unmarried) were all considered unmarried. We also divided the pathological tissue types into adenocarcinoma (ADC), squamous cell carcinoma (SCC), adenosquamous carcinoma (ASC) and large cell carcinoma (LCC). Other histopathologic types, such as giant cell carcinoma and spindle cell carcinoma, were classified as “other.” Overall survival (OS) was defined as the time from the beginning of random assignment to death caused by any reason. Cancer-specific survival (CSS) was defined as the time from the beginning of random assignment to death caused by cancer.

The formula used to calculate the pLNR was regional nodes positive/regional nodes examined. In most clinical studies, the correlations between continuous variables and outcomes are not linear, and continuous variables are not as convenient as categorical variables in clinical applications. For general dichotomized outcome indicators, Youden's index can be calculated, but for survival-type data, it is difficult to obtain truncated values. X-tile software was used to determine the optimal cut-off value of the survival data (11). This software analyzes different values as cut-off values for a statistical test, and the result with the smallest p-value is considered the best cut-off value. Patients were divided into high-pLNR and low-pLNR groups according to the optimal cut-off value.

Construction and Validation of the Nomogram

We randomly divided the enrolled patients into a training set and a validation set at a ratio of 7:3, and the clinical prognosis information of the two groups of patients was analyzed. For the training set, a univariate Cox regression analysis was used, and after excluding the prognostic factors with no statistical significance, the remaining factors were included in a multivariate Cox regression analysis. The hazard ratio and 95% confidence interval (CI) were also calculated. Finally, according to the same exclusion criteria, we obtained the final factors that affected the prognosis of non-advanced NSCLC patients. Based on the multivariate Cox regression analysis, the multiprediction indexes were integrated to further express the relationships between the variables in the prediction model. The rms (12), foreign and survival packages in R software were used to construct the nomogram.

To verify the prediction accuracy of the nomogram, we calculated Harrell's concordance index (C-index) (13) and calibration curves for the training and validation groups. In addition, decision curve analysis (DCA) performed with the DecisionCurve package (14) was used to determine the 1-, 3-, and 5-year survival rates of the two sets. DCA was performed to compare AJCC TNM stage (7th edition), the pLNR and the nomogram.

Risk Stratification

To clarify the descriptive power of the nomogram, we obtained the risk scores based on the clinical factors in the nomogram and calculated the score of each patient in the validation set. Then, we divided the validation set into four groups according to quartile spacing, constructed the survival curve using Kaplan–Meier analysis and calculated the p-value with the log-rank test. The survival curves of NSCLC patients for OS and CSS in the training set and validation set were constructed in the same manner.

Statistical Analysis

All the statistical tests were performed using R (version 3.6.0, https://www.r-project.org) and SPSS software (version 22.0; IBM Corp., Armonk, NY, USA). Cumulative survival time (for both OS and CSS) was calculated using the Kaplan-Meier method, and the differences in survival curves were analyzed using the log-rank test. We calculated Pearson's correlation coefficients to detect collinearity among the variables. A correlation coefficient of <0.7 between two independent variables was considered indicative of no multicollinearity (15). We also calculated tolerance and variance inflation factor (VIF) values to evaluate multicollinearity between variables, with tolerance <0.1 and VIF >10 considered indicative of multicollinearity. P < 0.05 was considered statistically significant (16).

Results

Patient Clinicopathological Characteristics

According to our inclusion and exclusion criteria, 6,245 patients with T1−4N1−3M0 NSCLC were enrolled. The best cut-off value for the pLNR was determined to be 0.55. The clinicopathological characteristics of the patients in the training set and the validation set are shown in Table 1. Among the patients, 4,373 were allocated to the training set, and 1,872 were allocated to the validation set. The prognosis of patients with high pLNR was significantly worse than that of both patients with low pLNR and the overall patient population for both OS (Figures 1A,B) and CCS (Figures 1C,D).

TABLE 1
www.frontiersin.org

Table 1. The demographics and pathological characteristics of the included patients in the training and validation sets.

FIGURE 1
www.frontiersin.org

Figure 1. Kaplan-Meier curves of OS and CSS for patients with high and low pLNR in the training set [(A), OS; (C), CSS] and the validation set [(B), OS; (D), CSS]. OS, overall survival; CSS, cancer-specific survival; pLNR, positive lymph node ratio.

Cox Regression Analysis

The following factors were included in the univariate Cox regression analysis: age, race (White vs. Black vs. other), sex (male vs. female), marital status (married vs. unmarried), insurance status (insured vs. uninsured), histological type (ADC vs. SCC vs. ASC vs. LCC vs. other), grade (well differentiated, grade I vs. moderately differentiated, grade II vs. poorly differentiated, grade III vs. undifferentiated or anaplastic, grade IV), primary site (main bronchus vs. upper lobe vs. middle lobe vs. lower lobe), laterality (left vs. right), T stage (T1 vs. T2 vs. T3 vs. T4), N stage (N1 vs. N2 vs. N3), surgery at the primary site (lobectomy vs. pneumonectomy), scope of regional lymph node surgery (1-3 regional lymph nodes removed vs. ≥4 regional lymph nodes removed), radiation therapy (yes vs. no), chemotherapy (yes vs. no) and pLNR (high vs. low). The prognostic factors with significant differences were included in the multivariate Cox regression analyses for OS and CSS. The multivariate Cox regression analyses revealed that primary site was not significant for OS and that race, primary site, surgery and radiation therapy were not significant for CSS. The other prognostic factors were included in the construction of the nomogram. The results of the Cox regression analysis of OS are shown in Figures 2A, 3A, and those for CSS are shown in Figures 2B, 3B.

FIGURE 2
www.frontiersin.org

Figure 2. The forest map of Cox regression analysis. Univariate Cox regression analyses estimating the risk factors for OS (A) and CSS (B). OS, overall survival; CSS, cancer-specific survival. *Means P < 0.05.

FIGURE 3
www.frontiersin.org

Figure 3. The forest map of Cox regression analysis. Multivariate Cox regression analyses estimating the risk factors for OS (A) and CSS (B). OS, overall survival; CSS, cancer-specific survival. *Means P < 0.05.

There was no significant correlation among N stage, the pLNR and the other independent variables for the overall dataset, the training set or the validation set (Figure 4). Furthermore, the tolerance was >1, and VIF was significantly <10 for the overall dataset, the training set and the validation set (Supplementary Table 1), indicating no collinearity among the independent variables.

FIGURE 4
www.frontiersin.org

Figure 4. Correlations between variables in the overall dataset. (A) The training set (B) and the validation set (C).

Construction and Validation of the Nomogram

The nomogram for OS comprised 10 prognostic factors: age, sex, marital status, histological type, grade, T stage, N stage, surgery type, chemotherapy and pLNR (Figure 5A). The nomogram for CSS included 8 prognostic factors: age, sex, histological type, grade, T stage, N stage, chemotherapy and pLNR (Figure 6A). We concluded that the pLNR plays an important role in patient prognosis. The total score was calculated by adding the scores of each factor according to the clinical characteristics, and the 1-, 3-, and 5-year survival rates were estimated by drawing a straight line from the total score on the nomogram. For the training set, the C-index, calculated by the bootstrap self-sampling method, was 0.681 for OS and 0.673 for CSS. For the validation set, the C-index was 0.674 for OS and 0.678 for CSS. The predicted calibration curves were close to the standard curves for 1-, 3-, and 5-year survival for both OS (Figure 5B) and CSS (Figure 6B) in the training set and for both OS (Figure 5F) and CSS (Figure 6F) in the validation set. For both the training and validation sets, the DCA curves for OS (Figures 5C–E,G–I) and CSS (Figures 6C–E,G–I) indicated that the pLNR had a good predictive ability regarding patient prognosis, and the predictive power of our nomogram was better than that of the AJCC staging system (7th edition).

FIGURE 5
www.frontiersin.org

Figure 5. (A) Nomogram used to predict the 1-, 3- and 5-year OS rates of patients with T1−4N1−3M0 NSCLC. (B) Calibration curve of the nomogram for predicting the 1-, 3- and 5-year OS rates of patients with T1−4N1−3M0 NSCLC from the training set. Decision curve analysis of the AJCC 7th stage, nomogram and positive lymph node ratio (pLNR) for the 1- (C), 3- (D) and 5-year (E) OS rates of patients with T1−4N1−3M0 NSCLC from the training set. (F) Calibration curve of the nomogram for predicting the 1-, 3- and 5-year OS rates of patients with T1−4N1−3M0 NSCLC from the validation set. Decision curve analysis of the AJCC 7th stage, nomogram and pLNR for the 1- (G), 3- (H) and 5-year (I) OS rates of patients with T1−4N1−3M0 NSCLC from the validation set. OS, overall survival; pLNR, positive lymph node ratio; NSCLC, non-small cell lung cancer. For calibration curves, green, red, and black line represent 1, 3, and 5 years, respectively. For decision curve analysis, green represents the nomogram, red represents pLNR, and blue represents AJCC 7th stage.

FIGURE 6
www.frontiersin.org

Figure 6. (A) Nomogram used to predict the 1-, 3-, and 5-year CSS rates of patients with T1−4N1−3M0 NSCLC. (B) Calibration curve of the nomogram for predicting the 1-, 3-, and 5-year CSS rates of patients with T1−4N1−3M0 NSCLC from the training set. Decision curve analysis of the AJCC 7th stage, nomogram and positive lymph node ratio (pLNR) for the 1- (C), 3- (D) and 5-year (E) CSS rates of patients with T1−4N1−3M0 NSCLC from the training set. (F) Calibration curve of the nomogram for predicting the 1-, 3-, and 5-year CSS rates of patients with T1−4N1−3M0 NSCLC from the validation set. Decision curve analysis of the AJCC 7th stage, nomogram and pLNR for the 1- (G), 3- (H), and 5-year (I) CSS rates of patients with T1−4N1−3M0 NSCLC from the validation set. CSS, cancer-specific survival; pLNR, positive lymph node ratio; NSCLC, non-small cell lung cancer. For calibration curves, green, red, and black line represent 1, 3, and 5 years, respectively. For decision curve analysis, green represents the nomogram, red represents pLNR, and blue represents AJCC 7th stage.

Risk Stratification

The total score was calculated for each patient in the training and validation sets, and the scores were divided into quartiles for OS (Min-112.86, 112.86–132.50, 132.50–153.46, 153.46-Max) and CSS (Min-115.43, 115.43–136.91, 136.91–159.47, 159.47-Max) to represent different outcomes. Statistically significant differences in OS (Figures 7A,C) and CSS (Figures 7B,D) were observed after stratifying patients according to quartile (all P < 0.001).

FIGURE 7
www.frontiersin.org

Figure 7. Kaplan–Meier curves of risk group stratification within the training set for (A) OS and (B) CSS and within the validation set for (C) OS and (D) CSS. OS, overall survival; CSS, cancer-specific survival.

Discussion

In this study, we screened data from the SEER database according to inclusion and exclusion criteria and conducted univariate and multivariate Cox regression analyses to identify prognostic risk factors. We conclude that the pLNR is a significant factor influencing survival of T1−4N1−3M0 NSCLC patients and can be used to predict patient prognosis. Visualization of the analysis results of the multiple risk factors with the nomogram proved the significant influence of the pLNR on prognosis. The C-index values, calibration curves and DCA curves also proved the good clinical predictive ability of the nomogram. Furthermore, risk stratification also proved the clinical applicability of the nomogram for patients of different stages.

To effectively and accurately treat NSCLC patients, all the prognostic factors that may affect survival should be considered. At present, the AJCC staging of lung cancer (eighth edition) is based mainly on the anatomical locations of lymph nodes and does not consider the number or proportion of positive lymph nodes. However, as early as the release of the 7th edition of the AJCC guidelines, Bria et al. (17) reviewed 415 NSCLC patients in Italy and indicated that the pLNR was an independent prognostic factor. Our current nomogram also shows that the pLNR has a significant influence on prognosis, so it is necessary to study the prognostic value of the pLNR.

Additionally, research using the SEER database has confirmed the ability of the pLNR to predict the survival of NSCLC patients. For example, Urban et al. (18) found that a high pLNR was associated with poor survival for patients with resected, node-positive (N1-N2) NSCLC. Ding et al. (19) analyzed data from 109,026 NSCLC patients and found that the pLNR had better predictive ability than N stage regarding patient survival following radiotherapy. Deng et al. (20) found that the pLNR had good predictive value for non-advanced NSCLC patients, both in terms of OS and cancer-specific survival (CCS). In a recent study, Han et al. (21) confirmed that the pLNR combined with TNM stage could predict the prognosis of patients with IIIa-N2 NSCLC.

The results of a number of clinical retrospective studies from all over the world, including studies on different ethnic groups, are consistent with our results based on the SEER database. A meta-analysis of five retrospective studies representing 6,130 non-advanced NSCLC patients from the United States and China indicated that the pLNR could be used to predict the OS and disease-free survival (DFS) of patients and detected no publication bias (22). According to clinical research, the pLNR can be used to assess not only the prognosis of early-stage NSCLC patients but also the risk of brain metastasis in late-stage NSCLC patients (23). Moreover, the pLNR can be used to predict the effects of postoperative radiotherapy and chemotherapy in NSCLC patients (24).

The appropriate partitioning of pLNR cut-off values is debated, and different studies have adopted different methods to determine the truncation value of the pLNR. Matsuguma et al. (25) divided the pLNR into three levels (0, 0.01 ~ 0.12 and >0.12) and used the median of the different groups as the truncated value. In another study on pN1 NSCLC patients, Bria et al. (17) used a classification and regression tree (C&RT) analysis and determined that 9% was the optimal cut-off value for the pLNR based on the maximum log-rank statistical value. The Youden index (26) of the ROC curve can be used to achieve the general dichotomous outcome index, but for survival data, it is difficult to determine the cut-off value. The innovation of our study was that we used X-tile software to determine the minimum P-value of the two groups of data (high and low pLNR) to identify the optimal truncation value.

The pLNR was not the only prognostic factor included in our nomogram. Treatment was another independent prognostic factor, and chemotherapy was identified as beneficial to patient survival. However, expanded resection, such as pneumonectomy, did not improve prognosis over lobectomy in our study. Similar findings were reported by Anderson et al. (27), who analyzed the 5-year survival rate of 641 patients with T4 NSCLC. Although they found no significant difference in survival between patients who underwent two different types of surgery, patients who underwent lobectomy did not die after 5 years. However, some scholars believe that pneumonectomy does not lead to a worse prognosis than lobectomy and that pneumonectomy should remain an option for certain patients (28). Currently, the specific scope of lymph node dissection remains controversial. Expanded regional lymph node dissection does not benefit stage I NSCLC patients, whereas for patients after stage I, such measures can significantly improve prognosis (29). Whether radiotherapy has a beneficial effect on the prognosis of patients is debated. In particular, the reported effects of radiotherapy on prognosis for different stages of lung cancer are inconsistent (30, 31).

Our nomogram revealed additional prognostic demographic factors, such as age, sex, and marital status. Due to the declining health of elderly patients, cancer resistance in such patients is poorer than that in young patients; thus, prognosis in these patients is poor (32, 33). Although the death rate of women with lung cancer is increasing, it remains lower than that of men with lung cancer (1). Further research is needed to determine the mechanism involved. Regarding race, a study from Florida showed that Asians have better prognosis than Blacks and Whites, which supports our hypothesis (34). However, the majority of the remainder of the population in the SEER database is Asian. Furthermore, a 10-year follow-up survey conducted by the Veteran Affairs Central Cancer Registry in the United States showed that ethnic differences did not affect survival or CSS (35). Interestingly, our study found that marital status had some impact on the prognosis of nonadvanced NSCLC patients. Galvin et al. (36) found that marriage significantly reduced the mortality rate of women in their study and that the prognosis of cancer patients was influenced by social and psychological factors.

NSCLC is a heterogeneous disease, and personalized treatment is very important. Therefore, it is necessary to identify prognostic factors to improve the survival rate of patients. The nomogram established in this study has not only high predictive power but also significance for clinical treatment. For example, according to the demographic and clinicopathologic characteristics of patients, scores can be obtained, and survival rates can be estimated. When the estimated survival rate of a patients is low, the choice of follow-up treatment, especially surgical treatment, should be made with care.

To our knowledge, the present study is the first retrospective study of a large number of NSCLC patients with extensive staging and the first to use the pLNR as a prognostic marker to construct a nomogram. However, our research has some shortcomings. First, our study is a retrospective study, and some prognostic factors that were not included in our study due to the limitations of the SEER database, such as smoking history, family history, receipt of targeted therapy or immunotherapy and type of lymph node involvement, may have affected our results. Additionally, the staging system that we used was the 7th edition of the AJCC staging system, and since the SEER database provides tumor size but not the specific site of the tumor or whether it had invaded the prostate or surrounding organs, we were unable to classify tumor information according to the 8th edition of the AJCC staging system. Finally, the SEER database contains data on patients in the United States, which, although abundant, are probably not very representative of lung cancer patients worldwide.

Conclusions

The pLNR is an independent risk factor for non-advanced NSCLC. A nomogram combining demographic, pathological and treatment data was established to predict OS and CSS for patients with non-advanced NSCLC and validated using data from the SEER database.

Data Availability Statement

Publicly available datasets were analyzed in this study. This data can be found here: https://seer.cancer.gov/data/.

Author Contributions

YL and GY conceived and designed the study, acquired and analyzed the data and wrote the manuscript. XF contributed to data analysis and manuscript preparation. All authors read and approved the manuscript and agree to be accountable for all aspects of the research in ensuring that the accuracy or integrity of any part of the work is appropriately investigated and resolved.

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

We thank American Journal Experts for their assistance with language editing.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fonc.2020.01356/full#supplementary-material

References

1. Bray F, Ferlay J, Soerjomataram I, Siegel RL, Torre LA, Jemal A. Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin. (2018) 68:394–424. doi: 10.3322/caac.21492

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Ferlay J, Colombet M, Soerjomataram I, Mathers C, Parkin DM, Pineros M, et al. Estimating the global cancer incidence and mortality in 2018: GLOBOCAN sources and methods. Int J Cancer. (2019) 144:1941–53. doi: 10.1002/ijc.31937

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Yang D, Liu Y, Bai C, Wang X, Powell CA. Epidemiology of lung cancer and lung cancer screening programs in China and the United States. Cancer Lett. (2020) 468:82–7. doi: 10.1016/j.canlet.2019.10.009

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Rami-Porta R, Bolejack V, Crowley J, Ball D, Kim J, Lyons G, et al. The IASLC lung cancer staging project: proposals for the revisions of the T descriptors in the forthcoming eighth edition of the TNM classification for lung cancer. J Thorac Oncol. (2015) 10:990–1003. doi: 10.1097/JTO.0000000000000559

CrossRef Full Text | Google Scholar

5. Yang L, Wang S, Zhou Y, Lai S, Xiao G, Gazdar A, et al. Evaluation of the 7th and 8th editions of the AJCC/UICC TNM staging systems for lung cancer in a large North American cohort. Oncotarget. (2017) 8:66784–95. doi: 10.18632/oncotarget.18158

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Sano T, Coit DG, Kim HH, Roviello F, Kassab P, Wittekind C, et al. Proposal of a new stage grouping of gastric cancer for TNM classification: international gastric cancer association staging project. Gastric Cancer. (2017) 20:217–25. doi: 10.1007/s10120-016-0601-9

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Nicholls RJ, Zinicola R, Haboubi N. Extramural spread of rectal cancer and the AJCC cancer staging manual 8th edition, 2017. Ann Oncol. (2019) 30:1394–5. doi: 10.1093/annonc/mdz147

PubMed Abstract | CrossRef Full Text | Google Scholar

8. You MS, Lee SH, Choi YH, Shin BS, Paik WH, Ryu JK, et al. Lymph node ratio as valuable predictor in pancreatic cancer treated with R0 resection and adjuvant treatment. BMC Cancer. (2019) 19:952. doi: 10.1186/s12885-019-6193-0

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Teng J, Abdygametova A, Du J, Ma B, Zhou R, Shyr Y, et al. Bayesian inference of lymph node ratio estimation and survival prognosis for breast cancer patients. IEEE J Biomed Health Inform. (2019) 24:354–64. doi: 10.1109/JBHI.2019.2943401

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Zhang K, Keymeulen S, Nelson R, Tong TR, Yuan YC, Yun X, et al. Overexpression of flap endonuclease 1 correlates with enhanced proliferation and poor prognosis of non-small-cell lung cancer. Am J Pathol. (2018) 188:242–51. doi: 10.1016/j.ajpath.2017.09.011

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Camp RL, Dolled-Filhart M, Rimm DL. X-tile: a new bio-informatics tool for biomarker assessment and outcome-based cut-point optimization. Clin Cancer Res. (2004) 10:7252–9. doi: 10.1158/1078-0432.CCR-04-0713

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Frank E, Harrel J. RMS: Regression Modeling Strategies. R package version 3.4-0 (2019) Available online at: http://CRAN.Rproject.org/packagerms (accessed February 19, 2019).

13. Heagerty PJ, Zheng Y. Survival model predictive accuracy and ROC curves. Biometrics. (2005) 61:92–105. doi: 10.1111/j.0006-341X.2005.030814.x

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Kerr KF, Brown MD, Zhu K, Janes H. Assessing the clinical impact of risk prediction models with decision curves: guidance for correct interpretation and appropriate use. J Clin Oncol. (2016) 34:2534–40. doi: 10.1200/JCO.2015.65.5654

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Waldmann P. On the use of the pearson correlation coefficient for model evaluation in genome-wide prediction. Front Genet. (2019) 10:899. doi: 10.3389/fgene.2019.00899

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Marcoulides KM, Raykov T. Evaluation of variance inflation factors in regression models using latent variable modeling methods. Educ Psychol Meas. (2019) 79:874–82. doi: 10.1177/0013164418817803

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Bria E, Milella M, Sperduti I, Alessandrini G, Visca P, Corzani F, et al. A novel clinical prognostic score incorporating the number of resected lymph-nodes to predict recurrence and survival in non-small-cell lung cancer. Lung Cancer. (2009) 66:365–71. doi: 10.1016/j.lungcan.2009.02.024

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Urban D, Bar J, Solomon B, Ball D. Lymph node ratio may predict the benefit of postoperative radiotherapy in non-small-cell lung cancer. J Thorac Oncol. (2013) 8:940–6. doi: 10.1097/JTO.0b013e318292c53e

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Ding N, Pang Z, Zhang X, Huang C, Yang Y, Liu Q, et al. Prognostic and predictive effects of positive lymph node number or ratio in NSCLC. Sci Rep. (2017) 7:584. doi: 10.1038/s41598-017-00619-5

CrossRef Full Text | Google Scholar

20. Deng W, Xu T, Wang Y, Xu Y, Yang P, Gomez D, et al. Log odds of positive lymph nodes may predict survival benefit in patients with node-positive non-small cell lung cancer. Lung Cancer. (2018) 122:60–6. doi: 10.1016/j.lungcan.2018.05.016

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Han H, Zhao Y, Gao Z, Zheng D, Fu F, Zhao Z, et al. A prognostic score system with lymph node ratio in stage IIIA-N2 NSCLC patients after surgery and adjuvant chemotherapy. J Cancer Res Clin Oncol. (2019) 145:2115–22. doi: 10.1007/s00432-019-02952-w

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Li Q, Zhan P, Yuan D, Lv T, Krupnick AS, Passaro A, et al. Prognostic value of lymph node ratio in patients with pathological N1 non-small cell lung cancer: a systematic review with meta-analysis. Transl Lung Cancer Res. (2016) 5:258–64. doi: 10.21037/tlcr.2016.06.13

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Ding X, Dai H, Hui Z, Ji W, Liang J, Lv J, et al. Risk factors of brain metastases in completely resected pathological stage IIIA-N2 non-small cell lung cancer. Radiat Oncol. (2012) 7:119. doi: 10.1186/1748-717X-7-119

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Shinde A, Horne ZD, Li R, Glaser S, Massarelli E, Koczywas M, et al. Optimal adjuvant therapy in clinically N2 non-small cell lung cancer patients undergoing neoadjuvant chemotherapy and surgery: the importance of pathological response and lymph node ratio. Lung Cancer. (2019) 133:136–43. doi: 10.1016/j.lungcan.2019.05.020

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Matsuguma H, Oki I, Nakahara R, Ohata N, Igarashi S, Mori K, et al. Proposal of new nodal classifications for non-small-cell lung cancer based on the number and ratio of metastatic lymph nodes. Eur J Cardiothorac Surg. (2012) 41:19–24. doi: 10.1016/j.ejcts.2011.04.016

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Fluss R, Faraggi D, Reiser B. Estimation of the youden index and its associated cutoff point. Biom J. (2005) 47:458–72. doi: 10.1002/bimj.200410135

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Andersson SE, Rauma VH, Sihvo EI, Räsänen JV, Ilonen IK, Salo JA. Bronchial sleeve resection or pneumonectomy for non-small cell lung cancer: a propensity-matched analysis of long-term results, survival and quality of life. J Thorac Dis. (2015) 7:1742–8. doi: 10.3978/j.issn.2072-1439.2015.10.62

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Yamaguchi M, Shimamatsu S, Edagawa M, Hirai F, Toyozawa R, Nosaki K, et al. Pneumonectomy after induction chemoradiotherapy for locally advanced non-small cell lung cancer: should curative intent pulmonary resection be avoided? Surg Today. (2019) 49:197–205. doi: 10.1007/s00595-018-1751-7

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Hughes MJ, Chowdhry MF, Woolley SM, Walker WS. In patients undergoing lung resection for non-small cell lung cancer, is lymph node dissection or sampling superior? Interact Cardiovasc Thorac Surg. (2011) 13:311–5. doi: 10.1510/icvts.2011.268979

CrossRef Full Text | Google Scholar

30. Liao Y, Wang X, Zhong P, Yin G, Fan X, Huang C. A nomogram for the prediction of overall survival in patients with stage II and III non-small cell lung cancer using a population-based study. Oncol Lett. (2019) 18:5905–16. doi: 10.3892/ol.2019.10977

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Yin G, Xiao H, Liao Y, Huang C, Fan X. Construction of a nomogram after using propensity score matching to reveal the prognostic benefit of tumor resection of stage IV M1a nonsmall cell lung cancer patients. Cancer Invest. (2020) 85:277–88. doi: 10.1080/07357907.2020.1753761

CrossRef Full Text | Google Scholar

32. Wang BY, Huang JY, Cheng CY, Lin CH, Ko J, Liaw YP. Lung cancer and prognosis in taiwan: a population-based cancer registry. J Thorac Oncol. (2013) 8:1128–35. doi: 10.1097/JTO.0b013e31829ceba4

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Dziedzic DA, Rudzinski P, Langfort R, Orlowski T. Risk factors for local and distant recurrence after surgical treatment in patients with non-small-cell lung cancer. Clin Lung Cancer. (2016) 17:e157–67. doi: 10.1016/j.cllc.2015.12.013

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Tannenbaum SL, Koru-Sengul T, Zhao W, Miao F, Byrne MM. Survival disparities in non-small cell lung cancer by race, ethnicity, and socioeconomic status. Cancer J. (2014) 20:237–45. doi: 10.1097/PPO.0000000000000058

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Williams CD, Salama JK, Moghanaki D, Karas TZ, Kelley MJ. Impact of race on treatment and survival among U.S. Veterans with early-stage lung cancer. J Thorac Oncol. (2016) 11:1672–81. doi: 10.1016/j.jtho.2016.05.030

PubMed Abstract | CrossRef Full Text | Google Scholar

36. Galvin A, Delva F, Helmer C, Rainfray M, Bellera C, Rondeau V, et al. Sociodemographic, socioeconomic, and clinical determinants of survival in patients with cancer: a systematic review of the literature focused on the elderly. J Geriatr Oncol. (2018) 9:6–14. doi: 10.1016/j.jgo.2017.07.007

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: nomogram, positive lymph node, non-small cell lung cancer, SEER, prognosis

Citation: Liao Y, Yin G and Fan X (2020) The Positive Lymph Node Ratio Predicts Survival in T1−4N1−3M0 Non-Small Cell Lung Cancer: A Nomogram Using the SEER Database. Front. Oncol. 10:1356. doi: 10.3389/fonc.2020.01356

Received: 03 January 2020; Accepted: 29 June 2020;
Published: 05 August 2020.

Edited by:

Matthias Scheffler, University Hospital of Cologne, Germany

Reviewed by:

Arnold Manfred Herskovic, Rush University, United States
Marcel Wiesweg, Universitätsklinikum Essen, Germany

Copyright © 2020 Liao, Yin and Fan. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Xianming Fan, ZnhtMTI5MTIwJiN4MDAwNDA7c2luYS5jb20=

These authors have contributed equally to this work

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.