Breast Cancer Patients With Positive Apical or Infraclavicular/Ipsilateral Supraclavicular Lymph Nodes Should Be Excluded in the Application of the Lymph Node Ratio System

Aim: Increasing studies have demonstrated lymph node ratio (LNR) to be an accurate prognostic indicator in breast cancer and an alternative to pN staging; however, the AJCC-TNM staging system classified apical or infraclavicular/ipsilateral supraclavicular lymph node-positive (APN(+)) patients with a worse prognosis as the pN3 stage. Until now, different reports on LNR in breast cancer have ignored this possibility. Consequently, it is necessary to discuss the role of APN(+) patients in the LNR system to obtain a precise LNR that predicts the prognosis accurately.

Materials and Methods: We collected data on 10,120 breast cancer patients, including 3,936 lymph node-positive patients (3,283 APN(−) and 653 APN(+) patients), who visited our hospital from 2007 to 2012. Then we applied X-tile analysis to calculate cut-off values and conduct survival analysis and multivariate analysis to evaluate patients’ prognosis.

Results: We confirmed that some APN(+) patients were mis-subgrouped according to previously reported LNR, indicating that APN(+) patients should be excluded in the application of LNR to predict prognosis. Then we applied X-tile analysis to calculate two cut-off values (0.15 and 0.34) for LNR-APN(−) patients and conducted survival analysis and found that LNR-APN(−) staging was superior to pN staging in predicting the prognosis of APN(−) breast cancer patients.

Conclusion: From this study, we conclude that excluding APN(+) patients is the most necessary condition for effective implementation of the LNR system. LNR-APN(−) staging could be a more comprehensive approach in predicting prognosis and guiding clinicians to provide accurate and appropriate treatment.

Introduction

The latest American Joint Committee on Cancer (AJCC) staging system recommends that pathologists evaluate the prognosis of patients by pN stage (Greene, 2002; Singletary et al., 2002). However, this classification only considered the number of positive lymph nodes and did not take the total number of lymph nodes into account. In recent years, emerging researchers have proposed lymph node ratio (LNR), the number of involved positive lymph nodes divided by the total number of lymph nodes examined, to be a better prognostic indicator than absolute lymph node number (Woodward et al., 2006; Vinh-Hung et al., 2009; Yang et al., 2017).

Remarkably, the WHO classification of breast tumors and AJCC demonstrated that patients with apical or infraclavicular/ipsilateral supraclavicular lymph node metastasis should be classified into the pN3 stage according to the traditional pN staging system, regardless of the status of lower-level metastatic lymph nodes, which were considered to exhibit a poor prognosis (Güven et al., 2007; Mary et al., 2009; Shalaka et al., 2019). Until now, reports on LNR in breast cancer from different research groups did not focus on the impact of APN(+) on the LNR system (Vinh-Hung et al., 2009; Kim et al., 2011; Duraker et al., 2013; Wu et al., 2013).

In order to illustrate the role of APN(+) in the LNR system and obtain the most precise LNR, we collected data on 10,120 patients diagnosed with breast cancer from 2007 to 2012 in our hospital (Tianjin Medical University Cancer Institute and Hospital). A total of 3,936 patients had positive lymph nodes, including 3,283 APN(−) and 653 APN(+) patients. We found that APN(+) patients had a significantly worse prognosis than APN(−) breast cancer patients in the same group according to previously reported LNR, indicating that APN(+) patients should be excluded in the application of the LNR system to predict prognosis. Then, we applied X-tile analysis to the data on the cohort of APN(−) patients to calculate two cut-off values (0.15 and 0.34) based on overall survival of these patients and defined the group as LNR-APN(−). Survival analysis further revealed that LNR-APN(−) staging was superior to pN staging in predicting the prognosis of APN(−) breast cancer patients.

Materials and Methods

Ethical Statement and Patient Selection

A total of 10,120 patients were diagnosed with breast cancer, including 6,184 patients with negative axillary lymph nodes and 3,936 patients with positive axillary lymph nodes, from January 2007 to December 2012 according to data from the archives of the Department of Breast Cancer Pathology and Research Laboratory, Tianjin Medical University Cancer Institute and Hospital. Patients with positive lymph nodes were further classified into APN(−) (3,283 patients) and APN(+) (653 patients). This study was approved by the Institutional Ethics Committee of Tianjin Medical University Cancer Institute and Hospital (bc2017019), and each participant signed an informed consent document.

All patients who underwent axillary lymph node dissection and received radical mastectomy or modified radical mastectomy were selected. Surgical specimens were then prepared for histological analysis: the specimens were fixed in 10% formaldehyde, and 2-µm sections were taken every 1.5 mm. Two experienced pathologists evaluated the status of the lymph nodes based on the World Health Organization histological classification of breast tumors. Metastatic nests >0.2 mm in diameter were scored as lymph node-positive metastases. After surgery, all patients were administered adjuvant chemotherapy and/or radiotherapy and/or endocrine therapy according to the National Comprehensive Cancer Network (NCCN) guidelines. Patients with multisource tumor, bilateral breast cancer, and loss to follow-up were excluded. We defined loss of follow-up as patients lost to follow up after being discharged from the hospital. Lumpectomy is the common treatment for early-stage breast cancer; most of these patients who underwent sentinel lymph node biopsy (SLNB) usually have a small number of lymph nodes. So, patients who received lumpectomy were excluded from the study. Information recorded for each patient included age at diagnosis, year of surgery, histologic features of the tumor, lymph node status, and survival. The median follow-up period was 81 (range 1–149) months.

Cut-Off Values of LNR-APN(−) Staging

Positive lymph nodes identified on histopathological examination were classified according to the eighth edition of the AJCC staging system into three stages: pN1 (one to three positive lymph nodes), pN2 (four to nine positive lymph nodes), and pN3 (more than nine positive lymph nodes and at least one positive apical or infraclavicular/ipsilateral supraclavicular lymph node). LNR was calculated by the number of positive lymph nodes/total lymph nodes examined in node-positive patients. We excluded APN(+) breast cancer patients and obtained the optimal cut-off values of LNR-APN(−) staging by using the X-tile plots (X-tile software 3.6.1, Yale University, New Haven, CT, United States) in terms of overall survival. X-tile is a bioinformatics tool for biomarker assessment and outcome-based cut-point optimization (Robert et al., 2004). The X-tile plot shows the robustness of the relationship between LNR-APN(−) and patient outcome via construction of a two-dimensional projection of every possible subpopulation. Chi-square values were calculated for every possible division of LNR-APN(−), and the program selected the optimal division of LNR-APN (−) by choosing the highest chi-square value. The interval between the given set of divisions was 0.01. Therefore, the X-tile program divided the entire cohort into three subgroups based on the ratio of positive lymph nodes, which were LNR1-APN(−) (<0.15), LNR2-APN(−) (0.15–0.34), and LNR3-APN(−) (>0.34).

SEER Database

We collected information on female breast cancer patients diagnosed between 1 January 2010 and 31 December 2012 from the SEER (Surveillance, Epidemiology, and End Results) database. Patients diagnosed with breast cancer before 2010 were excluded from this study because of unavailability of HER2 data. A total of 10,163 patients who met the following criteria were included: breast cancer as the primary cancer, unilateral breast cancer, received radical mastectomy or modified radical mastectomy, one or more involved lymph nodes, one or more positive lymph nodes, and known tumor size.

Statistical Analysis

Overall survival (OS) and disease-free survival (DFS) were the main endpoints of this trial. The follow-up interval for OS and DFS was calculated in months. OS was defined as the time between the date of diagnosis and the date of death from any cause or the date of last follow-up. DFS was defined as the time from the date of diagnosis to the date of the first locoregional recurrence or/and distant metastasis, or the last follow-up date. OS and DFS curves were estimated using the Kaplan–Meier method and compared by the log-rank test, and the chi-square test was used to compare differences between groups. The independent prognostic effect of LNR-APN(−) was investigated using the Cox regression analysis, adjusting for age at diagnosis, histological grade, pT stage, and pN stage. Hazard ratios (HRs) along with 95% confidence intervals (95% CIs) were calculated. Two-tailed p values of less than 0.05 were considered to be statistically significant. All statistical analyses were performed using the SPSS version 26.0 software package for Windows (IBM SPSS Statistics, Chicago, IL, United States).

Results

Patients and Characteristics

The graphical abstract is shown in Figure 1. A total of 10,120 patients were diagnosed with breast cancer from 2007 to 2012 in Tianjin Medical University Cancer Institute and Hospital, and the clinicopathologic characteristics of the breast cancer patients are summarized in Table 1. Of the 10,120 breast cancer patients, 6,184 (61.1%) and 3,936 (38.9%) patients were node-negative and node-positive, respectively. The mean number of dissected lymph nodes was 23.1. Based on the eighth edition of the AJCC staging system, 2,213 patients were classified as pN1 (21.9%), 804 patients as pN2 (7.9%), and 919 patients as pN3 (9.1%). The median follow-up time for all 10,120 patients was 81 (range 1–149) months. We also present the detailed description of abbreviations in Supplementary Table S1.

FIGURE 1

FIGURE 1. Graphical abstract of the lymph node ratio system.

TABLE 1

TABLE 1. Clinicopathologic characteristics of breast cancer patients in the TCIH database (n = 10,120).

Some APN(+) Patients With Poor Prognosis Were Mis-Subgrouped Into Low LNR Stage Using the LNR System

We applied the Kaplan–Meier survival analysis to our cohort based on the representative previously reported LNR (cut-off values: 0.2 and 0.65) (Vinh-Hung et al., 2009; Wu et al., 2013; Wu et al., 2015; Quintyne et al., 2017) and found that there was a significant difference in survival among different groups (p < 0.0001, Figure 2A). In the subgroup analysis, APN(+) patients were found to have a significantly worse prognosis than APN(−) patients in the LNR1 (LNR ≤ 0.2) and LNR2 (LNR 0.21–0.65) groups (p < 0.05, Figures 2B,C). In the LNR3 (LNR > 0.65) group, there was no difference in OS between APN(+) and APN(−) breast cancer patients, but a significant difference was noted in DFS, considering the poor prognosis within this group (Figure 2D). These results indicated that some APN(+) patients have been mis-subgrouped using the LNR system.

FIGURE 2

FIGURE 2. Some APN(+) patients with poor prognosis were mis-subgrouped in the low LNR stage using the LNR system. (A) Kaplan–Meier analysis in our breast cancer cohort according to previously reported LNR (n = 3,936). (B) Comparison of Kaplan–Meier curves of APN(−) and APN(+) breast cancer patients based on previously reported LNR ≤ 0.2 (n = 2,473, OS: p = 0.010, DFS: p = 0.029). (C) Comparison of Kaplan–Meier curves of APN(−) and APN(+) breast cancer patients based on previously reported LNR 0.21–0.65 (n = 1,051, OS: p < 0.0001, DFS: p < 0.0001). (D) Comparison of Kaplan–Meier curves of APN(−) and APN(+) breast cancer patients based on previously reported LNR > 0.65 (n = 412, DFS: p = 0.024).

Identification of the Optimal Cut-Off Values (0.15 and 0.34) for LNR-APN(−) Staging by X-Tile Analysis in APN(−) Patients With Positive Lymph Nodes Among 10,120 Breast Cancer Patients

In order to obtain the precise LNR, we focused on 3,283 APN(−) patients with positive lymph nodes from the 10,120 breast cancer patients and applied X-tile analysis to calculate two cut-off values (0.15 and 0.34) based on the OS of these patients (Figures 3A–C).

FIGURE 3

FIGURE 3. Identification of the optimal cut-off values (0.15 and 0.34) for LNR-APN(−) by X-tile analysis in APN(−) patients with positive lymph nodes among 10,120 breast cancer patients. (A) Red indicates a negative association. X-axis demonstrates all potential cut-off values from low to high (left to right), defined as larger low population. Y-axis demonstrates cut-off values from high to low (top to bottom), defined as larger high population. (B) Histogram of the entire cohort divided into three subgroups according to the optimal cut-off values of 0.15 and 0.34. (C) Kaplan–Meier curves showing the division of overall survival according to the cut-off values of 0.15 and 0.34 (n = 3,283, p < 0.0001).

LNR-APN(−) Staging Could Accurately Predict the Prognosis of APN(−) Breast Cancer Patients

The APN(−) breast cancer patients were classified into three groups based on the cut-off values and defined as LNR1-APN(−) (LNR > 0 and <0.15; n = 2015), LNR2-APN(−) (LNR ≥ 0.15 and ≤0.34; n = 836), and LNR3-APN(−) (LNR > 0.34; n = 432), which represented 52.1%, 24.0%, and 23.9% of patients in this study cohort, respectively. The groups categorized by LNR-APN(−) yielded a significant difference between the OS and DFS curves (p < 0.0001, Figure 4A). Consequently, LNR-APN(−) staging could predict the prognosis of breast cancer patients accurately.

FIGURE 4

FIGURE 4. LNR-APN(−) could accurately predict the prognosis of APN(−) breast cancer patients. Kaplan–Meier analysis of (A) LNR-APN(−) breast cancer patients (n = 3,283), (B) pN1-LNR-APN(−) breast cancer patients (n = 2,213), (C) pN2-LNR-APN(−) breast cancer patients (n = 804), and (D) pN3-LNR-APN(−) breast cancer patients (n = 266).

Next, we divided pN1 breast cancer patients (n = 2,213) into three groups, namely, pN1-LNR1-APN(−), pN1-LNR2-APN(−), and pN1-LNR3-APN(−); pN2 breast cancer patients (n = 804) into pN2-LNR1-APN(−), pN2-LNR2-APN(−), and pN2-LNR3-APN(−); and pN3 breast cancer patients (n = 266) into pN3-LNR2-APN(−) and pN3-LNR3-APN(−). Survival analysis between different subgroups revealed that the pN1-LNR2-APN(−) and pN1-LNR3-APN(−) groups had a significantly worse prognosis than pN1-LNR1-APN(−) (p < 0.05, Figure 4B), and the pN2-LNR1-APN(−) group had a significantly better prognosis than the pN2-LNR2-APN(−) and pN2-LNR3-APN(−) groups (p < 0.05, Figure 4C). Moreover, pN1-LNR2-APN(−) and pN1-LNR3-APN(−) patients had a significantly worse prognosis than patients with pN1 stage, and pN2-LNR1-APN(−) patients had a better prognosis than patients with pN2 stage; however, there was no significant difference between LNR3-APN(−) and pN3 groups (Figure 4D; Supplementary Figure S1).

Multivariate analysis revealed LNR-APN(−) to be a better prognostic predictor of OS than pN-APN(−) in breast cancer by using the Cox proportional hazard regression model (p < 0.05). LNR2,3-APN(−) (LNR2-APN(−) and LNR3-APN(−)) breast cancer patients had a significantly worse OS than LNR1-APN (−) patients (HR = 1.843, p < 0.0001, Table 2).

TABLE 2

TABLE 2. Overall survival multivariable analysis of APN(−) patients among 10,120 breast cancer patients.

Verify the Accuracy of the LNR-APN(−) System Using the SEER Database

To further verify the accuracy of the LNR-APN(−) system in different clinical databases, we fixed our attention on the SEER database, which comprised 10,163 breast cancer patients. The clinicopathologic characteristics of the breast cancer patients are summarized in Supplementary Table S2. As information on the pathological features of the lymph nodes was unavailable in the SEER database, pN3 patients were excluded from further analysis. As expected, the groups categorized by LNR-APN(−) yielded a significant difference between the OS curves (p < 0.0001, Figure 5A). Moreover, pN1-LNR2-APN(−) and pN1-LNR3-APN(−) patients had a significantly worse prognosis than pN1-LNR1-APN(−) patients (p < 0.05, Figure 5B); pN2-LNR1-APN(−) and pN2-LNR2-APN(−) patients had a better prognosis than pN2-LNR3-APN(−) patients (p < 0.05, Figure 5C). The aforementioned results indicate that LNR-APN(−) could predict the prognosis of patients included in the SEER database.

FIGURE 5

FIGURE 5. LNR-APN(−) could accurately predict the prognosis of pN1 and pN2 stage breast cancer patients in the SEER database. Kaplan–Meier analysis of (A) LNR-APN(−) breast cancer patients (n = 8,380), (B) pN1-LNR-APN(−) breast cancer patients (n = 5,846), and (C) pN2-LNR-APN(−) breast cancer patients (n = 2,534).

Neither the Published Cut-Off Values (0.2 and 0.65) nor Our Cut-Off Values (0.15 and 0.34) Could Accurately Predict the Prognosis of APN(+) Patients

We applied both the published cut-off values (0.2 and 0.65) and our cut-off values (0.15 and 0.34) to APN(+) patients, and the results indicated that none of them could accurately predict the prognosis of APN(+) patients. In the previously published system (0.2 and 0.65), there was no statistical difference in OS or DFS between LNR1-APN(+) and LNR2-APN(−) patients (OS: p = 0.842, DFS: p = 0.921) and between LNR2-APN(+) and LNR3-APN(−) patients (OS: p = 0.085, DFS: p = 0.636) (Figures 6A,B). There was also no difference in OS or DFS between LNR1-APN(+) and LNR2-APN(−) (OS: p = 0.402, DFS: p = 0.351) or LNR2-APN(+) patients (OS: p = 0.484, DFS: p = 0.955) in our system (0.15 and 0.34) (Figures 6C,D).

FIGURE 6

FIGURE 6. Neither the published cut-off values (0.2 and 0.65) (A,B) nor our cut-off values (0.15 and 0.34) (C,D) could accurately predict the prognosis of APN(+) patients.

Discussion

The current AJCC-TNM staging system classifies the pN stage based on only the number of positive lymph nodes. Over the past decades, increasing studies have suggested that the LNR system could be an accurate prognostic indicator in breast cancer, and LNR could be considered as an alternative to pN staging (Ahn et al., 2011; Ataseven et al., 2015; Chen et al., 2015; Solak et al., 2015; Cho et al., 2018). However, the AJCC-TNM staging system classified APN(+) breast cancer patients with a worse prognosis into the pN3 stage regardless of the lower-level lymph node metastasis state (Greene, 2002; Singletary et al., 2002). This point indicated a possibility that pN3-APN(+) patients with a small number of positive lymph nodes could be misclassified as low LNR stage. Until now, reports on LNR in breast cancer from different research groups have not mentioned this possibility using the LNR system (Dings et al., 2013; Yu et al., 2015; He et al., 2017; Ayşegül and Mehmet, 2020). Our results indicated that APN(+) patients had a significantly worse prognosis than APN(−) patients in the LNR1 (LNR ≤ 0.2) and LNR2 (LNR 0.21–0.65) groups, which strongly suggests that APN(+) patients should be excluded in the LNR system. In our study, we focused on 3,283 APN(−) patients with positive lymph nodes from among 10,120 breast cancer patients and applied X-tile analysis to calculate two cut-off values (0.15 and 0.34) based on the OS of these patients. Using these cut-off values, we classified our patients into LNR1-APN(−) (LNR > 0 and <0.15), LNR2-APN(−) (LNR ≥ 0.15 and ≤0.34), and LNR3-APN(−) (LNR > 0.34). We found that the LNR-APN(−) system could distinguish pN1-LNR2-APN(−) and pN1-LNR3-APN(−) patients with a significantly worse prognosis from pN1-LNR1-APN(−) patients to avoid inadequate treatment and could also distinguish pN2-LNR1-APN(−) patients with a significantly better prognosis from pN2-LNR2-APN(−) patients to avoid overtreatment, but had no role in identifying pN3 and LNR3-APN(−) patients. The study by Yu et al. (2015) suggested that LNR could be a significant prognostic factor in pN3 breast cancer patients. However, the study did not consider pN3 patients with or without APN(+) and did not compare the prognosis of subgroups of pN3 patients categorized by LNR with that of pN1 and pN2 patients. Therefore, the authors could not find the difference in the prognosis of subgroups of pN3 patients distinguished by LNR from that of pN1 and pN2 patients.

In our study, we applied the LNR system to APN(+) patients and compared their prognosis with that of other patients, and the results indicated neither the published cut-off values (0.2 and 0.65) nor our cut-off values (0.15 and 0.34) can accurately predict the prognosis of APN(+) patients. Despite the ethnic heterogeneity, the prognostic effect of LNR-APN (−) was successfully validated in another independent cohort from the SEER database. Due to the unavailability of data on the pathological features of the lymph nodes in the SEER database, pN3 patients were excluded from further analysis in this study. These results indicated that the LNR-APN(−) system could predict the prognosis of APN(−) patients accurately, and it may be a more comprehensive and valuable supplement to the previously reported LNR (Oven Ustaalioglu et al., 2010; Vinh-Hung et al., 2010; Xiao et al., 2013; Tonellotto et al., 2019). In the future, a comprehensive consideration of LNR and N staging may be a better choice when clinicians evaluate lymph node status in breast cancer patients.

Our cohort size of 10,120 breast cancer patients including 3,936 patients with positive lymph nodes, which comprise 3,283 APN(−) patients, is a large sample size, much larger than the sample size in comparable reports (Vinh-Hung et al., 2009; Danko et al., 2010; Li et al., 2012; Saxena et al., 2012; Liao et al., 2015), which makes our analysis more credible and representative. Moreover, uniform pathologic examination of the lymph node samples by a single institution ensures that similar surgical and pathologic procedures were performed. An additional advantage is a longer follow-up duration with a median of 81 months, which suggests that our data have a greater ability to predict the prognostic value of the variables being studied (Wang et al., 2012; Kim et al., 2016; Tsai et al., 2016; Wang et al., 2017). However, the retrospective nature of this study could have introduced bias in terms of patient and treatment selection. For this retrospective study to be meaningful, the baseline of patients such as sex, age, basic disease, and treatment cannot be considered. Individual differences exist objectively in any research and cannot be overcome one by one. It is an inherent disadvantage faced by any research. The way to minimize errors caused by treatment is to increase the sample size. Our study applied a breast cancer cohort of 10,120, which is a very large cohort size, even reaching the top of the international level. The cohort is large enough to ignore the errors caused by treatment. In addition, statistical analysis based on the Cox proportional hazards model showed that sample size has a significant impact on the results. To solve this problem, we should try more statistical methods or apply our cut-off values to another database for further validation.

Conclusion

Our present study revealed that excluding APN(+) patients is the most necessary supplement to LNR and that LNR-APN(−) staging should be a more comprehensive approach in predicting prognosis and guiding clinicians to provide accurate and appropriate treatment.

Data Availability Statement

The raw data supporting the conclusion of this article will be made available by the authors, without undue reservation.

Ethics Statement

The studies involving human participants were reviewed and approved by the Institutional Ethics Committee of Tianjin Medical University Cancer Institute and Hospital. The patients/participants provided their written informed consent to participate in this study.

Author Contributions

FG and YM had full access to all the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis. Study concept and design: FG and YM. Acquisition, analysis, and interpretation of data: FG, LF, ZW, WC, HZ, XL, YZ, and ZG. Drafting of the manuscript: ZW and WC. Critical revision of the manuscript for important intellectual content: FG and YM. Statistical analysis: FG, ZW, and WC. Administrative, technical, and material support: FG and YM. Study supervision: FG and YM.

Funding

This work was supported grants from the National Scientific Foundation of China to FG (No. 82173323) and to YM (No. 82172987).

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors, and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Acknowledgments

We thank the patients who participated in this study, their families, and the staff members at the study sites who cared for them.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fcell.2022.784920/full#supplementary-material

Supplementary Figure S1 | LNR-APN(−) could predict the prognosis of breast cancer patients more accurately than pN staging. Kaplan–Meier analysis of (A) LNR-APN(−) breast cancer patients (n = 3283), (B) pN1-LNR-APN(−) breast cancer patients (n = 2213), (C) pN2-LNR-APN(−) breast cancer patients (n = 804), and (D) pN3-LNR-APN(−) breast cancer patients (n = 266).

References

Ahn, S. H., Kim, H. J., Lee, J. W., Gong, G.-Y., Noh, D.-Y., Yang, J. H., et al. (2011). Lymph Node Ratio and pN Staging in Patients with Node-Positive Breast Cancer: a Report from the Korean Breast Cancer Society. Breast Cancer Res. Treat. 130, 507–515. doi:10.1007/s10549-011-1730-9

PubMed Abstract | CrossRef Full Text | Google Scholar

Ataseven, B., Kümmel, S., Weikel, W., Heitz, F., Holtschmidt, J., Lorenz-Salehi, F., et al. (2015). Additional Prognostic Value of Lymph Node Ratio over pN Staging in Different Breast Cancer Subtypes Based on the Results of 1,656 Patients. Arch. Gynecol. Obstet. 291, 1153–1166. doi:10.1007/s00404-014-3528-6

PubMed Abstract | CrossRef Full Text | Google Scholar

Ayşegül, S., and Mehmet, N. A. (2020). Lymph Node Ratio Predicts Long-Term Survival in Lymph Node-Positive Breast Cancer. Eur. J. Breast Health 16 (4), 270–275. doi:10.2450/2020.0011-20

PubMed Abstract | CrossRef Full Text | Google Scholar

Chen, Y.-L., Wang, C.-Y., Wu, C.-C., Lee, M.-S., Hung, S.-K., Chen, W.-C., et al. (2015). Prognostic Influences of Lymph Node Ratio in Major Cancers of Taiwan: a Longitudinal Study from a Single Cancer center. J. Cancer Res. Clin. Oncol. 141, 333–343. doi:10.1007/s00432-014-1810-4

PubMed Abstract | CrossRef Full Text | Google Scholar

Cho, D. H., Bae, S. Y., You, J. Y., Kim, H. K., Chang, Y. W., Choi, Y. J., et al. (2018). Lymph Node Ratio as an Alternative to pN Staging for Predicting Prognosis after Neoadjuvant Chemotherapy in Breast Cancer. Kaohsiung J. Med. Sci. 34, 341–347. doi:10.1016/j.kjms.2017.12.015

PubMed Abstract | CrossRef Full Text | Google Scholar

Danko, M. E., Bennett, K. M., Zhai, J., Marks, J. R., and Olson, J. A. (2010). Improved Staging in Node-Positive Breast Cancer Patients Using Lymph Node Ratio: Results in 1,788 Patients with Long-Term Follow-Up. J. Am. Coll. Surgeons 210, 797–805. doi:10.1016/j.jamcollsurg.2010.02.045

CrossRef Full Text | Google Scholar

Dings, P. J. M., Elferink, M. A. G., Strobbe, L. J. A., and de Wilt, J. H. W. (2013). The Prognostic Value of Lymph Node Ratio in Node-Positive Breast Cancer: a Dutch Nationwide Population-Based Study. Ann. Surg. Oncol. 20, 2607–2614. doi:10.1245/s10434-013-2932-7

PubMed Abstract | CrossRef Full Text | Google Scholar

Duraker, N., Batı, B., Çaynak, Z. C., and Demir, D. (2013). Lymph Node Ratio May Be Supplementary to TNM Nodal Classification in Node-Positive Breast Carcinoma Based on the Results of 2,151 Patients. World J. Surg. 37, 1241–1248. doi:10.1007/s00268-013-1965-1

PubMed Abstract | CrossRef Full Text | Google Scholar

Greene, F. L. (2002). AJCC Cancer Staging Handbook : From the AJCC Cancer Staging Manual. 6th ed. New York: American Cancer Society Springer. American Joint Committee on Cancer

Google Scholar

Güven, H. E., Bulak, H., Turanli, S., and Oral, S. (2007). Clinical Importance of Preoperative Detection of the Apical Lymph Node Metastasis in Patients with Breast Carcinoma. Singapore Med. J. 48, 31–33.

PubMed Abstract | Google Scholar

He, M., Zhang, J.-X., Jiang, Y.-Z., Chen, Y.-L., Yang, H.-Y., Tang, L.-C., et al. (2017). The Lymph Node Ratio as an Independent Prognostic Factor for Node-Positive Triple-Negative Breast Cancer. Oncotarget 8, 44870–44880. doi:10.18632/oncotarget.17413

PubMed Abstract | CrossRef Full Text | Google Scholar

Kim, J.-Y., Ryu, M.-R., Choi, B.-O., Park, W.-C., Oh, S. J., Won, J.-M., et al. (2011). The Prognostic Significance of the Lymph Node Ratio in Axillary Lymph Node Positive Breast Cancer. J. Breast Cancer 14, 204–212. doi:10.4048/jbc.2011.14.3.204

PubMed Abstract | CrossRef Full Text | Google Scholar

Kim, S. H., Jung, K. H., Kim, T.-Y., Im, S.-A., Choi, I. S., Chae, Y. S., et al. (2016). Prognostic Value of Axillary Nodal Ratio after Neoadjuvant Chemotherapy of Doxorubicin/Cyclophosphamide Followed by Docetaxel in Breast Cancer: A Multicenter Retrospective Cohort Study. Cancer Res. Treat. 48, 1373–1381. doi:10.4143/crt.2015.475

PubMed Abstract | CrossRef Full Text | Google Scholar

Li, Y., Holmes, E., Shah, K., Albuquerque, K., Szpaderska, A., and Erşahin, C. (2012). The Prognostic Value of Lymph Node Cross-Sectional Cancer Area in Node-Positive Breast Cancer: a Comparison with N Stage and Lymph Node Ratio. Patholog Res. Int. 2012, 161964. doi:10.1155/2012/161964

PubMed Abstract | CrossRef Full Text | Google Scholar

Liao, G.-S., Chou, Y.-C., Golshan, M., Hsu, H.-M., Hong, Z.-J., Yu, J.-C., et al. (2015). Prognostic Value of the Lymph Node Ratio in Breast Cancer Subtypes. Am. J. Surg. 210, 749–754. doi:10.1016/j.amjsurg.2014.12.054

PubMed Abstract | CrossRef Full Text | Google Scholar

Mary, F. D., Vriti, A., Catherine, M., Christina, O., Cecily, M. Q., Niall, O., et al. (2009). The Value of Level III Clearance in Patients with Axillary and sentinel Node Positive Breast Cancer. Ann. Surg. 249 (5), 834–839. doi:10.1097/SLA.0b013e3181a40821

PubMed Abstract | CrossRef Full Text | Google Scholar

Oven Ustaalioglu, B. B., Bilici, A., Kefeli, U., Şeker, M., Yildirim, E., Salepci, T., et al. (2010). Does the Metastatic Lymph Node Ratio Influence the Disease-free Survival of Patients with Breast Cancer: Single-Center Experiences. Oncology 79, 105–111. doi:10.1159/000320162

PubMed Abstract | CrossRef Full Text | Google Scholar

Quintyne, K. I., Woulfe, B., Coffey, J. C., Merrigan, A., and Gupta, R. K. (2017). Lymph Node Ratio in Sentinel Lymph Node Biopsy Era: Are We Losing Prognostic Information? Clin. Breast Cancer 17, 117–126. doi:10.1016/j.clbc.2016.07.011

PubMed Abstract | CrossRef Full Text | Google Scholar

Robert, L. C., Marisa, D. F., and David, L. R. (2004). X-tile: A New Bio-Informatics Tool for Biomarker Assessment and Outcome-Based Cut-point Optimization. Clin. Cancer Res. 10 (21), 7252–7259. doi:10.1158/1078-0432.CCR-04-0713

PubMed Abstract | CrossRef Full Text | Google Scholar

Saxena, N., Hartman, M., Yip, C.-H., Bhoo-Pathy, N., Khin, L. W., Taib, N. A., et al. (2012). Does the Axillary Lymph Node Ratio Have Any Added Prognostic Value over pN Staging for South East Asian Breast Cancer Patients? PLoS One 7, e45809. doi:10.1371/journal.pone.0045809

PubMed Abstract | CrossRef Full Text | Google Scholar

Shalaka, J., Jarin, N., Rohini, H., Girish, K., Vaibhav, V., Vani, P., et al. (2019). Merits of Level III Axillary Dissection in Node-Positive Breast Cancer: A Prospective, Single-Institution Study from India. J. Glob. Oncol. 5, 1–8. doi:10.1200/JGO.18.00165

CrossRef Full Text | Google Scholar

Singletary, S. E., Allred, C., Ashley, P., Bassett, L. W., Berry, D., Bland, K. I., et al. (2002). Revision of the American Joint Committee on Cancer Staging System for Breast Cancer. Jco 20, 3628–3636. doi:10.1200/jco.2002.02.026

PubMed Abstract | CrossRef Full Text | Google Scholar

Solak, M., Turkoz, F. P., Keskin, O., Aksoy, S., Babacan, T., Sarici, F., et al. (2015). The Lymph Node Ratio as an Independent Prognostic Factor for Non-metastatic Node-Positive Breast Cancer Recurrence and Mortality. J. Buon 20, 737–745.

PubMed Abstract | Google Scholar

Tonellotto, F., Bergmann, A., Bergmann, A., Abrahao, K. d. S., Sales de Aguiar, S., Adeodato Bello, M., et al. (2019). Impact of Number of Positive Lymph Nodes and Lymph Node Ratio on Survival of Women with Node-Positive Breast Cancer. Eur. J. Breast Health 15, 76–84. doi:10.5152/ejbh.2019.4414

PubMed Abstract | CrossRef Full Text | Google Scholar

Tsai, J., Bertoni, D., Hernandez-Boussard, T., Telli, M. L., and Wapnir, I. L. (2016). Lymph Node Ratio Analysis after Neoadjuvant Chemotherapy Is Prognostic in Hormone Receptor-Positive and Triple-Negative Breast Cancer. Ann. Surg. Oncol. 23, 3310–3316. doi:10.1245/s10434-016-5319-8

PubMed Abstract | CrossRef Full Text | Google Scholar

Vinh-Hung, V., Joseph, S. A., Coutty, N., Ly, B. H., Vlastos, G., and Nguyen, N. P. (2010). Age and Axillary Lymph Node Ratio in Postmenopausal Women with T1-T2 Node Positive Breast Cancer. Oncologist 15, 1050–1062. doi:10.1634/theoncologist.2010-0044

PubMed Abstract | CrossRef Full Text | Google Scholar

Vinh-Hung, V., Verkooijen, H. M., Fioretta, G., Neyroud-Caspar, I., Rapiti, E., Vlastos, G., et al. (2009). Lymph Node Ratio as an Alternative to pN Staging in Node-Positive Breast Cancer. Jco 27, 1062–1068. doi:10.1200/jco.2008.18.6965

CrossRef Full Text | Google Scholar

Wang, F., He, W., Qiu, H., Wang, X., Guo, G., Chen, X., et al. (2012). Lymph Node Ratio and pN Staging Show Different Superiority as Prognostic Predictors Depending on the Number of Lymph Nodes Dissected in Chinese Patients with Luminal A Breast Cancer. Clin. Breast Cancer 12, 404–411. doi:10.1016/j.clbc.2012.07.009

PubMed Abstract | CrossRef Full Text | Google Scholar

Wang, Q. X., Cai, Y. F., Chen, Y. Y., Zhang, W., Jin, W. X., Chen, E. D., et al. (2017). Additional Prognostic Value of Lymph Node Ratio (LNR) and Number of Negative Lymph Nodes (NLNs) in Chinese Patients with Triple Negative Breast Cancer. Ann. Clin. Lab. Sci. 47, 68–75.

PubMed Abstract | Google Scholar

Woodward, W. A., Vinh-Hung, V., Ueno, N. T., Cheng, Y. C., Royce, M., Tai, P., et al. (2006). Prognostic Value of Nodal Ratios in Node-Positive Breast Cancer. Jco 24, 2910–2916. doi:10.1200/jco.2005.03.1526

CrossRef Full Text | Google Scholar

Wu, S.-G., He, Z.-Y., Li, Q., Sun, J.-Y., Li, F.-Y., Lin, Q., et al. (2013). Prognostic Value of Metastatic Axillary Lymph Node Ratio for Chinese Breast Cancer Patients. PLoS One 8, e61410. doi:10.1371/journal.pone.0061410

PubMed Abstract | CrossRef Full Text | Google Scholar

Wu, S. G., Li, Q., Zhou, J., Sun, J. Y., Li, F. Y., Lin, Q., et al. (2015). Using the Lymph Node Ratio to Evaluate the Prognosis of Stage II/III Breast Cancer Patients Who Received Neoadjuvant Chemotherapy and Mastectomy. Cancer Res. Treat. 47, 757–764. doi:10.4143/crt.2014.039

PubMed Abstract | CrossRef Full Text | Google Scholar

Xiao, X.-S., Tang, H.-L., Xie, X.-H., Li, L.-S., Kong, Y.-N., Wu, M.-Q., et al. (2013). Metastatic Axillary Lymph Node Ratio (LNR) Is Prognostically Superior to pN Staging in Patients with Breast Cancer -- Results for 804 Chinese Patients from a Single Institution. Asian Pac. J. Cancer Prev. 14, 5219–5223. doi:10.7314/apjcp.2013.14.9.5219

PubMed Abstract | CrossRef Full Text | Google Scholar

Yang, J., Long, Q., Li, H., Lv, Q., Tan, Q., and Yang, X. (2017). The Value of Positive Lymph Nodes Ratio Combined with Negative Lymph Node Count in Prediction of Breast Cancer Survival. J. Thorac. Dis. 9, 1531–1537. doi:10.21037/jtd.2017.05.30

PubMed Abstract | CrossRef Full Text | Google Scholar

Yu, J. I., Park, W., Choi, D. H., Huh, S. J., Nam, S. J., Kim, S. W., et al. (2015). Clinical Outcomes and Prognostic Factors of Pathologic N3 Breast Cancer Treated with Modern Standard Treatments. Clin. Breast Cancer 15 (6), 512–518. doi:10.1016/j.clbc.2015.06.004

PubMed Abstract | CrossRef Full Text | Google Scholar