Shilong Zhang
Xin Wang3- 1Minhang Hospital, Fudan University, Shanghai, China
- 2Institute of Fudan-Minhang Academic Health System, Minhang Hospital, Fudan University, Shanghai, China
- 3Department of Acupuncture and Moxibustion, Central Hospital of Shanghai Xuhui District, Shanghai, China
- 4Faculty of Physical Education, Shandong Normal University, Jinan, China
Background: Metastatic cervical cancer (mCEC) is the end stage of cervical cancer. This study aimed to establish and validate a nomogram to predict the overall survival (OS) of mCEC patients.
Methods: We investigated the Surveillance, Epidemiology, and End Results (SEER) database for mCEC patients diagnosed between 2010 and 2014. Univariate and multivariable Cox analyses was performed to select the clinically important predictors of OS when developing the nomogram. The performance of nomogram was validated with Harrell's concordance index (C-index), calibration curves, receiver operating characteristic curve (ROC), and decision curve analysis (DCA).
Results: One thousand two hundred and fifty-two mCEC patients were included and were divided into training (n = 880) and independent validation (n = 372) cohorts. Age, race, pathological type, histology grade, radiotherapy, and chemotherapy were independent predictors of OS and used to develop the nomogram for predicting 1- and 3-year OS. This nomogram had a C-index of 0.753 (95% confidence interval [CI]: 0.780–0.726) and 0.751 (95% CI: 0.794–0.708) in the training and the validation cohorts, respectively. Internal and external calibration curves indicated satisfactory agreement between nomogram prediction and actual survival, and DCA indicated its clinical usefulness. Furthermore, a risk stratification system was established that was able to accurately stratify mCEC patients into three risk subgroups with significantly different prognosis.
Conclusions: We constructed the first nomogram and corresponding risk classification system to predict the OS of mCEC patients. These tools showed satisfactory accuracy, and clinical utility, and could aid in patient counseling and individualized clinical decision-making.
Introduction
Worldwide, cervical cancer is the third most common malignant tumor and the fourth leading cause of cancer-related mortality in the female population (1). About 30% of cervical cancer patients present with distant metastasis at initial diagnosis, especially in developing countries (2). Despite considerable advances in the treatment, patients with distant metastasis suffer dismal prognosis, with a median survival of 8–13 months (3). Actually, metastatic cervical cancer (mCEC) is a heterogeneous disease and varies substantially in prognosis (4). The survival for mCEC is influenced by multiple factors, including age, pathological type, metastasis pattern, and treatment strategy (5, 6). Therefore, an accurate prediction of survival may benefit mCEC patients and professional doctors alike in all aspects of clinical decision-making, and render individualized treatment and surveillance possible.
Nomogram is a simple, multivariate visualization tool used in oncology to predict and quantify the survival probability of an individual patient (7). Compared to the current TNM staging system, the nomograms focuses on the individualized prognosis, and have great value in risk classification, personalized clinical management, and even clinical trial design. However, to our knowledge, almost all of the available nomograms of cervical cancer are designed for patients with localized disease, and a nomogram specifically designed for mCEC patients does not exist. Therefore, in this study we aimed to establish a prognostic nomogram and risk stratification system for mCEC patients based on the data available in the Surveillance, Epidemiology, and End Results (SEER) database, a U.S. population-based cancer database that collects the data about cancer patients from 18 registries of the U.S. and covers more than 30% of the U.S. population.
Materials and Methods
Patients
Information of patients initially diagnosed with mCEC between 2010 and 2014 was extracted from the SEER-18 database using SEER*Stat software version 8.3.5. We limited our analysis to the period of 2010–2014 as the information about site-specific metastasis is only available from 2010 and onward in the SEER database. The eligible mCEC patients included in our study were those who had only one primary malignancy; active follow-up with complete date; and complete clinicopathological information (age, race, FIGO stage, tumor grade, therapy, etc.). Since the patient information in the SEER database is de-identified and publicly available, our study was exempted from institutional review board oversight.
Variables for each patient included age, race, TNM status, pathological subtype, histology grade, T stage, N stage, distant metastatic site, treatment strategy, vital status, and survival time. In our study, TNM status was restaged according to the FIGO classification (2018 version). The distant metastasis site at diagnosis was classified as lymph node, liver, lung, bone, and brain. Surgery or radiotherapy referred to the local treatment for primary tumor. The primary endpoint of this study was overall survival (OS).
Statistical Analyses
All eligible patients were divided randomly into the training and validation cohorts in a 7:3 split ratio. The Chi-square (χ2) test were used to compare the clinicopathological characteristics between the training and validation cohorts. The nomogram was developed in the training cohort as follows: First, the univariate Cox analysis was used to evaluate the ability of every variable in predicting OS. Second, variables that reached statistical significance in the univariate Cox analysis were fitted in the multivariate Cox analysis. In order to determine the independent variables that strikingly contributed to patients' prognosis, the backwards selection procedure with Akaike information criterion (AIC) score was introduced to do the variable selection. Finally, these final variables were incorporated to construct the nomogram. The nomogram adopted the 1- and 3-year OS as primary endpoints.
Validation of the nomogram was performed internally in the training cohort and externally in the validation cohort. To evaluate the predictive accuracy of the nomogram, we used the concordance index (C-index) and the receiver operating characteristic curve (ROC) analysis (8). Calibration curves (1,000 bootstrap resamples) were generated to visualize the discrimination between the predicted and actual 1- and 3-year OS. DCA, a novel algorithm, was introduced to evaluate the clinical utility of the nomogram (9).
Furthermore, a risk stratification system was developed based on the tertile of total scores in the training cohort and assigned mCEC patients into three risk subgroups, including low-, intermediate-, and high-risk groups. Kaplan-Meier analysis and log-rank test were performed to investigate the survival difference between three risk subgroups. All analyses were conducted using R software version 3.4.3. Differences were considered significant at two-sided P-value < 0.05.
Results
Patient Baseline Characteristics
Our study extracted 1,252 eligible patients diagnosed with mCEC from 2010 to 2014, including 880 patients in the training cohort and 372 patients in the validation cohort. All patients were confirmed to have distant metastasis at initial diagnosis. The median age of all patients were 56 years old with a range of 16–93 years. The majority in both cohorts were younger (≤60 years), and White. The most common pathological type was squamous cell carcinoma (65.5%). With regards to metastasis pattern, lung (31.0%) was the most frequent site, followed by bone (17.5%), liver (13.7%), and brain (2.6%). In both cohorts, most patients treated with radiotherapy or chemotherapy. Table 1 summarized the patients' baseline characteristics between the training and validation cohorts, which were comparable in our study.
Table 1. Characteristics of patients with metastatic cervical cancer in the training cohort and validation cohort.
Independent Prognostic Factors for Patients With mCEC
In the training cohort, the univariate Cox analysis showed that age, race, pathological type, histology grade, liver metastasis, lung metastasis, brain metastasis, bone metastasis, metastasis number, surgery, radiotherapy, and chemotherapy were identified as statistically significant prognostic factors (all P < 0.001) (Table 2). Among them, age (C-index = 0.593), lung metastasis (C-index = 0.594), metastasis number (C-index = 0.633), and chemotherapy (C-index = 0.641) had higher discrimination ability in predicting OS than the other factors. All these statistically significant factors were then subjected to the multivariate Cox analysis. Finally, six factors with the least value of AIC, including age, race, pathological type, histology grade, metastasis number, radiotherapy, and chemotherapy, were identified as independent prognostic factors for OS (Table 3).
Table 2. Univariate Cox analysis of overall survival in metastatic cervical cancer (training cohort).
Table 3. Multivariate Cox analysis of overall survival in metastatic cervical cancer (training cohort).
Nomogram Development and Validation
As selected by the AIC, the above-mentioned parameters were incorporated to develop the nomogram for predicting 1- and 3-year OS (Figure 1). As shown in the nomogram, chemotherapy made the largest contribution to the prognosis, followed by metastasis number and radiotherapy, interestingly. Age, pathological type showed moderate impacts on the OS, while race made the modest difference to the prognosis. The nomogram had a C-index of 0.753 (95% CI: 0.780–0.726) in the training cohort and 0.751 (95% CI: 0.794–0.708) in the validation cohort. ROC analysis showed the AUCs of this model at 1- and 3-year OS reached 0.794, 0.751 in the training cohort, and 0.779, 0.787 in the validation cohort, respectively (Figures 2B,D). The calibration curves demonstrated considerable agreement between the nomogram predicted and actual survival in both cohorts (Figures 2A,C). DCA was used to evaluate the clinical utility of the nomogram. As shown in Figure 3, the nomogram showed great positive net benefits across wide ranges of death risk in both cohorts, indicating its favorable clinical utility in predicting 1- and 3-year OS.
Figure 1. Nomogram for predicting 1- and 3-year overall survival of metastatic cervical cancer.
Figure 2. Calibration plots and ROC curves for predicting overall survival at 1- and 3- year point. (A) The calibration plots for predicting overall survival at 1- and 3-year point in the training cohort. (B) ROC curves of the nomogram for predicting overall survival at 1- and 3-year point in the training cohort. (C) The calibration plots for predicting overall survival at 1- and 3-year point in the validation cohort. (D) ROC curves of the nomogram for predicting overall survival at 1- and 3-year point in the validation cohort.
Figure 3. Decision curve analysis of the nomogram for predicting overall survival at 1-(A) and 3-year (B) point in the training cohort and overall survival at 1-(C) and 3-year (D) point in the validation cohort. The x-axis represents the percentage of threshold probability, whereas the y-axis represents the net benefit, calculated by adding the true positives and subtracting the false positives.
Furthermore, to establish a risk stratification system based on our nomogram, we calculated the total scores for each patient in the training cohort, and then stratified the patients according to the tertile of total scores into three risk subgroups: score 0–51.0, low-risk group; score 51.1–93.0; intermediate-risk group; score 93.1–197.0, high-risk group. Each risk subgroup represented a distinct prognosis and the OS in the three subgroups was accurately separated by this system (Figures 4A,B).
Figure 4. Kaplan-Meier analysis of overall survival for patients stratified by the risk stratification system in the training cohort (A) and validation cohort (B).
Discussion
mCEC is the end stage of cervical cancer with extremely poor survival (2). Because of its high heterogeneity, the prognosis of mCEC varies from patient to patient. Up to now, a reliable model for predicting survival in mCEC is still lacking, which leads to the difficulty in individualized clinical management and surveillance. To address this issue, we performed a real-world analysis of mCEC patients and established a prognostic nomogram and risk stratification system. The parameters in this nomogram were easily accessible from routine clinical work. Moreover, the nomogram showed excellent performance internally and externally, as indicated by C-index, calibration, ROC curves, and DCA.
The clinical value of this nomogram could be seen in the risk stratification system, which could accurately stratify mCEC patients into three risk subgroups, and might provide guidance for patient counseling and risk-adapted clinical management. For example, the National Comprehensive Cancer Network (NCCN) guidelines recommend bevacizumab in combination with systemic chemotherapy as the standard management for mCEC women (10). However, our nomogram was able to identify a high-risk subgroup who might need more intensive therapy (e.g., radiotherapy) first. For these patients, we should give them more psychological or sentimental care and encourage them to participate in clinical trials of novel drugs like immune checkpoint inhibitors. In patients with distant metastasis and squamous cell carcinoma, the 1-year OS rates were 66 and 52% in the first and second subgroups, respectively. Therefore, this new model can identify high-risk patients who had a favorable survival evaluated by the current standards. In addition, using this model, mCEC patients could be stratified in clinical trials based on the predicted prognosis, which help reduce the heterogeneity among different treatment arms (11).
In this study, six variables were identified as independent prognostic variables for OS, including age, race, pathological type, histology grade, metastasis number, radiotherapy, and chemotherapy. Among these variables, metastasis number displayed the highest discriminating power. To date, no studies have focused on the relationship between the number of metastasis sites and prognosis in mCEC patients. In our study, metastasis number was an independent prognostic factor and have a distinctly positive correlation with death risks in mCEC patients. On the other hand, the most common site of distant metastasis was lung (31.0%), followed by bone (17.5%), liver (13.7%), and brain (2.6%), which coincided with previous reports (12). Furthermore, the C-index of metastasis number was higher than that of metastasis site, indicating that the metastasis number had more powerful predictive ability. Hence, for purpose of improving survival and life quality, it is necessary to consider many aspects of prevention, early diagnosis for cervical cancer (13).
Remarkably, in our nomogram, chemotherapy had the most powerful prognostic value for OS, with the largest C-index among all factors. This result strengthened again the role of systemic chemotherapy in treating mCEC patients. To date, several clinical studies have justified multi-agent chemotherapy in patients with advanced cervical cancer, which produces a rapid response with tolerable adverse events (14, 15). Local treatment also had a role in the management of mCEC. Our nomogram indicated that radiotherapy showed significant impacts on the OS, which is consistent with previous studies (16–19).
Undeniably, our study has several limitations that should be acknowledged. The first major limitation stemmed from the lack of information about the use of targeted drugs, dosage of radiotherapy, and details of chemotherapy regimens (20). Different regimens and responses are significantly associated with survival (21, 22). In addition, lack of information about several important factors, including performance status, infection status of human papilloma virus, and comorbidities, was also one of the limitations in this nomogram. Hence, adding these predictors into future studies could refine this nomogram. Second, cancer registry data may be miscoded, which could render significant bias to our study. And we had excluded the patients who had missing data on the collected variables, leading to a selection bias (23). Third, although the nomogram and risk stratification were built using a large cohort, and validated in a split subgroup of patients, they were only developed based on the patients in the USA, which could not represent the patients in other countries. For this reason, an external validation in different countries remained necessary. Additionally, using our nomogram in the patients from randomized clinical trials would be the gold standard for validating its performance (24, 25).
In conclusion, we established the first nomogram and risk stratification system to predict the OS for patients who were initially diagnosed with mCEC. The internal and external validation suggested satisfactory performance and clinical utility of this model. However, this model should also be further evaluated in other independent population.
Data Availability Statement
Publicly available datasets were analyzed in this study. This data can be found here: Institutional review board approval was not demanded in our study for SEER database is publicly available and we get access to it via accession number: 10165-Nov 2017.
Author Contributions
SZ and LW contributed to the conception, design, and drafted the manuscript. SZ, XW, and ZL analyzed the data. SZ, WW, and LW contributed with a critical revision of the manuscript.
Funding
This work was supported by the National Natural Science Foundation of China (Nos. 81872245 and 81803601).
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
1. Cohen PA, Jhingran A, Oaknin A, Denny L. Cervical cancer. Lancet. (2019) 393:169–82. doi: 10.1016/S0140-6736(18)32470-X
2. Gaffney DK, Hashibe M, Kepka D, Maurer KA, Werner TL. Too many women are dying from cervix cancer: problems and solutions. Gynecol Oncol. (2018) 151:547–54. doi: 10.1016/j.ygyno.2018.10.004
3. Van Meir H, Kenter GG, Burggraaf J, Kroep JR, Welters MJ, Melief CJ, et al. The need for improvement of the treatment of advanced and metastatic cervical cancer, the rationale for combined chemo-immunotherapy. Anticancer Agents Med Chem. (2014) 14:190–203. doi: 10.2174/18715206113136660372
4. Hwang JH, Lim MC, Seo SS, Kang S, Park SY, Kim JY. Outcomes and toxicities for the treatment of stage IVB cervical cancer. Arch Gynecol Obstet. (2012) 285:1685–93. doi: 10.1007/s00404-011-2173-6
5. Nishio S, Matsuo K, Yonemoto K, Shimokawa M, Hosaka M, Kodama M, et al. Race and nodal disease status are prognostic factors in patients with stage IVB cervical cancer. Oncotarget. (2018) 9:32321–30. doi: 10.18632/oncotarget.25962
6. Usami T, Takahashi A, Matoda M, Okamoto S, Kondo E, Kanao H, et al. Review of treatment and prognosis of stage IVB cervical carcinoma. Int J Gynecol Cancer. (2016) 26:1239–45. doi: 10.1097/IGC.0000000000000771
7. Balachandran VP, Gonen M, Smith JJ, DeMatteo RP. Nomograms in oncology: more than meets the eye. Lancet Oncol. (2015) 16:173–80. doi: 10.1016/S1470-2045(14)71116-7
8. Wolbers M, Koller MT, Witteman JC, Steyerberg EW. Prognostic models with competing risks: methods and application to coronary risk prediction. Epidemiology. (2009) 20:555–61. doi: 10.1097/EDE.0b013e3181a39056
9. Vickers AJ, Elkin EB. Decision curve analysis: a novel method for evaluating prediction models. Med Decis Making. (2006) 26:565–74. doi: 10.1177/0272989X06295361
10. Tewari KS, Sill MW, Penson RT, Huang H, Ramondetta LM, Landrum LM, et al. Bevacizumab for advanced cervical cancer: final overall survival and adverse event analysis of a randomised, controlled, open-label, phase 3 trial (Gynecologic Oncology Group 240). Lancet. (2017) 390:1654–63. doi: 10.1016/S0140-6736(17)31607-0
11. Li H, Wu X, Cheng X. Advances in diagnosis and treatment of metastatic cervical cancer. J Gynecol Oncol. (2016) 27:e43. doi: 10.3802/jgo.2016.27.e43
12. Agarwal U, Dahiya P, Chauhan A, Sangwan K, Purwar P. Scalp metastasis in carcinoma of the uterine cervix–a rare entity. Gynecol Oncol. (2002) 87:310–2. doi: 10.1006/gyno.2002.6829
13. Thanapprapasr D, Nartthanarung A, Likittanasombut P, Na Ayudhya NI, Charakorn C, Udomsubpayakul U, et al. Bone metastasis in cervical cancer patients over a 10-year period. Int J Gynecol Cancer. (2010) 20:373–8. doi: 10.1111/IGC.0b013e3181d4a0a1
14. Zighelboim I, Taylor NP, Powell MA, Gibb RK, Rader JS, Mutch DG, et al. Outcomes in 24 selected patients with stage IVB cervical cancer and excellent performance status treated with radiotherapy and chemotherapy. Radiat Med. (2006) 24:625–30. doi: 10.1007/s11604-006-0082-6
15. Qian S, Ye L, Tian YH, Wang LG, Huang ZP, Li F, et al. Californium-252 neutron brachytherapy combined with external pelvic radiotherapy plus concurrent chemotherapy for cervical cancer: a retrospective clinical study. Chin J Cancer. (2017) 36:24. doi: 10.1186/s40880-017-0191-x
16. Hata M, Omura M, Miyagi E, Koike I, Numazaki R, Asai-Sato M, et al. The role of radiation therapy for uterine cervical cancer with distant metastasis. Oncology. (2012) 83:67–74. doi: 10.1159/000337985
17. Kim HS, Kim T, Lee ES, Kim HJ, Chung HH, Kim JW, et al. Impact of chemoradiation on prognosis in stage IVB cervical cancer with distant lymphatic metastasis. Cancer Res Treat. (2013) 45:193–201. doi: 10.4143/crt.2013.45.3.193
18. Ning MS, Ahobila V, Jhingran A, Stecklein SR, Frumovitz M, Schmeler KM, et al. Outcomes and patterns of relapse after definitive radiation therapy for oligometastatic cervical cancer. Gynecol Oncol. (2018) 148:132–8. doi: 10.1016/j.ygyno.2017.10.017
19. Lee CK, Lee SR, Cho JM, Yang KA, Kim SH. Therapeutic effect of gamma knife radiosurgery for multiple brain metastases. J Korean Neurosurg Soc. (2011) 50:179–84. doi: 10.3340/jkns.2011.50.3.179
20. Zhang SL, Wang ZM, Wang WR, Wang X, Zhou YH. Novel nomograms individually predict the survival of patients with soft tissue sarcomas after surgery. Cancer Manag Res. (2019) 11:3215–25. doi: 10.2147/CMAR.S195123
21. Lee DY, Chong C, Lee M, Kim JW, Park NH, Song YS, et al. Prognostic factors in neuroendocrine cervical carcinoma. Obstet Gynecol Sci. (2016) 59:116–22. doi: 10.5468/ogs.2016.59.2.116
22. Nagase S, Inoue Y, Umesaki N, Aoki D, Ueda M, Sakamoto H, et al. Evidence-based guidelines for treatment of cervical cancer in Japan: Japan Society of Gynecologic Oncology (JSGO) 2007 edition. Int J Clin Oncol. (2010) 15:117–24. doi: 10.1007/s10147-010-0061-x
23. Zhang SL, Wang WR, Liu ZJ, Wang ZM. Marital status and survival in patients with soft tissue sarcoma: a population-based, propensity-matched study. Cancer Med. (2019) 8:465–79. doi: 10.1002/cam4.1802
24. Li S, Zhao J, Zhu L, Su F, Chen K. Development and validation of a nomogram predicting the overall survival of stage IV breast cancer patients. Cancer Med. (2017) 6:2586–94. doi: 10.1002/cam4.1224
Keywords: nomogram, metastatic cervical cancer, SEER, overall survival, decision curve analysis
Citation: Zhang S, Wang X, Li Z, Wang W and Wang L (2019) Score for the Overall Survival Probability of Patients With First-Diagnosed Distantly Metastatic Cervical Cancer: A Novel Nomogram-Based Risk Assessment System. Front. Oncol. 9:1106. doi: 10.3389/fonc.2019.01106
Received: 16 June 2019; Accepted: 07 October 2019;
Published: 05 November 2019.
Edited by:
Giuseppe Vizzielli, Agostino Gemelli University Polyclinic, ItalyReviewed by:
Marco Petrillo, University of Sassari, ItalyNicolò Bizzarri, A. Gemelli University Hospital Foundation, Italy
Luigi Pedone Anchora, Agostino Gemelli University Polyclinic, Italy
Copyright © 2019 Zhang, Wang, Li, Wang and Wang. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Lishun Wang, bGlzaHVud2FuZyYjeDAwMDQwO2Z1ZGFuLmVkdS5jbg==