- 1Department of Gynecologic Oncology, Sun Yat-sen University Cancer Center, Guangzhou, China
- 2State Key Laboratory of Oncology in South China, Collaborative Innovation Centre for Cancer Medicine, Guangzhou, China
- 3Department of General Surgery, Hunan Provincial People’s Hospital, The First Affiliated Hospital of Hunan Normal University, Changsha, China
- 4Department of Gynecology, Fujian Medical University Cancer Hospital, Fujian Cancer Hospital, Fuzhou, China
- 5Department of Gynecologic Oncology, The Affiliated Tumor Hospital of Guangxi Medical University, Nanning, China
Purpose: Treatment of epithelial ovarian cancer is evolving towards personalization and precision, which require patient-specific estimates of overall survival (OS) and progression-free survival (PFS).
Patients and Methods: Medical records of 1173 patients who underwent debulking surgery in our center were comprehensively reviewed and randomly allocated into a derivation cohort of 879 patients and an internal validation cohort of 294 patients. Five hundred and seventy-seven patients from the other three cancer centers served as the external validation cohort. A novel nomogram model for PFS and OS was constructed based on independent predictors identified by multivariable Cox regression analysis. The predictive accuracy and discriminative ability of the model were measured using Harrell’s concordance index (C-index) and calibration curve.
Results: The C-index values were 0.82 (95% CI: 0.76–0.88) and 0.84 (95% CI: 0.78–0.90) for the PFS and OS models, respectively, substantially higher than those obtained with the FIGO staging system and most nomograms reported for use in epithelial ovarian cancer. The nomogram score could clearly classify the patients into subgroups with different risks of recurrence or postoperative mortality. The online versions of our nomograms are available at https://eocnomogram.shinyapps.io/eocpfs/ and https://eocnomogram.shinyapps.io/eocos/.
Conclusion: A externally validated nomogram predicting OS and PFS in patients after R0 reduction surgery was established using a propensity score matching model. This nomogram may be useful in estimating individual recurrence risk and guiding personalized surveillance programs for patients after surgery, and it could potentially aid clinical decision-making or stratification for clinical trials.
Introduction
Ovarian cancer is the most lethal type of gynecologic malignancy, with an estimated 21410 new cases and 13770 deaths occurring in the United States in 2021 (1). The majority of these deaths are from epithelial ovarian cancer (EOC), which comprises 60% of ovarian cancers (2). Owing to the absence of specific symptoms and screening tools, EOC is usually diagnosed at an advanced stage, resulting in high rates of mortality and recurrence (3). Nowadays, the treatment of EOC is evolving towards personalization and precision, which require patient-specific estimates of overall survival (OS) and progression-free survival (PFS).
For first-diagnosed EOC patients, debulking surgery combined with platinum-based cytotoxic chemotherapy remains the cornerstone of standard management (4). Generally, an optimal debulking surgery is defined as ≤1 cm residual disease in the greatest dimension after resection (R0 resection), whereas >1 cm indicates a suboptimal surgery (R1 resection) (5, 6). Based on this, multiple predictive models have been established using R0/R1 as the main (sometimes only) prognostic variable describing surgeries (7, 8). However, several disconcerting facts have led to this practice being questioned. First, to maximize tumor removal, extensive resections including digestive tract resections or abdominal organ resections may be performed. Thus, “optimal resections” may comprise multiple surgeries that differ tremendously in the field of surgical complexity and long-term sequelae. A single index may be inadequate for describing such a set of surgeries (6, 9, 10). Second, numerous studies have proven that smaller amounts of residual disease are associated with longer survival, indicating that estimation of total tumor burden should be emphasized in predictive models (5). However, to the best of our knowledge, no predictive model has effectively quantified the total burden or refined the grey zone between R0 surgeries and complete resections. Therefore, it is natural to hypothesize that surgical complexity and total tumor burden are predictive factors of OS and PFS and should be taken into consideration in order to construct accurate predictive models.
Nomograms are statistical models that condense diverse prognostic variables into user-friendly pictorial representations to estimate the probability of a clinical event, e.g., recurrence or death, for an individual patient (11–13). As we aimed to devise an applicable and reliable model, we considered the use of scoring systems including the Arbeitsgemeinschaft Gynäkologische Onkologie score (AGO), peritoneal cancer index (PCI), and peritoneal surface disease severity score (PSDSS), which are all widely used in other cancers, to evaluate the impact of tumor burden without losing reproducibility (14, 15). By integrating prognostic factors including pathological features, surgical factors, and the scoring systems mentioned above, we created a novel prognostic model for OS and PFS in postsurgical EOC patients. To the best of our knowledge, this is the first externally validated nomogram to specifically estimate OS and PFS in EOC patients after R0 reduction surgery.
Materials and Methods
Patients
From January 2007 to December 2018, medical records of all patients who underwent debulking surgery in our center were comprehensively reviewed and evaluated by gynecologists. The inclusion criteria were as follows: 1. histopathologically confirmed EOC; 2. no history of other malignancies; 3. no other anti-cancer therapies before surgery or neoadjuvant chemotherapy. Patients were excluded if they met any of the following exclusion criteria: 1. suboptimal surgery; 2. incomplete clinical data; 3. non-standard surgery or non-standard first-line chemotherapy; 4. early-stage EOC patients who underwent fertility-saving procedures; 5. previous hysterectomy or unilateral/bilateral salpingo-oophorectomy before diagnosis (e.g., previous treatment of hysteromyoma or ectopic pregnancy); 6. operational records were not detailed enough to calculate PCI score, PSDSS, adjusted AGO score, or surgical complexity score (SCS); 7. death or loss to follow-up within 3 months after initial treatment. After evaluation, a total of 1173 patients were included in this study and were randomly allocated into a derivation cohort of 879 patients and an internal validation cohort of 294 patients, in a ratio of 3:1. Five hundred and seventy-seven patients from another three cancer centers served as the external validation cohort. This retrospective study was approved by the Medical Ethics Committee of all institutions involved and was conducted under relevant guidelines. The workflow is summarized in Figure 1.
Data Collection and Definition
Factors that might impact OS and PFS were extracted and analyzed. Demographic characteristics including age, Eastern Cooperative Oncology Group performance, body mass index, hemoglobin and platelet counts, and neoadjuvant chemotherapy (NACT) status were acquired. Inflammatory data, including leukocytes counts or neutrophil and monocyte percentages, were collected. Tumor characteristics (pathological diagnosis and differentiation, maximum tumor diameter, presurgical CA125 and HE4s, ascites cytology, etc.) were obtained, as well as surgical information including the duration of surgery and amount of blood loss. Biochemical indexes including but not limited to ALT, AST, GGT, TP, ALB, CREA, PT, INR, and APTT, were measured.
We used PCI score and PSDSS to represent the level of tumor burden observed during surgery, as both of these scoring systems are objective, implementable, and frequently used in other malignancies (15–18). PCI score was calculated by assessing the extent of intra-peritoneal disease at diagnosis through quantitatively combining the cancer implant size with the tumor distribution throughout 13 abdominopelvic regions, producing a maximum score of 393. PSDSS was calculated by integrating clinical symptoms, the extent of carcinomatosis, and primary tumor pathology as reported by Antonio et al. (15). We also consulted the settings of the AGO score by utilizing three vital factors to assess the gross disease of patients (complete cytoreduction at initial surgery, no ascites, and good performance status at recurrence). As the AGO score was created for evaluation of secondary cytoreduction, this study used an adjusted AGO score, defined based on complete cytoreduction, no ascites, and good performance status at initial surgery. SCS was used to describe the complexity of the cytoreductive surgery (19, 20). The score sheet used for calculating PCI score, PSDSS, adjusted AGO score, and SCS is summarized in Supplementary Figure 1.
Treatment and Follow-Up
For patients with comorbidity, poor performance status, and predicted suboptimal debulking surgery, neoadjuvant chemotherapy was performed before initial surgery. The possibility of suboptimal resection in the primary debulking setting was assessed by at least two experienced gynecological oncologists and one radiologist. All patients who underwent NACT were assessed with computed tomography (CT) and had Suidan score ≥3. Before NACT was initiated, fine needle biopsy (only for those whose clinical conditions couldn’t tolerate a diagnostic laparoscopy) or diagnostic laparoscopy was completed for histologic confirmation of diagnosis. For those who received interval debulking surgery, surgeries were performed after < 4 cycles of NACT. After surgery, adjuvant chemotherapy was performed when clinically indicated, according to the standard of care based on NCCN guidelines. All patients involved in this research received taxane/platinum-based systemic chemotherapy. Those who did not complete initial treatment or switched to a non-standard regimen were excluded from this study.
All surgeries were performed by experienced gynecological oncologists. For patients in the initial stages (FIGO stages I–II), comprehensive surgical staging was performed, with standard surgical treatment consisting of hysterectomy, bilateral salpingo-oophorectomy, omentectomy, and retroperitoneal (pelvic and para-aortic) lymphadenectomy. For patients with advanced disease (FIGO stages III–IV), cytoreductive surgeries were performed. Surgical approaches included but were not limited to the operations mentioned above, together with other tumorectomies of metastatic lesions if applicable, in an attempt to reach a state of no gross residual disease (complete surgical resection). Peritoneal washing was routinely conducted for all patients.
Patients were followed up every 3 months for the first 2 years after complete initial surgery and adjuvant chemotherapy. After 2 years, patients were followed up annually. Each follow-up consisted of a blood test to determine CA125 and HE4 levels, biochemical tests, and imaging such as abdominal ultrasound or contrast-enhanced CT/magnetic resonance imaging. Recurrence was defined as a persistent elevation in CA125 level or metastases detected by CT/ultrasound. Recurrent EOC was treated by further surgical resection, radiofrequency ablation, or chemotherapy according to the recurrence pattern. The end of follow-up was May 2021. The median follow-up period was 41 months (range: 6.0–160.7 months) for the cohort of patients from our center and 40 months (range: 6.0–149.5 months) for the external validation cohort.
Statistical Analysis
The endpoints of this study were PFS and OS. PFS was calculated as the interval between the last day of initial treatment and the date when a recurrence was confirmed. OS was defined as the period between the last day of initial treatment and the date of the patient’s death or the date of the last follow-up. Kruskal–Wallis analysis of variance (ANOVA) tests and ANOVA t-tests were performed to compare continuous data. For discrete data, χ2-tests were carried out. Survival was calculated by the classical Kaplan–Meier method and compared between groups by log-rank tests. Variables screened as significant by univariate analysis were used in multivariate Cox proportional hazards regression analysis to identify independent prognostic factors.
Based on the multivariate analysis of the training cohort, two nomograms were established. Final model selection was performed by a backward step-down process with the Akaike information criterion. The two nomograms were assessed by Harrell’s concordance index (C-index) and calibration curves comparing model-predicted vs real-world Kaplan–Meier estimates of OS and PFS.
Nomograms were then validated in the internal and external validation cohorts. The nomograms were also compared with the FIGO staging system by analysis of receiver operating characteristic (ROC) curves. SPSS (version 22.0, IBM, Armonk, NY) and R (version 3.6.3) software was used during those procedures. P < 0.05 was defined as statistically significant.
Results
Baseline Characteristics of Patients
This multicenter study recruited 1750 patients with a median age of 52.0 (interquartile range: 45–60) years. Of these patients, 630 patients underwent interval debulking surgery (36.0%), whereas others received primary debulking surgery (74.0%). The clinicopathological data of the patients in the training and validation cohorts, including demographic factors, imaging results, surgical factors, and preoperative blood test results, are summarized in Supplementary Table 1.
Independent Prognostic Factors in the Training Cohort
Univariable and multivariable analyses were performed in the training cohort. All significant factors (P < 0.05) in the univariable analysis were entered into the multivariable analysis via a Cox regression model. The results showed that FIGO stage, pathological differentiation, NACT, number of organ sites of metastases, blood loss, PSDSS, SCS, and HE4 level were independent risk factors associated with PFS, whereas FIGO stage, pathological differentiation, NACT status, number of organ sites of metastases, ascites cytology, PSDSS, adjusted AGO score, and SCS were independent risk factors associated with OS (Figure 2).
Figure 2 Multivariate analysis and forest plot of the hazard ratios for progression-free survival (PFS) (A) and overall survival (OS) (B) in the training cohort.
Construction of PFS and OS Predictive Nomograms
To predict OS and PFS of patients with EOC, two nomograms were formulated using R software based on the findings of the multivariable analysis (Figure 3). Each value of these variables was assigned as a subtype, therefore a score on the point scale. By adding up the scores for each variable and positioning it on the total point scale, a user can predict the PFS and OS of an individual patient. Red points in the graph represent the values of an observed case. The size of the green boxes represents the proportion of this type of patient in the training cohort, and the density represents the distribution of the variable in the data set.
Figure 3 Nomograms for predicting the probability of 1, 3, and 5-year progression-free survival (PFS) (A) and 1, 3, and 5-year overall survival (OS) (B) of patients with epithelial ovarian cancer. PSDSS, peritoneal surface disease severity score.
Internal and External Validation of Predictive Accuracy
The Harrell’s C-index values for the PFS and OS nomograms in the training cohort were 0.82 (95% CI: 0.76–0.88) and 0.84 (95% CI: 0.78–0.90), respectively. In the internal validation cohort, the C-index values for the PFS and OS nomograms were 0.80 (95% CI: 0.74–0.86) and 0.81 (95% CI: 0.75–0.87), respectively. In the external validation cohort, the C-index values for the PFS and OS nomograms were 0.84 (95% CI: 0.79–0.89) and 0.87 (95% CI: 0.82–0.92), respectively. The calibration plots showed remarkable agreement between the nomograms’ predictions and actual observations for 1-, 3-, and 5-year PFS and OS in the training cohort (Figures 4A–D), internal validation cohort (Figures 4B–E), and external validation cohort (Figures 4C–F).
Figure 4 Calibration curves for predicting 1-, 3-, and 5-year progression-free survival (PFS) in the training (A), internal validation (B), and external validation (C) cohorts, and for predicting 1-, 3-, and 5-year overall survival (OS) in the training (D), internal validation (E), and external validation (F) cohorts.
Comparison of Predictive Powers of Nomograms With Conventional FIGO Staging System
We compared the predictive abilities of the PFS and OS nomograms with those of the FIGO staging system using ROC curve analysis. Our nomograms showed better discriminatory power in the training cohort than did the conventional FIGO staging system (Figure 5). For the PFS nomogram, the C-index value was 0.82 (95% CI: 0.76–0.88), substantially higher than that of the FIGO staging system (0.74, 95% CI: 0.71–0.81; P < 0.001). For the OS nomogram, the C-index value was 0.84 (95% CI: 0.78–0.90), significantly higher than that of the FIGO staging system (0.76, 95% CI: 0.70–0.78; P < 0.001).
Figure 5 Receiver operating characteristic (ROC) curve analysis of progression-free survival (PFS) (A) and overall survival (OS) (B) in the training cohort using the nomograms and the FIGO staging system.
Nomogram Scores Could Clearly Classify Patients Into Subgroups With Different Risks of Recurrence or Postoperative Mortality
We determined appropriate cutoff values by grouping the patients in the training cohort evenly into three subgroups after sorting by total score. The OS nomogram could also stratify patients into low risk (score ≤ 172), medium risk (score 172 to 220), and high risk (score > 220) groups. The 5-year PFS rates were 87.4%, 53.2%, and 27.5%, respectively, in the training cohort (P < 0.001) (Figure 6A). Similar results were obtained in the internal validation cohort (Figure 6B) and in the external validation cohort (Figure 6C). Similarly, the PFS nomogram was able to accurately stratify patients as low risk (score ≤ 172), medium risk (score 173-208), or high risk (score > 208) of recurrence, where each group represented a distinct prognosis (Figure 6D). The 5-year PFS rates were 71.1%, 25.1%, and 13.6%, respectively, in the training cohort (P < 0.001). Similar results were obtained in the internal validation cohort (Figure 6E) and the external validation cohort (Figure 6F). While stratifying patients into different risk groups, we took the nomogram’s score of patients from training group into the Cox-model, to explore the relationship between the nomogram score and the probability of >5-year PFS/OS. Using nomogram score as the horizontal axis, and the probability of >5-year PFS/OS as the vertical axis, we found that those two variables are almost linear (Supplementary Figure 3).
Figure 6 Kaplan–Meier survival curves for each subtype of patients, estimating progression-free survival (PFS) in the training (A), internal validation (B), and external validation (C) cohorts, and overall survival (OS) in the training (D), internal validation (E), and external validation (F) cohorts.
Development of Webserver for Easy Access to the Novel Nomograms
The online versions of our nomograms are available for public use; clinicians and researchers can visit https://eocnomogram.shinyapps.io/eocpfs/ and https://eocnomogram.shinyapps.io/eocos/ to predict the long-term survival of postoperative patients with EOC. Predicted survival probability across time can be easily determined by inputting clinical features and reading the output figures and tables generated by the webserver (Supplementary Figure 2).
Discussion
To the best of our knowledge, no prognostic model has previously been constructed specifically for EOC patients undergoing optimal resections. We chose optimal resections as our study interest for the following reasons. Foremost, an unsuccessful cytoreduction offers no appreciable survival benefit and may place patients at risk of morbidity. Efforts are ongoing to better anticipate which patients will experience R1 surgery (21–23). Although there is currently no universally recognized method, there is a growing move towards NACT for patients whose disease is determined to be unresectable (24, 25). In light of this, the prediction of optimal resections with or without NACT is of greater clinical expectations than those underwent R1 surgery. Furthermore, to maximize tumor removal, extensive resections including digestive tract resections or abdominal organ resections may be performed. Therefore, it is natural to hypothesize that “optimal resections” include great disparities that could affect OS and PFS (9, 26). Last, postoperative tumor burden profoundly influences patient prognosis, affecting recurrence and survival (27, 28). Despite optimal resection (residual disease ≤1 cm) being the threshold for satisfactory cytoreduction, various studies have shown that removal of all evidence of macroscopic disease is associated with prolonged survival (5). Hence, the state between complete cytoreductive surgeries and optimal resection is in need of refinement (29).
In the present study, we constructed a PFS-nomogram and OS-nomogram to predict postoperative recurrence and OS in patients who had undergone optimal resection based on conventional clinicopathological and surgical variables. The nomograms showed excellent performance in predicting post-operative PFS and OS of an individual who had undergone optimal resection for EOC. Compared with the conventional FIGO staging system, our nomograms achieved better prediction of outcomes.
Many factors potentially affect the prognosis of EOC patients, including demographic characteristics, pathological diagnosis, imaging results, surgical factors, the volume of residual disease, and the results of relevant blood examinations (30–33). In order to establish a reasonable and accurate model for prediction, all these aspects should be taken into consideration. Unfortunately, there is no prediction model for EOC that attempts to integrate all these types of factors. There is also a conundrum regarding how to describe total tumor burden in a quantified manner. To solve this, we used PCI score and PSDSS to represent the level of tumor burden, as these scoring systems are objective, implementable, and extensively used in malignancies including gastric cancer and colorectal cancer (15–18). In this study, we collected variables that fully covered demographic characteristics (age), pathological diagnosis (FIGO stage, histology, histologic differentiation, ascites cytology, and lymph node invasion), imaging results (Suidan score, largest tumor size by image), surgical factors (operative time, blood loss, volume of ascites, SCS), the tumor burden (PCI score, PSDSS), results of relevant blood tests (levels of HE4, CA125, CA199, hemoglobin, platelets, WBC, RBC, ALT, AST, TP, ALB, SCr, PT, APTT, TBIL, etc.), and other indexes (adjusted AGO score and NACT status). Using univariate and multivariate analysis, we identified risk factors that were associated with PFS and OS. Our finding that PSDSS and SCS were as independent predictive factors for OS and PFS echoes findings from prior studies with significantly larger sample sizes (3, 19, 34). The results validated our speculation that patients who underwent optimal resection with lower presurgical tumor burden, and thus with lower PCI score and PSDSS, might have better prognosis. We established nomograms based on factors including FIGO stage, pathological differentiation, NACT, number of organ sites of metastases, blood loss, PSDSS, SCS, HE4, ascites cytology, and adjusted AGO score, which are strongly associated with PFS and OS.
The two nomograms were validated in a separate internal validation cohort of patients from our center and an external validation cohort of patients from another three cancer centers in different geographic areas in mainland China. The C-index values in the two validation cohorts were 0.80 and 0.85 for predicting PFS and 0.85 and 0.89 for predicting OS. The calibration plots showed good agreement of actual and nomogram-predicted probabilities for PFS and OS in both the internal validation cohort and the external validation cohort. Most previously reported nomograms have lacked external validation, especially multicenter validation (Supplementary Table 2) (7, 8, 35–40). According to our multicenter external validation data, the proposed nomograms showed good predictive performance in patients from different areas of China. Thus, they are suitable for national application in clinical practice.
The proposed nomograms could divide postoperative patients into three subgroups with different risks of recurrence or mortality (Figure 6). Patients with EOC are often diagnosed at an advanced stage, leading to high rates of mortality and recurrence. Thus, there is a need to improve clinical risk stratification to identify which patients require close surveillance protocols and to design postoperative therapeutic clinical trials. For those with a high risk of recurrence, i.e., patients whose OS-nomogram scores exceeded 220 or PFS-nomogram scores were higher than 208, higher-frequency personalized surveillance programs, hyperthermic intraperitoneal chemotherapy, or targeted therapies might be considered (41).
There were some limitations of this study. The discovery of the BRCA gene and PARP inhibitors heralded a new era for the precision treatment of EOC (42, 43). Unfortunately, as China remains a developing country, most of our patients had not undergone BRCA1/2 gene mutation testing or homologous recombination deficiency testing (HRD). Therefore, there was a lack of information on whether patients in our study harbored genetic mutations. The study also had limitations due to its retrospective nature. For example, the reliability of the PSDSS depends on the validity of surgical records. Future prospective studies are needed to verify our findings.
Conclusion
An externally validated nomogram predicting OS and PFS in patients after R0 reduction surgery was established. The nomogram score could clearly classify the patients into subgroups with different risks of recurrence or postoperative mortality. The online versions of our nomograms are available at https://eocnomogram.shinyapps.io/eocpfs/ and https://eocnomogram.shinyapps.io/eocos/ . These nomograms may be useful for estimating individual recurrence risk and guiding personalized surveillance programs for patients after surgery, and may potentially open up more options for clinical decision-making or stratification for clinical trials.
Data Availability Statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Ethics Statement
The studies involving human participants were reviewed and approved by SYSUCC. The patients/participants provided their written informed consent to participate in this study.
Author Contributions
QL designed the model and wrote the manuscript with input from all authors. YD analyzed the data and performed the calculations. WW and FY collected and reviewed patient data from the derivation cohort and internal validation cohort. AL, YD, and DY collected and reviewed patient data from the external validation cohort. JL and XZ conceived the study and were in charge of overall direction and planning. QL, YD, WW, FY, AL, DY, XZ, and JL contributed to the interpretation of the results. All authors provided critical feedback and helped to shape the research, analysis, and manuscript.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary Material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fonc.2022.859409/full#supplementary-material
Supplementary Figure 1 | Score sheets for calculating PCI (peritoneal cancer index) score (A), peritoneal surface disease severity score (PSDSS) (B), surgical complexity score (SCS) (C) and adjusted Arbeitsgemeinschaft Gynäkologische Onkologie (AGO) score (D).
Supplementary Figure 2 | Screenshot of the online prediction tool based on the progression-free survival (PFS) (A) and overall survival (OS) (B) nomogram models.
References
1. Siegel RL, Miller KD, Fuchs HE, Jemal A. Cancer Statistics, 2021. CA Cancer J Clin (2021) 71:7–33. doi: 10.3322/caac.21654
2. Flaum N, Crosbie EJ, Edmondson RJ, Smith MJ, Evans DG. Epithelial Ovarian Cancer Risk: A Review of the Current Genetic Landscape. Clin Genet (2020) 97(1):54–63. doi: 10.1111/cge.13566
3. Elzarkaa AA, Shaalan W, Elemam D, Mansour H, Melis M, Malik E, et al. Peritoneal Cancer Index as a Predictor of Survival in Advanced Stage Serous Epithelial Ovarian Cancer: A Prospective Study. J Gynecol Oncol (2018) 29:e47. doi: 10.3802/jgo.2018.29.e47
4. Wimberger P, Wehling M, Lehmann N, Kimmig R, Schmalfeldt B, Burges A, et al. Influence of Residual Tumor on Outcome in Ovarian Cancer Patients With FIGO Stage IV Disease: An Exploratory Analysis of the AGO-OVAR (Arbeitsgemeinschaft Gynaekologische Onkologie Ovarian Cancer Study Group). Ann Surg Oncol (2010) 17:1642–8. doi: 10.1245/s10434-010-0964-9
5. du Bois A, Reuss A, Pujade-Lauraine E, Harter P, Ray-Coquard I, Pfisterer J. Role of Surgical Outcome as Prognostic Factor in Advanced Epithelial Ovarian Cancer: A Combined Exploratory Analysis of 3 Prospectively Randomized Phase 3 Multicenter Trials: By the Arbeitsgemeinschaft Gynaekologische Onkologie Studiengruppe Ovarialkarzinom (AGO-OVAR) and the Groupe D’investigateurs Nationaux Pour Les Etudes Des Cancers De L’ovaire (GINECO). Cancer (2009) 115:1234–44. doi: 10.1002/cncr.24149
6. Hernandez-Lopez LA, Elizalde-Mendez A. How Far Should We Go in Optimal Cytoreductive Surgery for Ovarian Cancer? Chin Clin Oncol (2020) 9:70. doi: 10.21037/cco-20-40
7. Barlin JN, Yu C, Hill EK, Zivanovic O, Kolev V, Levine DA, et al. Nomogram for Predicting 5-Year Disease-Specific Mortality After Primary Surgery for Epithelial Ovarian Cancer. Gynecol Oncol (2012) 125:25–30. doi: 10.1016/j.ygyno.2011.12.423
8. Rutten MJ, Boldingh JHL, Schuit E, Trum H, van Driel W, Mol BWJ, et al. Development and Internal Validation of a Prognostic Model for Survival After Debulking Surgery for Epithelial Ovarian Cancer. Gynecol Oncol (2014) 135:13–8. doi: 10.1016/j.ygyno.2014.07.099
9. Aletti GD, Dowdy SC, Gostout BS, Jones MB, Stanhope RC, Wilson TO, et al. Quality Improvement in the Surgical Approach to Advanced Ovarian Cancer: The Mayo Clinic Experience. J Am Coll Surg (2009) 208:614–20. doi: 10.1016/j.jamcollsurg.2009.01.006
10. Schorge JO, Bradford LS, del Carmen MG. Primary Cytoreductive Surgery for Advanced Ovarian Cancer: Is It the Past, Present, or Future? Clin Adv Hematol Oncol (2011) 9:912–8.
11. Fakhry C, Zhang Q, Nguyen-Tân PF, Rosenthal DI, Weber RS, Lambert L, et al. Development and Validation of Nomograms Predictive of Overall and Progression-Free Survival in Patients With Oropharyngeal Cancer. J Clin Oncol (2017) 35:4057–65. doi: 10.1200/JCO.2016.72.0748
12. Iasonos A, Schrag D, Raj GV, Panageas KS. How to Build and Interpret a Nomogram for Cancer Prognosis. J Clin Oncol (2008) 26:1364–70. doi: 10.1200/JCO.2007.12.9791
13. Raghav K, Hwang H, Jácome AA, Bhang E, Willett A, Huey RW, et al. Development and Validation of a Novel Nomogram for Individualized Prediction of Survival in Cancer of Unknown Primary. Clin Cancer Res (2021) 27:3414–21. doi: 10.1158/1078-0432.CCR-20-4117
14. Verheij FS, Bakkers C, van Eden WJ, Aalbers AGJ, Nienhuijs SW, Jóźwiak K, et al. Comparison of the Peritoneal Cancer Index and Dutch Region Count as Tools to Stage Patients With Peritoneal Metastases of Colorectal Cancer. BJS Open (2020) 4(6):1153–61. doi: 10.1002/bjs5.50313
15. Pedro Antonio C-C, Alvaro Jesus G-R, Jose G, Elena G, Alida G, Francisco M-L, et al. Validation of a Peritoneal Surface Disease Severity Score in Stage IIIC-IV Ovarian Cancer Treated With Cytoreduction and Hyperthermic Intraperitoneal Chemotherapy. Surg Oncol (2019) 28:57–61. doi: 10.1016/j.suronc.2018.11.005
16. Esquivel J, Sanchez-Garcia S, Hicken W. Evaluation of a New Staging Classification and a Peritoneal Surface Disease Severity Score (PSDSS) in 210 Patients With Mucinous Appendiceal Neoplasms With or Without Peritoneal Dissemination. Ann Surg Oncol (2014) 21:S14. doi: 10.1002/jso.23679
17. Gilly FN, Cotte E, Brigand C, Monneuse O, Beaujard AC, Freyer G, et al. Quantitative Prognostic Indices in Peritoneal Carcinomatosis. Eur J Surg Oncol (2006) 32:597–601. doi: 10.1016/j.ejso.2006.03.002
18. Yonemura Y, Bandou E, Kawamura T, Endou Y, Sasaki T. Quantitative Prognostic Indicators of Peritoneal Dissemination of Gastric Cancer. Eur J Surg Oncol (2006) 32:602–6. doi: 10.1016/j.ejso.2006.03.003
19. Davidson BA, Broadwater G, Crim A, Boccacio R, Bixel K, Backes F, et al. Surgical Complexity Score and Role of Laparoscopy in Women With Advanced Ovarian Cancer Treated With Neoadjuvant Chemotherapy. Gynecol Oncol (2019) 152:554–9. doi: 10.1016/j.ygyno.2018.12.011
20. Di Donato V, Di Pinto A, Giannini A, Caruso G, D’Oria O, Tomao F, et al. Modified Fragility Index and Surgical Complexity Score Are Able to Predict Postoperative Morbidity and Mortality After Cytoreductive Surgery for Advanced Ovarian Cancer. Gynecol Oncol (2021) 161:4–10. doi: 10.1016/j.ygyno.2020.08.022
21. Llueca A, Serra A, Rivadulla I, Gomez L, Escrig J. MUAPOS Working Group (Multidisciplinary Unit of Abdominal Pelvic Oncology Surgery). Prediction of Suboptimal Cytoreductive Surgery in Patients With Advanced Ovarian Cancer Based on Preoperative and Intraoperative Determination of the Peritoneal Carcinomatosis Index. World J Surg Oncol (2018) 16:37. doi: 10.1186/s12957-018-1339-0
22. Song YJ. Prediction of Optimal Debulking Surgery in Ovarian Cancer. Gland Surg (2021) 10:1173–81. doi: 10.21037/gs-2019-ursoc-08
23. Son HM, Kim SH, Kwon BR, Kim MJ, Kim CS, Cho SH. Preoperative Prediction of Suboptimal Resection in Advanced Ovarian Cancer Based on Clinical and CT Parameters. Acta Radiol (2017) 58:498–504. doi: 10.1177/0284185116658683
24. Bacalbaşa N, Bălescu I, Vîlcu M, Dima S, Iliescu L, Brezean I. Cytoreductive Surgery for Advanced Stage Ovarian Cancer in the Second Trimester of Pregnancy—A Case Report and Literature Review. Medicine (2020) 99:e21127. doi: 10.1097/MD.0000000000021127
25. Randall TC, Rubin SC. Cytoreductive Surgery for Ovarian Cancer. Surg Clin North Am (2001) 81:871–83. doi: 10.1016/S0039-6109(05)70171-7
26. Hall H, Savvatis K, Nixon K, Kyrgiou M, Hariharan K, Padwick M. Maximal-Effort Cytoreductive Surgery for Ovarian Cancer Patients With a High Tumor Burden: Variations in Practice and Impact on Outcome. Ann Surg Oncol (2019) 26:2943–51. doi: 10.1245/s10434-019-07516-3
27. Yamamoto M, Tsujikawa T, Fujita Y, Chino Y, Kurokawa T, Kiyono Y. Metabolic Tumor Burden Predicts Prognosis of Ovarian Cancer Patients Who Receive Platinum-Based Adjuvant Chemotherapy. Cancer Sci (2016) 107(4):478–85. doi: 10.1111/cas.12890
28. Heilmann T, Pfisterer J, Hempel AM, Saß S, Hedderich J, Pujade-Lauraine E, et al. Early Treatment Modifications Improve Chemotherapy Adherence in Ovarian Cancer Patients ≥70 Years. Gynecol Oncol (2019) 153:616–24. doi: 10.1016/j.ygyno.2019.02.015
29. Chi DS, Eisenhauer EL, Lang J, Huh J, Haddad L, Abu-Rustum NR, et al. What is the Optimal Goal of Primary Cytoreductive Surgery for Bulky Stage IIIC Epithelial Ovarian Carcinoma (EOC)? Gynecol Oncol (2006) 103:559–64. doi: 10.1016/j.ygyno.2006.03.051
30. Winter WE, Maxwell GL, Tian C, Carlson JW, Ozols RF, Rose PG, et al. Prognostic Factors for Stage III Epithelial Ovarian Cancer: A Gynecologic Oncology Group Study. J Clin Oncol (2007) 25:3621–7. doi: 10.1200/JCO.2006.10.2517
31. Chang L-C, Huang C-F, Lai M-S, Shen L-J, Wu F-LL, Cheng W-F. Prognostic Factors in Epithelial Ovarian Cancer: A Population-Based Study. PloS One (2018) 13:e0194993. doi: 10.1371/journal.pone.0194993
32. Marsoni S, Torri V, Valsecchi MG, Belloni C, Bianchi U, Bolis G, et al. Prognostic Factors in Advanced Epithelial Ovarian Cancer. (Gruppo Interregionale Cooperativo Di Oncologia Ginecologica (GICOG)). Br J Cancer (1990) 62:444–50. doi: 10.1038/bjc.1990.315
33. Schildkraut JM, Halabi S, Bastos E, Marchbanks PA, McDonald JA, Berchuck A. Prognostic Factors in Early-Onset Epithelial Ovarian Cancer: A Population-Based Study. Obstet Gynecol (2000) 95:119–27. doi: 10.1097/00006250-200001000-00023
34. Yarema R, Fetsych T, Volodko N, Оhorchak M, Petronchak O, Huley R, et al. Evaluation of the Peritoneal Surface Disease Severity Score (PSDSS) in Ovarian Cancer Patients Undergoing Cytoreductive Surgery and HIPEC: Two Pathogenetic Types Based Study. J Surg Oncol (2018) 117:1806–12. doi: 10.1002/jso.25087
35. Nieuwenhuyzen-de Boer GM, Gerestein CG, Eijkemans MJC, Burger CW, Kooi GS. Nomogram for 30-Day Morbidity After Primary Cytoreductive Surgery for Advanced Stage Ovarian Cancer. Eur J Gynaecol Oncol (2016) 37:63–8.
36. Wei W, Liu Z, Rong Y, Zhou B, Bai Y, Wei W, et al. A Computed Tomography-Based Radiomic Prognostic Marker of Advanced High-Grade Serous Ovarian Cancer Recurrence: A Multicenter Study. Front Oncol (2019) 9:255. doi: 10.3389/fonc.2019.00255
37. Chi DS, Palayekar MJ, Sonoda Y, Abu-Rustum NR, Awtrey CS, Huh J, et al. Nomogram for Survival After Primary Surgery for Bulky Stage IIIC Ovarian Carcinoma. Gynecol Oncol (2008) 108:191–4. doi: 10.1016/j.ygyno.2007.09.020
38. Yang J, Ma J, Jin Y, Cheng S, Huang S, Zhang N, et al. Development and Validation for Prognostic Nomogram of Epithelial Ovarian Cancer Recurrence Based on Circulating Tumor Cells and Epithelial-Mesenchymal Transition. Sci Rep (2021) 11:6540. doi: 10.1038/s41598-021-86122-4
39. Xu X-L, Cheng H, Tang M-S, Zhang H-L, Wu R-Y, Yu Y, et al. A Novel Nomogram Based on LODDS to Predict the Prognosis of Epithelial Ovarian Cancer. Oncotarget (2017) 8:8120–30. doi: 10.18632/oncotarget.14100
40. Wang R, Xie G, Shang L, Qi C, Yang L, Huang L, et al. Development and Validation of Nomograms for Epithelial Ovarian Cancer: A SEER Population-Based, Real-World Study. Future Oncol (2021) 17(8):893–906. doi: 10.2217/fon-2020-0531
41. Ceelen W, Demuytere J, de Hingh I. Hyperthermic Intraperitoneal Chemotherapy: A Critical Review. Cancers (2021) 13:3114. doi: 10.3390/cancers13133114
42. Banerjee S, Kaye S. PARP Inhibitors in BRCA Gene-Mutated Ovarian Cancer and Beyond. Curr Oncol Rep (2011) 13:442–9. doi: 10.1007/s11912-011-0193-9
Keywords: epithelial ovarian cancer, nomogram, predictive models, optimal resection, progression-free survival, overall survival
Citation: Li Q, Deng Y, Wei W, Yang F, Lin A, Yao D, Zhu X and Li J (2022) Development and External Validation of a Novel Model for Predicting Postsurgical Recurrence and Overall Survival After Cytoreductive R0 Resection of Epithelial Ovarian Cancer. Front. Oncol. 12:859409. doi: 10.3389/fonc.2022.859409
Received: 21 January 2022; Accepted: 28 February 2022;
Published: 23 March 2022.
Edited by:
Andrea Tinelli, Moscow Institute of Physics and Technology, RussiaReviewed by:
Qichen Chen, China Academy of Chinese Medical Sciences, ChinaBarbara Costantini, Agostino Gemelli University Polyclinic (IRCCS), Italy
Copyright © 2022 Li, Deng, Wei, Yang, Lin, Yao, Zhu and Li. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Jundong Li, bGlqZEBzeXN1Y2Mub3JnLmNu; Xiaofeng Zhu, emh1eGZAc3lzdWNjLm9yZy5jbg==
†These authors have contributed equally to this work and share first authorship