- 1Guy's, King's, and St. Thomas' Hospital, London, United Kingdom
- 2Xing Technologies, Sinnamon Park, QLD, Australia
- 3Janssen R&D, Raritan, NJ, United States
- 4Janssen Global Services LLC, Raritan, NJ, United States
- 5Idea Pharma, New York, NY, United States
- 6Idea Pharma, Cranfield, United Kingdom
Background: Using progression-free survival (PFS)2, time from randomization to 2nd disease progression or death, is proposed as a surrogate for overall survival (OS) in oncology clinical trials. We used published data from solid tumor trials to assess whether PFS2 and OS are correlated.
Methods: A literature search identified studies that reported PFS, PFS2, and OS. Two reviewers screened for eligibility, and documented PFS2, PFS or time from 1st to 2nd disease progression or death and OS. Correlation between PFS2 and OS was assessed using: (1) Kendall's Tau + Pearson's correlation coefficient in randomized controlled trials (RCTs); (2) Meta-analysis with the random effects model to compute the pooled correlation of PFS2 and OS.
Results: Overall, 133 studies met search criteria, 15 (28 arms) had complete PFS2 and OS data in ovarian, gastric, colorectal, prostate, lung, renal and breast cancers. A positive correlation for PFS2 and OS was found for all 15 studies (Kendall's Tau = 0.7 [95% CIs 0.54, 0.78]); 10 RCTs (Pearson's correlation coefficient = 0.86); and meta-analysis from 7 trials (pooled Spearman's correlation coefficient = 0.84 [p = 0.0001; 95% CIs 0.71, 0.96]).
Conclusions: In this retrospective analysis PFS2 strongly correlates with OS supporting the use of PFS2 to measure long-term clinical benefit when OS cannot be assessed.
Introduction
Overall survival (OS) is recognized as the definitive endpoint in oncology clinical trials. However, time for OS data to mature can be protracted, costly, and delay effective treatments (1). Progression-free survival (PFS) is seen before OS (2, 3), but often PFS does not correlate with OS because of subsequent lines of therapy during the course of cancer treatment (2, 4). The impact of subsequent treatments can mask the effects of first-line treatment such that OS benefits are not always observed in clinical studies despite significant improvements in PFS. Also, occasionally, first line therapies can have short PFS but extend OS by sensitizing tumor cells to second-line agents (5). In contrast, occasionally longer duration of PFS on study treatment is found to correspond to longer OS. In patients with platinum-sensitive, recurrent ovarian cancer, compared with placebo treatment, niraparib significantly extended the median PFS, and this longer PFS was associated with longer median OS (6).
To address these issues, the European Medicines Agency (EMA) encourages the use of the time from randomization to initial experimental therapy to tumor progression on the next line of treatment or death from any cause (PFS2) to evaluate benefit over two lines of treatment (7).
The retrospective analysis included in this report evaluated the strength of correlation between PFS2 and OS in solid tumor oncology trials across multiple tumor types.
Methods
Search Strategy
An electronic literature search of Global Data was conducted for all oncology trials published from January 1, 2000 to August 10, 2018 that included the term PFS2. Global Data consisted of original journal publications, online articles, scientific meeting presentations, 90 clinical trials registries including ClinicalTrials.gov and EuroDACT, and other published reports.
Study Selection
Individual citations were downloaded, and corresponding abstracts and full-text articles were retrieved from PubMed and Google Scholar. Publications were examined by two authors (LC, SM) for the following inclusion criteria: patients had confirmed solid tumors and were receiving treatment; outcomes measured included PFS2 or PFS and time to second progression (TTP2).
Data Extraction
Summary data (registration identifier, and trial acronym), interventions and target population, indication, metastasis; endpoints; definitions of PFS, PFS2, TTP were extracted from cancer clinical trials reporting PFS2 (or PFS + TTP2) and OS. Out of 25 studies, four did not provide consistent definitions of PFS2 or TTP2; median survival times of PFS2 were calculated based on the availability of the medians of PFS and TTP2.
Sensitivity and Publication Bias
The relative influence of each study was evaluated by omitting studies one at a time. Meanwhile, funnel plots were used to visualize the potential publication bias. Begg's and Egger's tests were used to evaluate the asymmetry of the funnel plot (8, 9).
Statistical Analysis
Impute Medians of PFS2
PFS + TTP2 or PFS2 values were combined for different cancer types and treatment arms in our analysis. To compute the median PFS2 from PFS and TTP2, the exponential assumptions were imposed for PFS and TTP2.
Correlation Between PFS2 and OS
To investigate the correlation between PFS2 and OS, numerical and graphical methods were used to summarize and examine the original and imputed data using two methods. The first was based on data reported for 28 study arms in 15 studies. The second was based on randomized multi-arm studies only.
Method 1
Unweighted pooled estimates of PFS2 and OS were computed using median values reported or predicted for each treatment group in the included studies. The Kendall rank coefficient is non-parametric, and often used as a test statistic to establish whether two variables may be regarded as statistically dependent. Here, it is used to measure the correspondence between the ranking of PFS2 and OS. The total number of possible pairings of PFS2 and OS is where n is the size of PFS2 and OS. The Kendall's Tau correlation coefficient is calculated as follows
Kendall's Tau point estimate and 95% CI were used to summarize the correlation based on the pooled randomized controlled trials from all clinical indications together; the Kendall's Tau correlation τ is translated into Pearson's correlation ρ to evaluate the strength of the relationship (10):
Pearson's correlations ranging from 0.3 to 0.5, 0.5 to 0.7 or >0.7 were classified as weak, moderate and strong, respectively.
Method 2
Within each indication represented by a total ≥2 arms across multiple randomized studies, Spearman's rank correlation coefficient was used to assess the dependence between medians of PFS2 and OS (11, 12). Within each indication, Spearman's rank correlation coefficient was used to assess the dependence between PFS2 and OS; subsequent meta-analysis with fixed effect or random effects models (13, 14) was used to compute the pooled correlation of PFS2 and OS in solid tumors. To be more specific, the fixed-effects model assumes that all studies along with their effect sizes stem from a single homogeneous population with underlying correlation of PFS2 and OS being the same; while, random-effects model assumes the effects are different due to tumor types, but from the same distribution. Performing a meta-analysis of correlations is to combine correlations from different studies into one pooled correlation estimate. When pooling correlations, the Fisher's r-to-z transformation for correlation was used to obtain accurate weights Conducting Meta-Analyses in R with the Metafor Package for each study based on the study sample size.
Results
Literature Review
Of the 133 studies identified by the search term PFS2 (Figure 1), 75 did not report efficacy outcomes. Of the 58 that did, 25 were eligible to be screened for PFS, PFS2 (or PFS + TTP2), and OS data. Complete PFS2 and OS data sets were reported in 15 trials, for a total of 3368 patients distributed among 28 individual arms (treatment or control). Seven cancer types (ovarian, gastric, colorectal (CRC), prostate, non-small cell lung (NSCLC), renal and breast) were represented (Table 1). All cancer types except mCRPC were represented by 2 arms. Three cancers (breast, CRC, and NSCLC) that were represented in ≥1 randomized study with ≥2 arms across were included in the meta-analysis.
Correlation of PFS2 and OS
All Studies
The ranges of median PFS2 and OS based on pooled data from all studies are (1.8, 20.2) and (5, 54), respectively, and the Spearman's rank correlation of 0.843 is noted. (Figure 2) A strong positive correlation between PFS2 and OS was confirmed, with a correlation of 0.70 using Kendall's Tau where a value of 0 is no relationship and 1 is a perfect correlation, Kendall's tau = 0.70 corresponds to a Pearson's correlation of 0.86 showing a strong correlation (>0.7) of OS and PFS2 as continuous variables.
Figure 2. Distribution of Raw Data, Ranks and Spearman's Rank Correlation of PFS2 to OS. The scatter plot shows the Spearman's ranks and correlation details between median PFS2 and OS for 28 treatment arms among 7 cancer types. Each color represents a specific cancer type; each dot corresponds to a treatment arm. The X axis numbers represent the median PFS2 in each study in rank order and Y axis median OS for each study also in rank order. The histograms and density curves (blue) show the frequency and distribution of the raw median survival times in PFS2 and OS, respectively.
Single Tumor Types
The correlation between PFS2 and OS was assessed for 6 individual tumor types represented by at least 2 treatment arms. A strong Spearman's rank correlation was observed within each tumor type (Table 2).
Meta-Analysis
A meta-analysis across three tumor types with >1 study and ≥2 trial arms. confirmed the strong correlation of 0.84 between PFS2 and OS (Table 3, Figure 3).
Table 3. Spearman's rank correlation based on pooled data from three tumors (breast, CRC, and NSCLC) with multiple study arms.
Figure 3. Funnel plot for publication bias analysis of the correlation between PFS2 and OS using the random effect model. This funnel plot is based on the three cancer types investigating the correlation between PFS2 and OS in meta-analysis. The X-axis stands for the correlation and the Y-axis is the standard error for each of the studies. Begg's and Egger's tests were used to evaluate the asymmetry of the funnel plot.
Sensitivity and Publication Bias Analysis
By excluding any one study, we identified that the combined correlation between PFS2 and OS was still strong and did not vary substantially. To create a visual representation, a funnel plot was created showing the estimated correlation (plotted on the horizontal axis) vs. the reciprocal of its standard error (plotted on the vertical axis). As seen in Figure 3, there appears to be a slight asymmetry of the funnel plot and the published findings are close and scattered on either side of the funnel plot suggesting small systematic bias. However, despite this potential bias all the data show effects of strong correlation in the same direction. Moreover, Begg's, and Egger's tests, other standard formal tests for the presence of publication bias that avoid subjective interpretation as required for the funnel plot, showed no significant publication bias for the model (Begg's test, P = 0.3333 and Egger's test, P = 0.2626).
Discussion
To our knowledge, this is the first publication to evaluate the correlation between PFS2 and OS in multiple solid tumor types. We found a strong correlation across all 15 studies and 28 study arms with Kendall's Tau correlation coefficient of 0.70 and a Pearson's correlation of 0.9 among randomized trials. A strong correlation was also observed, on meta-analysis of data from three indications represented by a total of ≥3 arms in multiple randomized trials (Spearman's rank correlation of 0.84). The consistently robust correlations observed in individual tumor types as well as pooled data from multiple indications suggest that in the absence of OS data, PFS2 can provide reassurance that treating with an experimental agent first followed by a second therapy is better than treating with standard of care therapy followed by second therapy. The observation underscores the importance of early treatment with active therapy that results in a sustained clinical benefit even after discontinuing the experimental therapy.
The clinical studies included in our analysis (Table 1) demonstrated median OS <5 yrs. However, treatment of early stage malignant diseases may improve survival beyond 10 years (31–34), and in such cases there is an unmet need to use endpoints like PFS2 that indicate/predict (potential) long term benefit. In the past many trials could not be implemented until the OS data matured as a result these therapies took years to benefit patients.
Moreover, in studies where results may be biased by factors that affect the next treatment in a sequence, PFS2 may be a more accurate measure of treatment benefit than PFS1. This possibility was tested in a recent analysis of data from PROREPAIR-B that included 419 patients with mCRPC with or without DNA repair germline mutations. PFS2 was significantly associated with OS, whether the PFS2 was clinical, radiographic or biochemical and was a better indicator of treatment benefit than PFS (35).
Analysis of correlations within indications as well as pooled data from multiple tumor types is strength of this analysis. Moreover, the population represented comprised 3,368 patients and seven indications. We found no evidence of publication bias. However, it is important to acknowledge that PFS2 can only be evaluated for patients who initiate a second treatment on study.
This analysis has several limitations that require caution in interpreting and generalizing the results. The results are based on trial level data rather than individual patient level data. The need to impute missing data is a limitation as is the variability introduced by differences in treatments and trial designs across studies.
Also, several questions regarding the correlation between PFS2 and OS are not addressed by this analysis and may warrant further investigation. Although we found a strong correlation across multiple tumor types and different treatments, factors such as the position of a specific study treatment in the sequence of therapies as well as any treatment-free interval between agents may affect the correlation. Lastly, we cannot rule out the possibility that the extent of the relationship between PFS2 and OS may vary among tumor types and therapies, especially in the rapidly evolving treatment landscape.
Conclusions
A strong correlation was found between PFS2 and OS in multiple solid tumor clinical trials. These findings warrant further analysis to determine whether PFS2 is an appropriate surrogate endpoint for OS.
Data Availability Statement
All datasets presented in this study are included in the article/supplementary material.
Author Contributions
All authors participated in conception and design of this work, acquisition and collection of data, analysis of data, and participated in writing and reviewing this manuscript.
Conflict of Interest
SC has a consulting/advisory relationship with Astellas Pharma, Bayer, Beigene, Clovis Oncology, Janssen Pharmaceuticals, and Pfizer; is a scientific advisory board member for Janssen Pharmaceuticals and Pfizer; has received honoraria from Clovis Oncology and Novartis; and has received research funding from Clovis Oncology and Sanofi/Aventis. AG is employed by and has ownership interests in IDEA Pharma; and has a consulting/advisory relationship with Pfizer and Janssen Pharmaceuticals. PM is employed by, has ownership interests in, and is an intellectual property rights/inventor/patent holder for XING Technologies P/L; and has received honoraria from Pfizer and Janssen Pharmaceuticals. EP is employed by and has ownership interests in IDEA Pharma; has ownership interests in Pfizer; and has a consulting/advisory relationship with Janssen Pharmaceuticals, Inc. The authors declare that this study received funding from Janssen Research and Development. SM, MW, and LZ are employed by (and have ownership interests in) Janssen R&D and were involved in all aspects of the review, statistical analysis, and manuscript preparation. This funding also supported a portion of the data search and editorial support.
Acknowledgments
Editorial assistance was provided by Ann C. Sherwood, Ph.D.
References
1. Kogan AJ, Haren M. Translating cancer trial endpoints into the language of managed care. Biotechnol Healthc. (2008) 5:22–35.
2. Booth CM, Eisenhauer EA. Progression-free survival: meaningful or simply measurable? J Clin Oncol. (2012) 30:1030–3. doi: 10.1200/JCO.2011.38.7571
3. Prentice RL. Surrogate endpoints in clinical trials: definition and operational criteria. Stat Med. (1989) 8: 431–40. doi: 10.1002/sim.4780080407
4. Kantoff PW, Higano CS, Shore ND, Berger ER, Small EJ, Penson DF, et al. Sipuleucel-T immunotherapy for castration-resistant prostate cancer. N Engl J Med. (2010) 363:411–22. doi: 10.1056/NEJMoa1001294
5. Khalaf DJ, Annala M, Taavitsainen S, Finch DL, Oja C, Vergidis J, et al. Optimal sequencing of enzalutamide and abiraterone acetate plus prednisone in metastatic castration-resistant prostate cancer: a multicentre, randomised, open-label, phase 2, crossover trial. Lancet Oncol. (2019) 20:1730–9. doi: 10.1016/S1470-2045(19)30688-6
6. Mirza MR, Monk BJ, Herrstedt J, Oza AM, Mahner S, Redondo A, et al. Niraparib maintenance therapy in platinum-sensitive, recurrent ovarian cancer. N Engl J Med. (2016) 375:2154–64. doi: 10.1056/NEJMoa1611310
7. European Medicinces Agency. Available online at: https://www.ema.europa.eu/en/documents/scientific-guideline/guideline-evaluation-anticancer-medicinal-products-man-revision-5_en.pdf (accessed March 31, 2020).
8. Begg CB, Mazumdar M. Operating characteristics of a rank correlation test for publication bias. Biometrics. (1994) 50:1088–101. doi: 10.2307/2533446
9. Egger M, Davey Smith G, Schneider M, Minder C. Bias in meta-analysis detected by a simple, graphical test. BMJ. (1997) 315:629–34. doi: 10.1136/bmj.315.7109.629
12. DerSimonian RL, Laird N. Meta-analysis in clinical trials. Controlled Clinical Trials. (1986) 7:177–88. doi: 10.1016/0197-2456(86)90046-2
13. Field AP. Meta-analysis of correlation coefficients: a Monte Carlo comparison of fixed- and random-effects methods. Psychol Methods. (2001) 6:161–80. doi: 10.1037/1082-989X.6.2.161
14. Viechtbauer W. Conducting meta-analyses in R with the metafor package. J Stat Softw. (2010) 36:1–48. doi: 10.18637/jss.v036.i03
15. Tezuka T, Hamada C, Ishida H, Ooshiro M, Matsuoka H, Kawasaki S, et al. Phase II clinical study of modified FOLFOX7 (intermittent oxaliplatin administration) plus bevacizumab in patients with unresectable metastatic colorectal cancer-CRAFT study. Invest New Drugs. (2013) 31:1321–9. doi: 10.1007/s10637-013-9982-3
16. ClinicalTrials.gov. Available online at: https://clinicaltrials.gov/ct2/show/NCT02000622?term=OlymPiad&draw=2&rank=1
17. Drooger JC, van Tinteren H, de Groot SM, Ten Tije AJ, de Graaf H, Portielje JE, et al. A randomized phase 2 study exploring the role of bevacizumab and a chemotherapy-free approach in HER2-positive metastatic breast cancer: The HAT study (BOOG 2008-2003), a Dutch Breast Cancer Research Group trial. Cancer. (2016) 122:2961–70. doi: 10.1002/cncr.30141
18. Goey KKH, Elias SG, van Tinteren H, Laclé MM, Willems SM, Offerhaus GJA, et al. Maintenance treatment with capecitabine and bevacizumab versus observation in metastatic colorectal cancer: updated results and molecular subgroup analyses of the phase 3 CAIRO3 study. Ann Oncol. (2017) 28:2128–34. doi: 10.1093/annonc/mdx322
19. Shitara K, Yamanaka T, Denda T, Tsuji Y, Shinozaki K, Komatsu Y, et al. REVERCE: randomized phase II clinical trial of regorafenibfollowed by cetuximab versus the reverse sequence for metastatic colorectal cancerpreviously treated with fluoropyrimidine, oxaliplatin, and irinotecan. J Clinic Oncol. (2018) 36:557. doi: 10.1200/JCO.2018.36.4_suppl.557
20. Scicinski J, Fisher G, Carter C, Cho-Phan C, Kunz P, Ning S, et al. The development of RRx-001, a novel nitric oxide mediated, epigenetically activated active anticancer agent. Redox Biol. (2015) 5:422. doi: 10.1016/j.redox.2015.09.035
21. Li Q, Jiang H, Li H, Xu R, Shen L, Yu Y, et al. Efficacy of trastuzumab beyond progression in HER2 positive advanced gastric cancer: a multicenter prospective observational cohort study. Oncotarget. (2016) 7:50656–65. doi: 10.18632/oncotarget.10456
22. Miyake H, Hara T, Tamura K, Sugiyama T, Furuse H, Ozono S, et al. Comparative assessment of efficacies between 2 alternative therapeutic sequences with novel androgen receptor-axis-targeted agents in patients with chemotherapy-naive metastatic castration-resistant prostate cancer. Clin Genitourin Cancer. (2017) 15:e591–7. doi: 10.1016/j.clgc.2016.12.015
23. Cortot A, Audigier Valette C, Molinier O, Le Moulec S, Barlesi F, Zalcman G, et al. Prolonged OS of patients exposed to weekly paclitaxel and bevacizumab: impact of the cross-over in the IFCT-1103 ULTIMATE Study. J Thoracic Oncol. (2017) 12:S284–5. doi: 10.1016/j.jtho.2016.11.288
24. Clinicaltrials.org. Available online at: https://clinicaltrials.gov/ct2/show/results/NCT01351415?term=NCT01351415&rank=1§=X870156#outcome2 (accessed March 31, 2020).
25. Park K, Yu CJ, Kim SW, Lin MC, Sriuranpong V, Tsai CM, et al. First-line erlotinib therapy until and beyond response evaluation criteria in solid tumors progression in asian patients with epidermal growth factor receptor mutation-positive non-small-cell lung cancer: the ASPIRATION study. JAMA Oncol. (2016) 2:305–12. doi: 10.1001/jamaoncol.2015.4921
26. Reck M, Rodriguez-Abreu D, Robinson AG, Hui R, Csoszi T, Fülöp A, et al. Pembrolizumab versus chemotherapy for PD-L1-positive non-small-cell lung cancer. N Engl J Med. (2016) 375:1823–33. doi: 10.1056/NEJMoa1606774
27. Brahmer JR, Rodriguez-Abreu D, Robinson AG, Hui R, Csõszi T, Fülöp A, et al. Progression after the next line of therapy (PFS2) and updated OS among patients (pts) with advanced NSCLC and PD-L1 tumor proportion score (TPS) ≥50% enrolled in KEYNOTE-024. J Clinic Oncol. (2017) 35(15_suppl):9000. doi: 10.1200/JCO.2017.35.15_suppl.9000
28. Barlesi F, Zalcman G, Dumont P, Pouessel D, Poulet C, Hiret S, et al. A phase II study assessing the benefit of cisplatin re-introduction (stop and go strategy) in patients with advanced non-squamous non-small cell lung cancer (NSCLC): The IFCT-1102 BUCiL study (a Better Use of Cisplatin in Lung cancer). J Clinc Oncol. (2016) 34 (15_suppl), 9077. doi: 10.1200/JCO.2016.34.15_suppl.9077
29. Monk BJ, Sill MW, Walker JL, Darus CJ, Sutton G, Tewari KS, et al. Randomized phase II evaluation of bevacizumab versus bevacizumab plus fosbretabulin in recurrent ovarian, tubal, or peritoneal carcinoma: an NRG Oncology/Gynecologic Oncology Group Study. J Clin Oncol. (2016) 34: 2279–86. doi: 10.1200/JCO.2015.65.8153
30. Cirkel GA, Hamberg P, Sleijfer S, Loosveld OJL, Dercksen MW, Los M, Pet al. Alternating treatment with pazopanib and everolimus vs continuous pazopanib to delay disease progression in patients with metastatic clear cell renal cell cancer: the ROPETAR Randomized Clinical Trial. JAMA Oncol. (2017) 3:501–8. doi: 10.1001/jamaoncol.2016.5202
31. Shipley WU, Seiferheld W, Lukka HR, Major PP, Heney NM, Grignon DJ, et al. Radiation with or without antiandrogen therapy in recurrent prostate cancer. N Engl J Med. (2017) 376:417–28. doi: 10.1056/NEJMoa1607529
32. Jones CU, Hunt D, McGowan DG, Amin MB, Chetner MP, Bruner DW, et al. Radiotherapy and short-term androgen deprivation for localized prostate cancer. N Engl J Med. (2011) 365:107–18. doi: 10.1056/NEJMoa1012348
33. Hamdy FC, Donovan JL, Lane JA, Mason M, Metcalfe C, Holding P, et al. 10-year outcomes after monitoring, surgery, or radiotherapy for localized prostate cancer. N Engl J Med. (2016) 375:1415–24. doi: 10.1056/NEJMoa1606220
34. Blondeaux E, Lambertini M, Michelotti A, Conte B, Benasso M, Dellepiane C, et al. Dose-dense adjuvant chemotherapy in early breast cancer patients: 15-year results of the Phase 3 Mammella InterGruppo (MIG)-1 study. Br J Cancer. (2020) 122:1611–7. doi: 10.1038/s41416-020-0816-8
Keywords: PFS2, OS, second disease progression, surrogate clinical endpoint, time to progression on second therapy
Citation: Chowdhury S, Mainwaring P, Zhang L, Mundle S, Pollozi E, Gray A and Wildgust M (2020) Systematic Review and Meta-Analysis of Correlation of Progression-Free Survival-2 and Overall Survival in Solid Tumors. Front. Oncol. 10:1349. doi: 10.3389/fonc.2020.01349
Received: 27 May 2020; Accepted: 26 June 2020;
Published: 14 August 2020.
Edited by:
Attila A. Seyhan, Brown University, United StatesReviewed by:
Guru Sonpavde, Dana–Farber Cancer Institute, United StatesFabrizio Martelli, Istituto Superiore di Sanità (ISS), Italy
Copyright © 2020 Chowdhury, Mainwaring, Zhang, Mundle, Pollozi, Gray and Wildgust. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Simon Chowdhury, c2ltb24uY2hvd2RodXJ5JiN4MDAwNDA7Z3N0dC5uaHMudWs=