- 1School of General Practice and Continuing Education, Capital Medical University, Beijing, China
- 2Department Clinical Research, University of Bern, Bern, Switzerland
- 3Center of Stroke, Beijing Institute for Brain Disorders, Capital Medical University, Beijing, China
Background: Comprehensive evidence comparing treatment-related adverse events (trAEs) among PD-1/PD-L1 inhibitors is unavailable.
Methods: A systematic review and network meta-analysis (NMA) was conducted. Randomized controlled trials in cancer patients treated with PD1/PD-L1 inhibitors or their combinations with chemotherapy/placebo and compared with PD1/PD-L1 inhibitors/chemotherapy/placebo were identified through comprehensive searches of multiple databases. Bayesian NMA was performed using random-effects model. Relative ranking of treatments was assessed with surface under the cumulative ranking (SUCRA) probabilities. Incidences and odds ratios of trAEs and immune-related adverse events (irAEs) of all-grade (Grade 1–5) and high-grade (Grade 3–5) were estimated.
Results: Twenty-three RCTs (14,204 patients) comparing six different strategies were included. The incidence of trAEs was lowest for PD-L1 inhibitors (all-grade: pooled incidence = 60.4%, SUCRA = 77.2%; high-grade: 6.4, 73.8%). PD-L1 inhibitors plus chemotherapy had the highest incidence of all-grade trAEs (88.6, 10.1%), while PD-1 inhibitors plus chemotherapy had the highest incidence of high-grade trAEs (8.2, 9.3%). The use of PD-1/PD-L1 inhibitors alone was associated with significant reductions on high-grade trAEs, compared with PD-1/PD-L1 inhibitors plus chemotherapy. PD-1 inhibitors had the highest incidence of irAEs (all-grade: 15.1, 9.5%; high-grade: 3.5, 16.8%). Compared with PD-L1 inhibitors, PD-1 inhibitors neither increased trAEs nor irAEs significantly. Results from sensitivity analyses were consistent.
Conclusions: Current data showed that PD-L1 inhibitors had the best safety on both trAEs and irAEs. Awareness of the comparative safety could promote further appropriate utilization of PD-1/PD-L1 inhibitors in clinical practice.
Introduction
Programmed cell death 1 (PD-1) and programmed cell death ligand 1 (PD-L1) inhibitors have shown clinical activity and marked efficacy in metastatic cancer therapy (1–6). Over recent years, many PD-1/PD-L1 inhibitors have been approved by Food and Drug Administration (FDA). For example, nivolumab and pembrolizumab (both PD-1 inhibitors) were approved for non-small cell lung cancer (NSCLC) and metastatic melanoma treatment (7–10). Atezolizumab and durvalumab were approved for NSCLC and urothelial carcinoma treatment (11–14). These regulatory approvals have resulted in a widespread prescribing of PD-1/PD-L1 inhibitors in real-world clinical practice. However, PD-1/PD-L1 inhibitors could disrupt normal immune tolerance mechanisms, thus lead to immune-related adverse events (irAEs) and other treatment-related adverse events (trAEs) (15–18).
The improvements in marked clinical efficacy should be balanced against the potentially serious or life-threatening adverse events when choosing among different therapeutic regimens. It is important for clinicians to be fully aware of the treatment-related risks and to better manage cancer treatment. To date, numerous randomized controlled trials (RCTs) have been conducted to investigate the efficacy and safety profiles of PD-1/PD-L1 inhibitors (2, 5, 6, 19–23). However, RCTs that are not prospectively designed with the particular safety outcome as a primary endpoint may not have sufficient sample size to detect important trAEs and irAEs. Thus, they would lack more convincing statistical power or could not reliably evaluate the potentially increased risks caused by PD-1/PD-L1 inhibitors. Moreover, head-to-head RCT, that compares PD-1/PD-L1 inhibitors against one another, is not available (24). Comparative trAEs and irAEs among different PD1/PD-L1 inhibitor-related therapeutic regimens have never been systematically studied.
Structured evidence on treatment-related safety of PD1/PD-L1 inhibitors would be necessary for clinicians in making clinical decisions. In this study, we carried out a systematic review and network meta-analysis (NMA) to compare the safety on trAEs and irAEs among different types of PD1/PD-L1 inhibitor-related therapeutic regimens simultaneously for cancer patients.
Methods
Study Design
This network meta-analysis was reported according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines (25, 26). A priori established review protocol was followed when this study was conducted. The review protocol was not registered.
Search Strategy and Selection Criteria
PubMed and Embase databases were systematically searched up to April 17th 2019 using the combinations of the following terms: (neoplasia OR malignancy OR melanoma) AND (nivolumab OR pembrolizumab OR lambrolizumab OR avelumab OR atezolizumab OR durvalumab OR “programmed cell death 1 receptor” OR “programmed cell death 1 ligand 1”) AND (random OR control OR placebo). The detailed search strategies are listed in Supplementary Table 1. There was no restriction on language or year of publication. We manually checked reference lists of related review articles and published trials to identify additional studies.
Studies were selected when they met the following inclusion criteria: (1) either PD-1 inhibitors (i.e., nivolumab, pembrolizumab) or PD-L1 inhibitors (i.e., atezolizumab, avelumab, durvalumab), alone or in combination with chemotherapy/placebo, were included in at least one of the treatment arms; (2) either PD-1/PD-L1 inhibitors, chemotherapy or placebo were included in the control arms; (3) treatment-related and/or immune-related adverse events were reported; (4) phase II or III RCTs. We excluded: (1) studies only in conference abstracts or posters form or presentations of ongoing trials; (2) study protocols, review, or commentary; (3) in vitro or animal studies; (4) studies which only involved quality-of-life outcomes or cost effectiveness analyses. Two investigators (HY, FH) selected the potentially eligible studies independently. The titles, abstracts, and full texts were evaluated sequentially.
Data Extraction
Two independent investigators (HY and FH) extracted the data from all the eligible studies. The following information was extracted: trial name, line of treatment, study phase, blinding, median age (range), sex, tumor type, types, and dosage of drugs, number of patients in each randomization arm, median length of follow-up, number of patients in the safety dataset, number of patients with high-grade (grade 3–5) and all-grade (grade 1–5) treatment-related adverse events (trAEs), number of patients with high-grade and all-grade immune-related adverse events (irAEs). When more than one article reported the same outcome, we used the most updated data.
Quality Assessment
The risk of bias was assessed independently by two authors (HY and FH) using Review Manager 5.3 software. The following domains were assessed: random sequence generation (selection bias), allocation concealment (selection bias), blinding of participants, and personnel (performance bias), blinding of outcome assessment (detection bias), incomplete outcome data (attrition bias), selective reporting (reporting bias), and other bias (27).
The Grading of Recommendations Assessment, Development, and Evaluation system (GRADE) approach was used to rate the quality of evidence (28). The four levels of evidence quality including high, moderate, low, and very low. The quality of evidence for each outcome was based on the fundamental study design and additional methodological factors.
Outcome Measures
The term immune-related adverse events (irAEs) would not be appropriate to describe the chemotherapy toxicity. Therefore, treatment-related adverse events (trAEs) of both all-grade and high-grade were selected as the primary outcomes. The term trAEs was defined as all the adverse events that deemed to be treatment-related toxicities, based on the reporting of each original trial. The adverse events that were not described in the original trials as treatment-related were excluded. To avoid selective reporting, irAEs of both all-grade and high-grade were reported as the secondary outcomes. All the trAEs that deemed to be possible immune-related toxicities were irAEs. The all-grade and high-grade adverse events were defined as Grade 1–5 and Grade 3–5 adverse events, respectively, based on the National Cancer Institute Common Terminology Criteria for Adverse Events version 4.0.
Data Synthesis and Statistical Analysis
Traditional pairwise meta-analyses were calculated using DerSimonian-Laird random-effects model since they were more conservative to deal with heterogeneity (29, 30). The summary effect sizes were presented as pooled odds ratio (OR) and 95% confidence intervals (CIs), with regard to the all-grade and high-grade trAEs and irAEs, respectively. A two-sided p < 0.05 or 95% CIs (excluding one) was regarded as statistically significant. We used the Cochrane Q statistic and quantified with I2 statistics to evaluate the heterogeneity among studies. An I2 value over 50% indicated substantial heterogeneity. Publication bias was examined using funnel plots (31).
NMA were performed based on Bayesian framework using a Markov Chain Monte Carlo (MCMC) simulation technique. The posterior distribution of all parameters was estimated using non-informative priors (32). The MCMC model was updated with 100,000 simulated draws after a burn-ins of 20,000 iterations and used a thinning interval of 10 for each chain. The adequacy of burn-in and convergence were assessed using the Brooks-Gelman-Rubin statistic (33). We reported the relative adverse effects of treatments as OR along with corresponding 95% credible intervals (Crls). Random-effects model was used since they generally showed better goodness of fit. Relative risks (RRs) and corresponding 95% CrIs were also calculated to estimate the incidence of trAEs and irAEs for each treatment (Incidence = 100 × assumed placebo risk × RR, the assumed placebo risk was generated by using traditional meta-analyses with random-effects model).
We calculated the posterior mean of the residual deviance to determine goodness of fit of the models. Ideally, each data point should contribute about one to the posterior mean of the residual deviance. It can be compared with the number of data points for model fit checking.
The median ranks and surface under the cumulative ranking curve (SUCRA) were estimated for all the arms and to obtain the hierarchy of safety. SUCRA was the percentage of drug safety on the adverse events that would be ranked first without uncertainty. When the drug safety is certain to be the best, the SUCRA value equals one. It equals zero when the safety is certain to be the worst (34).
Since consistency (defined as agreement) between direct and indirect results is the key to robust results, the presence of inconsistency was first evaluated by node splitting analysis in the entire network on particular comparisons (35, 36). Then we used the loop-specific approach to evaluate the presence of inconsistency in each loop (37). We calculated the values of two odds ratios (RoR) from direct and indirect evidence with 95% CI. P-value of <0.05 was regarded as significant inconsistency.
Meta-regression analyses were performed by adding pre-specified covariates (i.e., median age, percentage of male, line of treatment, tumor histology, whether double-blind design was used) to the network meta-analysis models. Sensitivity analyses were performed based on phase III trials only to evaluate the robustness of results. Subgroup analyses were conducted based on type of cancer (NSCLC and melanoma) and line of treatment (first-line, second, or higher line). The data analyses were conducted using STATA version 14.0 and WinBUGs version 1.4.3.
Results
Selection of Trials
Literature search initially identified 4,274 unduplicated articles, 4,217 of which were excluded after review of titles and abstracts. A total of 57 full-text articles were assessed for eligibility. Finally, 27 articles including 23 randomized controlled trials (RCTs) were included for quantitative synthesis (Figure 1) (1–6, 19–23, 38–53).
Characteristics of Trials and Patients
The 23 RCTs covered six treatment strategies and involved a total of 14,204 patients with cancer in the safety data set (Figure 2). Of the 23 included RCTs, 12 studied first-line treatment. Eight were phase III trials with double-blind design. Cancer types investigated included lung cancer (13), melanoma (4), gastric or gastro-esophageal junction cancer (2), urothelial carcinoma (2), breast cancer (1), head and neck carcinoma (1). PD-1 inhibitor (anti-PD-1) and PD-L1 inhibitor (anti-PD-L1) were evaluated in 17 and 6 trials, respectively. The baseline characteristics of included trials are listed in Table 1. The risk of bias summary for included trials is listed in Supplementary Table 2.
Figure 2. Network plots of eligible comparisons for the Bayesian network meta-analysis. The size of the nodes is proportional to the number of patients (in parentheses) randomized to receive the treatment. The width of the lines is proportional to the number of comparisons (beside the line) comparing the connected treatment (nodes). A total of 23 comparisons were analyzed for treatment-related adverse events (A); a total of 11 comparisons were analyzed for immune-related adverse events (B).
Table 1. Characteristics of included trials (27 articles including 23 randomized controlled trials).
Treatment-Related Adverse Events (trAEs)
Results of pairwise meta-analyses showed that anti-PD-L1 plus chemotherapy was associated with increased all-grade trAEs compared with using chemotherapy alone (OR = 1.74, 95% CI: 1.06–2.88), with high quality of evidence. However, anti-PD-L1 monotherapy was associated with a significant reduction in trAEs compared with chemotherapy (all-grade: OR = 0.29, 95% CI: 0.23–0.35; high-grade: OR = 0.26, 95% CI: 0.20–0.34), with moderate quality of evidence. Compared with placebo, both anti-PD-1 and anti-PD-L1 were associated with significantly increased high-grade trAEs, with moderate to high quality of evidence (Supplementary Tables 3, 4).
Median ranks on treatment-related safety from high to low were: placebo, anti-PD-L1, anti-PD-1, chemotherapy, anti-PD-1 plus chemotherapy, anti-PD-L1 plus chemotherapy for all-grade trAEs; placebo, anti-PD-L1, anti-PD-1, chemotherapy, anti-PD-L1 plus chemotherapy, anti-PD-1 plus chemotherapy for high-grade trAEs (Supplementary Table 5). Pooled all-grade and high-grade incidences of trAEs were, respectively, 48.9 and 4.3% for placebo, 60.4 and 6.4% for anti-PD-L1, 65.7 and 6.6% for anti-PD-1, 82.8 and 8.0% for chemotherapy, 87.4 and 8.2% for anti-PD-1 plus chemotherapy, 88.6 and 8.1% for anti-PD-L1 plus chemotherapy.
Results from NMA and SUCRA suggested that, compared with placebo, anti-PD-L1 monotherapy did not increase trAEs significantly (all-grade: OR = 1.62, 95% CrI: 0.85–3.06, SUCRA = 77.2%; high-grade: OR = 2.95, 95% CrI: 1.23–7.07, SUCRA = 73.8%). However, anti-PD-L1 plus chemotherapy had the worst safety on all-grade trAEs (all-grade: OR = 9.62, 95% CrI: 3.60–25.81, SUCRA = 10.1%. Anti-PD-1 plus chemotherapy had the worst safety on high-grade trAEs (OR = 15.52, 95% CrI: 4.90–49.65, SUCRA = 9.3%), with moderate to high quality of evidence (Figures 3A, 4A, Supplementary Table 4).
Figure 3. Bayesian network meta-analysis of treatment-related and immune-related adverse events. Comparisons should be read from the top treatment to the bottom treatment. Bold underline cells are significant. Results represent pooled odds ratios and 95% credible intervals for treatment-related adverse events (A) and immune-related adverse events (B). Odds ratio >1 favors the bottom treatment.
Figure 4. Cluster SUCRA ranking plots and incidence. (A) Cluster SUCRA ranking plot for safety on all-grade and high-grade trAEs (x-axis: SUCRA ranking for safety on high-grade trAEs; y-axis: SUCRA ranking for safety on all-grade trAEs) and incidence. (B) Cluster SUCRA ranking plot for safety on all-grade and high-grade irAEs (x-axis: SUCRA ranking for safety on high-grade irAEs; y-axis: SUCRA ranking for safety on all-grade irAEs) and incidence. For trAEs and irAEs, higher SUCRA ranking = safer treatment with lower risk of adverse events. Numbers in parenthesis represent 95% CIs derived by replacing the relative risks in the calculation with the lower and upper limits of their respective 95% CrIs. irAEs, immune-related adverse events; trAEs, treatment-related adverse events.
When comparative safety was assessed, anti-PD-L1 and anti-PD-1 were superior to all other treatments (not include placebo) for the safety on high-grade trAEs. Anti-PD-L1 and anti-PD-1 were comparable with each other for trAEs (all-grade: OR = 1.26, 95% CrI: 0.74–2.17; high-grade: OR = 1.15, 95% CrI: 0.58–2.29), both with high quality of evidence. When combined with chemotherapy, anti-PD-L1 and anti-PD-1 were also comparable with each other for trAEs (all-grade: OR = 0.88, 95% CrI: 0.15–5.55; high-grade: OR = 1.47, 95% CrI: 0.30–7.30), with high quality of evidence (Figure 3A, Supplementary Table 4).
Immune-Related Adverse Events (irAEs)
Results of pairwise meta-analyses showed that both anti-PD-1 and anti-PD-L1 and their combination with chemotherapy were associated with increased all-grade irAEs compared with using chemotherapy alone, with low to high quality of evidence. Compared with placebo, anti-PD-1 was associated with increased high-grade irAEs (OR = 12.66, 95% CI: 3.87–41.38, with moderate quality of evidence), whereas anti-PD-L1 was not (OR = 1.10, 95% CI: 0.49–2.45, with moderate quality of evidence; Supplementary Tables 3, 4).
Median ranks on immune-related safety from high to low were: placebo, chemotherapy, anti-PD-L1, anti-PD-L1 plus chemotherapy, anti-PD-1 plus chemotherapy, anti-PD-1 for both all-grade and high-grade irAEs (Supplementary Table 5). Pooled all-grade and high-grade incidences of irAEs were, respectively, 11.6 and 2.4% for chemotherapy, 13.3 and 2.8% for anti-PD-L1, 13.9 and 3.0% for anti-PD-L1 plus chemotherapy, 14.9 and 3.2% for anti-PD-1 plus chemotherapy, 15.1 and 3.5% for anti-PD-1.
Results from NMA suggested that, compared with placebo, anti-PD-1 monotherapy increased all-grade irAEs significantly (all-grade: OR = 6.60, 95% CrI: 2.94–15.67, SUCRA = 9.5%; high-grade: OR = 6.36, 95% CrI: 0.74–66.54, SUCRA = 16.8%), with moderate to high quality of evidence (Figures 3B, 4B, Supplementary Table 4).
When comparative safety was assessed, compared with chemotherapy, anti-PD-1 was associated with increased all-grade irAEs (OR = 3.30, 95% CrI: 1.93–6.32), whereas anti-PD-L1 was not (OR = 1.64, 95% CrI: 0.74–3.89). However, both were with low quality of evidence. Compared with chemotherapy, anti-PD-1 plus chemotherapy was associated with increased all-grade irAEs (OR = 2.95, 95% CrI: 1.52–5.51, with low quality of evidence), whereas anti-PD-L1 plus chemotherapy was not (OR = 1.94, 95% CrI: 0.98–3.95, with high quality of evidence). Anti-PD-L1 and anti-PD-1 were comparable with each other for irAEs (all-grade: OR = 2.01, 95% CrI: 0.84–5.09; high-grade: OR = 2.84, 95% CrI: 0.29–33.13), with high quality of evidence. When combined with chemotherapy, anti-PD-L1 and anti-PD-1 were also comparable with each other for irAEs (all-grade: OR = 1.52, 95% CrI: 0.57–3.78; high-grade: OR = 1.53, 95% CrI: 0.07–31.33), with high quality of evidence (Figure 3B, Supplementary Table 4).
Model Fit, Inconsistence Check, and Quality of Evidence
The model fit was evaluated using the posterior mean of the residual deviance, which was 42 and 43 for trAEs of all-grade and high-grade, respectively, and was 20 and 19 for irAEs of all-grade and high-grade, respectively. The model's overall fit was relatively satisfactory. Inconsistence check showed that neither node splitting analysis nor loop-specific approach showed significant inconsistency between direct and indirect results, which indicated robust results (Supplementary Tables 6, 7). Supplementary Table 4 summarized the quality of evidence using GRADE framework for the outcomes. Overall, there was no inconsistency of results, indirectness or publication bias. In several direct comparisons, study limitations existed since lack of blinding. In NMA, three comparisons had serious imprecision in summary estimate.
Reporting Bias, Sensitivity Analyses, and Meta-Regression
Supplementary Figure 1 presents the adjusted funnel plot for the network. The funnel plots of all-grade and high-grade of trAEs and irAEs did not show asymmetry, suggesting no potential risk of reporting bias. Sensitivity analyses based on phase III trials did not indicate any major influence on the outcomes (Supplementary Figures 2, 3). Meta-regression analyses did not reveal any pre-specified factors that influenced the estimated effects significantly (Supplementary Table 8).
Subgroup Analyses
Among patients with NSCLC, median ranks on treatment-related safety from high to low were: placebo, anti-PD-L1, anti-PD-1, chemotherapy, anti-PD-1 plus chemotherapy. Median ranks on immune-related safety from high to low were: chemotherapy, anti-PD-1 plus chemotherapy, anti-PD-1 (Supplementary Tables 9, 10). The pooled incidence of trAEs was highest for anti-PD-1 plus chemotherapy (all-grade: 97.0%; high-grade: 10.7%; Supplementary Table 11). Compared with chemotherapy, both anti-PD-1 and anti-PD-L1 were associated with decreased trAEs, whereas anti-PD-1 increased irAEs significantly (Supplementary Table 12).
Among patients with melanoma, median ranks on treatment-related safety from high to low were: placebo, anti-PD-1, chemotherapy (Supplementary Tables 9, 10). For anti-PD-1, the pooled incidence was 85.0 and 5.6% for all-grade and high-grade trAEs, respectively (Supplementary Table 11).
Among patients with first-line treatment, median ranks on treatment-related safety high to low were anti-PD-L1, anti-PD-1, chemotherapy, anti-PD-1 plus chemotherapy, anti-PD-L1 plus chemotherapy. Median ranks on immune-related safety from high to low were: chemotherapy, anti-PD-L1, anti-PD-L1 plus chemotherapy, anti-PD-1 plus chemotherapy, anti-PD-1 (Supplementary Tables 9, 10). The pooled incidence of trAEs was lowest for anti-PD-L1 (all-grade: 37.8%; high-grade 19.0%), whereas anti-PD-1 had the highest irAEs incidence (all-grade: 27.6%; high-grade: 4.5%; Supplementary Table 11). Compared with chemotherapy, anti-PD-1 was associated with decreased trAEs of both all-grade and high-grade. However, anti-PD-1 was associated with increased all-grade irAEs compared with chemotherapy (Supplementary Table 12).
Among patients with second or higher line of treatment, median ranks on treatment-related safety from high to low were: placebo, anti-PD-L1, anti-PD-1, chemotherapy (Supplementary Tables 9, 10). The pooled incidence of all-grade trAEs was 65.6 and 60.5% for anti-PD-1 and anti-PD-L1, respectively (Supplementary Table 11). Compared with chemotherapy, both anti-PD-1 and anti-PD-L1 decreased trAEs significantly (Supplementary Table 12).
Discussion
Summary of Key Findings
This NMA compares all anti-PD1/PD-L1-related therapeutic regimens for cancer patients. There are three key findings. First, anti-PD-L1 monotherapy was ranked the best for safety on trAEs. However, when combined with chemotherapy, both anti-PD-L1 and anti-PD-1 were ranked the worst. Second, anti-PD-L1 monotherapy had the lowest irAEs incidence, whereas anti-PD-1 monotherapy had the highest. However, anti-PD-L1 did not decrease irAEs significantly compared with anti-PD-1. Third, both anti-PD-L1 and anti-PD-1 monotherapy decreased high-grade trAEs significantly compared with using chemotherapy alone or combining chemotherapy with anti-PD-1/anti-PD-L1.
Comparison With Other Studies
One study showed that combinations of conventional therapy with immune checkpoint inhibitors (ICIs) would be associated with increased trAEs compared with taking one ICI drug (17). Another study showed that anti-PD-1 would slightly increase trAEs compared with anti-PD-L1 (54). This NMA agreed with these previous findings. In addition, we calculated the safety ranking on trAEs. We found that anti-PD-L1 monotherapy had the lowest incidences on both trAEs and irAEs among anti-PD-1/anti-PD-L1-related therapeutic regimens.
Xu et al. reported all-grade trAEs incidences of 73.5 and 66.4% for anti-PD-1 and anti-PD-L1, respectively (17). In our study, lower pooled incidence of trAEs was obtained, which was 65.7 and 60.4% for anti-PD-1 and anti-PD-L1, respectively. Xu et al. used all adverse events if trAE was not available (17), whereas we used trAEs data only. Thus, the overall incidence would not be overestimated. Pillai et al. compared irAEs between anti-PD-1 and anti-PD-L1 among patients with NSCLC (54). Both would lead to 3.0% high-grade irAEs incidence. Our study included patients with all types of cancer who showed an incidence of 3.5 and 2.8% for anti-PD-1 and anti-PD-L1, respectively. In addition, we found that anti-PD-1 monotherapy would increase irAEs compared with chemotherapy, whereas anti-PD-L1 monotherapy would not. Compared with placebo, all the anti-PD-1/anti-PD-L1-related therapeutic regimens would increase all-grade irAEs, but not high-grade irAEs.
Strength and Limitations of Study
This NMA fills a crucial knowledge gap regarding the comparative risks of both trAEs and irAEs among PD-1/PD-L1 inhibitors and their combination with chemotherapy. However, four limitations should be noted. First, each individual drug would have its distinct toxicity profile. However, data analyses in this study were performed by classifying drugs according to the mechanism of action rather than analyzing the drugs separately due to a limited number of trials available at this moment so as to avoid yielding very sparse networks. Combining different drugs of the same class within a single category of targeted agent may introduce heterogeneity in the NMA. Nevertheless, the random-effects model was used and the model's overall fit was satisfactory. More original trials are still awaited to explore more about the toxicity profiles for each drug. Second, indirect comparisons from NMA may suffer bias through confounding by study-level characteristics. Results from indirect comparisons should be interpreted with caution as direct comparison is lacking. However, we included RCTs only in this NMA, thus the trial populations and study characteristics were comparable to the target population. Potential confounding factors were further evaluated using meta-regression analyses, which had no major influence on the results. Third, node split analysis showed a P-value of 0.08 in four comparisons of high-grade irAEs. Despite there being no statistical inconsistency, further evidence with outstanding consistency is still needed when more trials are available for these comparisons. Last but not least, immune-related diseases are usually late onset, thus the incidence of irAEs may be underestimated due to limited follow-up time of the included trials.
Clinical and Research Implications
This current study sheds light on the important clinical issue about the comparative safety on both trAEs and irAEs from anti-PD-L1/anti-PD-1-related treatment. Our results demonstrated that anti-PD-L1 was well-tolerated for all cancer patients. A previous study showed that different tumor histologies may have different irAEs profiles (55). In our study, results of meta-regression showed that tumor histology did not influence the estimated effects.
Among patients with NSCLC, Xu et al. stated that nivolumab (anti-PD-1) rather than anti-PD-L1 would be ranked the best for safety on trAEs. However, this finding could be considered with caution in clinical practice. First, PACIFIC study was not included in their analysis (4, 21). We found that anti-PD-L1 monotherapy was still ranked the best for all-grade trAEs if the PACIFIC study was included among NSCLC. Second, we found that among the nivolumab trials available, none of them reported all-grade or high-grade irAEs. It will be interesting to learn how the conclusion changes with more irAEs data being reported. The immune-related safety needs to be investigated further for nivolumab.
There are two research implications. First, the irAEs associated with anti-PD-1/anti-PD-L1 may be distinct. For example, anti-PD-1 agents may have higher risk of immune-related pneumonitis, whereas, anti-PD-L1 agents may have higher hypothyroidism risk (56). More studies should be conducted in the future base on organ specific immune-related adverse events, especially focusing on colitis, hepatitis (aspartate aminotransferase), pneumonitis, hypothyroidism, and rash. Second, in real-world clinical practice, it is still challenging to discern irAEs since adverse events, such like pneumonitis and colitis, may be caused by non-immune-related reactions. In the future, it is important to publish standardized method to specify the clinical criteria for irAEs.
Conclusion
Anti-PD-L1 monotherapy was ranked the best for safety on trAEs, whereas anti-PD-1/anti-PD-L1 plus chemotherapy was ranked the worst. Among the anti-PD-1/PD-L1-related therapeutic regimens, anti-PD-L1 had the best irAEs safety, whereas anti-PD-1 had the worst. Anti-PD-1 did not increase trAEs or irAEs significantly compared with anti-PD-L1. Awareness surrounding the comparative safety of trAEs and irAEs from anti-PD-1/PD-L1-related therapeutic regimens could promote further appropriate utilization of these agents in clinical practice.
Data Availability Statement
All data generated or analyzed during this study are included in this published article.
Author Contributions
YH, WX, and JD: study conception and paper writing. YH and WX: study design and discussion of the findings. YH and HF: data extraction and elaboration. YH, WX, and HF: data analysis and interpretation. YH, WX, HF, and JD: all coauthors have read and approved the manuscript in its present form, agreed to be personally accountable for the author's own contributions and to ensure that questions related to the accuracy or integrity of any part of the work, even ones in which the author was not personally involved, are appropriately investigated, resolved, and the resolution documented in the literature.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Supplementary Material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fonc.2019.00972/full#supplementary-material
Supplementary Figure 1. Comparison—adjusted funnel plot for the network. Adjusted funnel plot for the network for all-grade treatment-related adverse events (A), high-grade treatment-related adverse events (B), all-grade immune-related adverse events (C), and high-grade immune-related adverse events (D). The red line represents the null hypothesis that the study-specific effect sizes do not differ from the respective comparison-specific pooled effect estimates. The blue line is the regression line. Different colors correspond to different comparisons. 01, Placebo; 02, Chemotherapy; 03, anti-PD-L1 plus chemotherapy; 04, anti-PD-L1; 05, anti-PD-1 plus chemotherapy; 06, anti-PD-1 inhibitors.
Supplementary Figure 2. Bayesian network meta-analysis of treatment-related and immune-related adverse events (sensitivity analysis). Comparisons should be read from the top treatment to the bottom treatment. Bold underline cells are significant. Results represent pooled odds ratios and 95% credible intervals for treatment-related adverse events (A) and immune-related adverse events (B). Odds ratio >1 favors the bottom treatment.
Supplementary Figure 3. Cluster SUCRA ranking plots (sensitivity analysis). (A) Cluster SUCRA ranking plot for safety on all-grade and high-grade trAEs (x-axis: SUCRA ranking for safety on high-grade trAEs; y-axis: SUCRA ranking for safety on all-grade trAEs). (B) Cluster SUCRA ranking plot for safety on all-grade and high-grade irAEs (x-axis: SUCRA ranking for safety on high-grade irAEs; y-axis: SUCRA ranking for safety on all-grade irAEs). For trAEs and irAEs, higher SUCRA ranking = safer treatment with lower risk of adverse events. irAEs, immune-related adverse events; trAEs, treatment-related adverse events.
Supplementary Table 1. Search strategies.
Supplementary Table 2. Risk of bias summary.
Supplementary Table 3. Results of traditional pairwise meta-analyses for different outcomes.
Supplementary Table 4. Evaluation of the quality of evidence using GRADE framework for outcomes.
Supplementary Table 5. Median ranks on safety (rank 1–6 on each scale) and 95% CrIs.
Supplementary Table 6. Nodesplit analysis of network meta-analysis for treatment-related adverse events and immune-related adverse events.
Supplementary Table 7. Evaluation of inconsistency using loop-specific heterogeneity estimates.
Supplementary Table 8. Meta-regression for treatment-related adverse events and immune-related adverse events.
Supplementary Table 9. Subgroup analysis: median ranks on safety (rank 1–6 on each scale) and 95% CrIs.
Supplementary Table 10. SUCRA rankings in the subgroup analysis based on type of cancer and line of treatment.
Supplementary Table 11. Pooled incidence along with corresponding 95% credible intervals of treatment based on type of cancer and line of treatment.
Supplementary Table 12. Bayesian network meta-analysis based on type of cancer and line of treatment.
Abbreviations
AEs, adverse events; CIs, confidence intervals; CrIs, credible intervals; FDA, Food and Drug Administration; ICIs, immune checkpoint inhibitors; irAEs, immune-related adverse events; NA, not available; NE, not estimable; NSCLC, non-small cell lung cancer; OR, odds ratio; PD-1, programmed cell death 1; PD-L1, programmed cell death-ligand 1; trAEs, treatment-related adverse events.
References
1. Hamid O, Puzanov I, Dummer R, Schachter J, Daud A, Schadendorf D, et al. Final analysis of a randomised trial comparing pembrolizumab versus investigator-choice chemotherapy for ipilimumab-refractory advanced melanoma. Eur J Cancer. (2017) 86:37–45. doi: 10.1016/j.ejca.2017.07.022
2. Ascierto PA, Long GV, Robert C, Brady B, Dutriaux C, Di Giacomo AM, et al. Survival outcomes in patients with previously untreated BRAF wild-type advanced melanoma treated with nivolumab therapy: three-year follow-up of a randomized phase 3 trial. JAMA Oncol. (2019) 5:187–94. doi: 10.1001/jamaoncol.2018.4514
3. Cohen EEW, Soulieres D, Le Tourneau C, Dinis J, Licitra L, Ahn MJ, et al. Pembrolizumab versus methotrexate, docetaxel, or cetuximab for recurrent or metastatic head-and-neck squamous cell carcinoma (KEYNOTE-040): a randomised, open-label, phase 3 study. Lancet. (2019) 393:156–67. doi: 10.1016/s0140-6736(18)31999-8
4. Antonia SJ, Villegas A, Daniel D, Vicente D, Murakami S, Hui R, et al. Overall survival with durvalumab after chemoradiotherapy in stage III NSCLC. N Engl J Med. (2018) 379:2342–50. doi: 10.1056/NEJMoa1809697
5. Horn L, Mansfield AS, Szczesna A, Havel L, Krzakowski M, Hochmair MJ, et al. First-line atezolizumab plus chemotherapy in extensive-stage small-cell lung cancer. N Engl J Med. (2018) 379:2220–9. doi: 10.1056/NEJMoa1809064
6. Schmid P, Adams S, Rugo HS, Schneeweiss A, Barrios CH, Iwata H, et al. Atezolizumab and nab-paclitaxel in advanced triple-negative breast cancer. N Engl J Med. (2018) 379:2108–21. doi: 10.1056/NEJMoa1809615
7. Barone A, Hazarika M, Theoret MR, Mishra-Kalyani P, Chen H, He K, et al. FDA approval summary: pembrolizumab for the treatment of patients with unresectable or metastatic melanoma. Clin Cancer Res. (2017) 23:5661–5. doi: 10.1158/1078-0432.ccr-16-0664
8. Beaver JA, Theoret MR, Mushti S, He K, Libeg M, Goldberg K, et al. FDA approval of nivolumab for the first-line treatment of patients with BRAF(V600) wild-type unresectable or metastatic melanoma. Clin Cancer Res. (2017) 23:3479–83. doi: 10.1158/1078-0432.ccr-16-0714
9. Kazandjian D, Suzman DL, Blumenthal G, Mushti S, He K, Libeg M, et al. FDA approval summary: nivolumab for the treatment of metastatic non-small cell lung cancer with progression on or after platinum-based chemotherapy. Oncologist. (2016) 21:634–42. doi: 10.1634/theoncologist.2015-0507
10. Pai-Scherf L, Blumenthal GM, Li H, Subramaniam S, Mishra-Kalyani PS, He K, et al. FDA approval summary: pembrolizumab for treatment of metastatic non-small cell lung cancer: first-line therapy and beyond. Oncologist. (2017) 22:1392–9. doi: 10.1634/theoncologist.2017-0078
11. Suzman DL, Agrawal S, Ning YM, Maher VE, Fernandes LL, Karuri S, et al. FDA approval summary: atezolizumab or pembrolizumab for the treatment of patients with advanced urothelial carcinoma ineligible for cisplatin-containing chemotherapy. Oncologist. (2019) 24:563–9. doi: 10.1634/theoncologist.2018-0084
12. Tabayoyong W, Gao J. The emerging role of immunotherapy in advanced urothelial cancers. Curr Opin Oncol. (2018) 30:172–80. doi: 10.1097/cco.0000000000000445
13. Weinstock C, Khozin S, Suzman D, Zhang L, Tang S, Wahby S, et al. U.S. Food and Drug Administration approval summary: atezolizumab for metastatic non-small cell lung cancer. Clin Cancer Res. (2017) 23:4534–9. doi: 10.1158/1078-0432.ccr-17-0540
14. Mezquita L, Planchard D. Durvalumab for the treatment of non-small cell lung cancer. Expert Rev Respir Med. (2018) 12:627–39. doi: 10.1080/17476348.2018.1494575
15. Man J, Ritchie G, Links M, Lord S, Lee CK. Treatment-related toxicities of immune checkpoint inhibitors in advanced cancers: a meta-analysis. Asia Pac J Clin Oncol. (2018) 14:141–52. doi: 10.1111/ajco.12838
16. Baxi S, Yang A, Gennarelli RL, Khan N, Wang Z, Boyce L, et al. Immune-related adverse events for anti-PD-1 and anti-PD-L1 drugs: systematic review and meta-analysis. BMJ. (2018) 360:k793. doi: 10.1136/bmj.k793
17. Xu C, Chen YP, Du XJ, Liu JQ, Huang CL, Chen L, et al. Comparative safety of immune checkpoint inhibitors in cancer: systematic review and network meta-analysis. BMJ. (2018) 363:k4226. doi: 10.1136/bmj.k4226
18. Nishino M, Giobbie-Hurder A, Hatabu H, Ramaiya NH, Hodi FS. Incidence of programmed cell death 1 inhibitor-related pneumonitis in patients with advanced cancer: a systematic review and meta-analysis. JAMA Oncol. (2016) 2:1607–16. doi: 10.1001/jamaoncol.2016.2453
19. Fehrenbacher L, Spira A, Ballinger M, Kowanetz M, Vansteenkiste J, Mazieres J, et al. Atezolizumab versus docetaxel for patients with previously treated non-small-cell lung cancer (POPLAR): a multicentre, open-label, phase 2 randomised controlled trial. Lancet. (2016) 387:1837–46. doi: 10.1016/s0140-6736(16)00587-0
20. Weber JS, D'Angelo SP, Minor D, Hodi FS, Gutzmer R, Neyns B, et al. Nivolumab versus chemotherapy in patients with advanced melanoma who progressed after anti-CTLA-4 treatment (CheckMate 037): a randomised, controlled, open-label, phase 3 trial. Lancet Oncol. (2015) 16:375–84. doi: 10.1016/s1470-2045(15)70076-8
21. Antonia SJ, Villegas A, Daniel D, Vicente D, Murakami S, Hui R, et al. Durvalumab after chemoradiotherapy in stage III non-small-cell lung cancer. N Engl J Med. (2017) 377:1919–29. doi: 10.1056/NEJMoa1709937
22. Reck M, Rodriguez-Abreu D, Robinson AG, Hui R, Csoszi T, Fulop A, et al. Pembrolizumab versus chemotherapy for PD-L1-positive non-small-cell lung cancer. N Engl J Med. (2016) 375:1823–33. doi: 10.1056/NEJMoa1606774
23. Robert C, Long GV, Brady B, Dutriaux C, Maio M, Mortier L, et al. Nivolumab in previously untreated melanoma without BRAF mutation. N Engl J Med. (2015) 372:320–30. doi: 10.1056/NEJMoa1412082
24. Nishijima TF, Shachar SS, Nyrop KA, Muss HB. Safety and tolerability of PD-1/PD-L1 inhibitors compared with chemotherapy in patients with advanced cancer: a meta-analysis. Oncologist. (2017) 22:470–9. doi: 10.1634/theoncologist.2016-0419
25. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JP, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration. BMJ. (2009) 339:b2700. doi: 10.1136/bmj.b2700
26. Hutton B, Salanti G, Caldwell DM, Chaimani A, Schmid CH, Cameron C, et al. The PRISMA extension statement for reporting of systematic reviews incorporating network meta-analyses of health care interventions: checklist and explanations. Ann Intern Med. (2015) 162:777–84. doi: 10.7326/m14-2385
27. Higgins JP, Altman DG, Gotzsche PC, Juni P, Moher D, Oxman AD, et al. The Cochrane Collaboration's tool for assessing risk of bias in randomised trials. BMJ. (2011) 343:d5928. doi: 10.1136/bmj.d5928
28. Puhan MA, Schunemann HJ, Murad MH, Li T, Brignardello-Petersen R, Singh JA, et al. A GRADE Working Group approach for rating the quality of treatment effect estimates from network meta-analysis. BMJ. (2014) 349:g5630. doi: 10.1136/bmj.g5630
29. Higgins JPT, Green S. (editors) Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0. The Cochrane Collaboration (2011). Available online at: http://handbook.cochrane.org (accessed April 29, 2019).
30. Biggerstaff BJ, Tweedie RL. Incorporating variability in estimates of heterogeneity in the random effects model in meta-analysis. Stat Med. (1997) 16:753–68.
31. Egger M, Davey Smith G, Schneider M, Minder C. Bias in meta-analysis detected by a simple, graphical test. BMJ. (1997) 315:629–34.
32. Sutton AJ, Abrams KR. Bayesian methods in meta-analysis and evidence synthesis. Stat Methods Med Res. (2001) 10:277–303. doi: 10.1177/096228020101000404
33. Brooks SP, Gelman A. General methods for monitoring convergence of iterative simulations. J Comput Graph Stat. (1998) 7:434–55. doi: 10.1080/10618600.1998.10474787
34. Salanti G, Ades AE, Ioannidis JP. Graphical methods and numerical summaries for presenting results from multiple-treatment meta-analysis: an overview and tutorial. J Clin Epidemiol. (2011) 64:163–71. doi: 10.1016/j.jclinepi.2010.03.016
35. Dias S, Welton NJ, Caldwell DM, Ades AE. Checking consistency in mixed treatment comparison meta-analysis. Stat Med. (2010) 29:932–44. doi: 10.1002/sim.3767
36. Lu G, Ades AE. Assessing evidence inconsistency in mixed treatment comparisons. J Am Stat Assoc. (2006) 101:447–59. doi: 10.1198/016214505000001302
37. Song F, Altman DG, Glenny A-M, Deeks JJ. Validity of indirect comparison for estimating efficacy of competing interventions: empirical evidence from published meta-analyses. BMJ. (2003) 326:472. doi: 10.1136/bmj.326.7387.472
38. Shitara K, Ozguroglu M, Bang YJ, Bartolomeo MD, Mandala M, Ryu MH, et al. Pembrolizumab versus paclitaxel for previously treated, advanced gastric or gastro-oesophageal junction cancer (KEYNOTE-061): a randomised, open-label, controlled, phase 3 trial. Lancet. (2018) 392:123–33. doi: 10.1016/s0140-6736(18)31257-1
39. Ribas A, Puzanov I, Dummer R, Schadendorf D, Hamid O, Robert C, et al. Pembrolizumab versus investigator-choice chemotherapy for ipilimumab-refractory melanoma (KEYNOTE-002): a randomised, controlled, phase 2 trial. Lancet Oncol. (2015) 16:908–18. doi: 10.1016/s1470-2045(15)00083-2
40. Herbst RS, Baas P, Kim DW, Felip E, Perez-Gracia JL, Han JY, et al. Pembrolizumab versus docetaxel for previously treated, PD-L1-positive, advanced non-small-cell lung cancer (KEYNOTE-010): a randomised controlled trial. Lancet. (2016) 387:1540–50. doi: 10.1016/s0140-6736(15)01281-7
41. Gandhi L, Rodriguez-Abreu D, Gadgeel S, Esteban E, Felip E, De Angelis F, et al. Pembrolizumab plus chemotherapy in metastatic non-small-cell lung cancer. N Engl J Med. (2018) 378:2078–92. doi: 10.1056/NEJMoa1801005
42. Paz-Ares L, Luft A, Vicente D, Tafreshi A, Gümüş M, Mazières J, et al. Pembrolizumab plus chemotherapy for squamous non–small-cell lung cancer. N Engl J Med. (2018) 379:2040–51. doi: 10.1056/NEJMoa1810865
43. Bellmunt J, de Wit R, Vaughn DJ, Fradet Y, Lee JL, Fong L, et al. Pembrolizumab as second-line therapy for advanced urothelial carcinoma. N Engl J Med. (2017) 376:1015–26. doi: 10.1056/NEJMoa1613683
44. Larkin J, Minor D, D'Angelo S, Neyns B, Smylie M, Miller WH Jr, et al. Overall survival in patients with advanced melanoma who received nivolumab versus investigator's choice chemotherapy in CheckMate 037: a randomized, controlled, open-label phase III trial. J Clin Oncol. (2018) 36:383–90. doi: 10.1200/jco.2016.71.8023
45. Brahmer J, Reckamp KL, Baas P, Crino L, Eberhardt WE, Poddubskaya E, et al. Nivolumab versus docetaxel in advanced squamous-cell non-small-cell lung cancer. N Engl J Med. (2015) 373:123–35. doi: 10.1056/NEJMoa1504627
46. Borghaei H, Paz-Ares L, Horn L, Spigel DR, Steins M, Ready NE, et al. Nivolumab versus docetaxel in advanced nonsquamous non-small-cell lung cancer. N Engl J Med. (2015) 373:1627–39. doi: 10.1056/NEJMoa1507643
47. Hellmann MD, Ciuleanu TE, Pluzanski A, Lee JS, Otterson GA, Audigier-Valette C, et al. Nivolumab plus ipilimumab in lung cancer with a high tumor mutational burden. N Engl J Med. (2018) 378:2093–104. doi: 10.1056/NEJMoa1801946
48. Kang YK, Boku N, Satoh T, Ryu MH, Chao Y, Kato K, et al. Nivolumab in patients with advanced gastric or gastro-oesophageal junction cancer refractory to, or intolerant of, at least two previous chemotherapy regimens (ONO-4538-12, ATTRACTION-2): a randomised, double-blind, placebo-controlled, phase 3 trial. Lancet. (2017) 390:2461–71. doi: 10.1016/s0140-6736(17)31827-5
49. Carbone DP, Reck M, Paz-Ares L, Creelan B, Horn L, Steins M, et al. First-line nivolumab in stage IV or recurrent non-small-cell lung cancer. N Engl J Med. (2017) 376:2415–26. doi: 10.1056/NEJMoa1613493
50. Langer CJ, Gadgeel SM, Borghaei H, Papadimitrakopoulou VA, Patnaik A, Powell SF, et al. Carboplatin and pemetrexed with or without pembrolizumab for advanced, non-squamous non-small-cell lung cancer: a randomised, phase 2 cohort of the open-label KEYNOTE-021 study. Lancet Oncol. (2016) 17:1497–508. doi: 10.1016/s1470-2045(16)30498-3
51. Rittmeyer A, Barlesi F, Waterkamp D, Park K, Ciardiello F, von Pawel J, et al. Atezolizumab versus docetaxel in patients with previously treated non-small-cell lung cancer (OAK): a phase 3, open-label, multicentre randomised controlled trial. Lancet. (2017) 389:255–65. doi: 10.1016/s0140-6736(16)32517-x
52. Powles T, Duran I, van der Heijden MS, Loriot Y, Vogelzang NJ, De Giorgi U, et al. Atezolizumab versus chemotherapy in patients with platinum-treated locally advanced or metastatic urothelial carcinoma (IMvigor211): a multicentre, open-label, phase 3 randomised controlled trial. Lancet. (2018) 391:748–57. doi: 10.1016/s0140-6736(17)33297-x
53. Eggermont AMM, Blank CU, Mandala M, Long GV, Atkinson V, Dalle S, et al. Adjuvant pembrolizumab versus placebo in resected stage III melanoma. N Engl J Med. (2018) 378:1789–801. doi: 10.1056/NEJMoa1802357
54. Pillai RN, Behera M, Owonikoko TK, Kamphorst AO, Pakkala S, Belani CP, et al. Comparison of the toxicity profile of PD-1 versus PD-L1 inhibitors in non-small cell lung cancer: a systematic analysis of the literature. Cancer. (2018) 124:271–7. doi: 10.1002/cncr.31043
55. Khoja L, Day D, Wei-Wu Chen T, Siu LL, Hansen AR. Tumour- and class-specific patterns of immune-related adverse events of immune checkpoint inhibitors: a systematic review. Ann Oncol. (2017) 28:2377–85. doi: 10.1093/annonc/mdx286
Keywords: PD-1 inhibitors, PD-L1 inhibitors, treatment-related adverse events, immune-related adverse events, network meta-analysis
Citation: Huang Y, Xie W, Fan H and Du J (2019) Comparative Safety of PD-1/PD-L1 Inhibitors for Cancer Patients: Systematic Review and Network Meta-Analysis. Front. Oncol. 9:972. doi: 10.3389/fonc.2019.00972
Received: 23 May 2019; Accepted: 13 September 2019;
Published: 01 October 2019.
Edited by:
Haidong Dong, Mayo Clinic College of Medicine and Science, United StatesReviewed by:
Luis De La Cruz-Merino, Hospital Universitario Virgen Macarena, SpainBrant A. Inman, Duke University, United States
Copyright © 2019 Huang, Xie, Fan and Du. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Juan Du, Y3Vja29vJiN4MDAwNDA7Y2NtdS5lZHUuY24=