Skip to main content

SYSTEMATIC REVIEW article

Front. Oncol., 29 October 2020
Sec. Cancer Immunity and Immunotherapy

Systematic Assessment of Risk of Fever in Solid Tumor Patients Treated With PD-1/PD-L1 Inhibitors: A Systematic Review and Meta-Analysis

  • 1Department of Radiotherapy Oncology, Shandong Provincial Qianfoshan Hospital, The First Hospital Affiliated With Shandong First Medical University, Jinan, China
  • 2Nursing Department, Shandong Provincial Qianfoshan Hospital, The First Hospital Affiliated With Shandong First Medical University, Jinan, China
  • 3Department of Liver Transplantation and Hepatic Surgery, Shandong Provincial Qianfoshan Hospital, The First Hospital Affiliated With Shandong First Medical University, Jinan, China
  • 4Department of Pediatrics, The People's Hospital of Yuncheng County, Heze, China
  • 5Department of General Surgery, Peking University Third Hospital, Beijing, China
  • 6Department of Hepatobiliary Intervention, Beijing Tsinghua Changgung Hospital, School of Clinical Medicine, Tsinghua University, Beijing, China

Purpose: Drug-induced fever is frequently reported in cancer patients treated with anti-programmed cell death 1 (PD-1)/programmed cell death ligand 1 (PD-L1), and stoppage of the offending agent is the management of choice. However, given the complex management of cancer patients, this needs to be carefully studied. Therefore, we conducted a meta-analysis to estimate the risk of fever associated with anti-PD-1/PD-L1 in cancer patients.

Methods: From May 2010 to 2020, an electronic search was conducted through PubMed for relevant studies. All clinical trials reporting fever in cancer patients treated with PD-1/PD-L1 inhibitors were included, while other designs were excluded. A manual search was also conducted to search for relevant articles. Outcomes included the risk of pyrexia and febrile neutropenia in the overall population and based on the grade of fever (all grades vs. grades 3–5). The Newcastle–Ottawa Scale was used to assess the quality of included studies.

Results: Thirty-one articles, involving 27 clinical trials and 15,867 participants, were included. The increased risk of pyrexia for all grades is only found when PD-1/PD-L1 plus cytotoxic T lymphocyte-associated protein 4 (CTLA-4) was compared to CTLA-4 [odds ratio (OR) = 2.48, 95% CI: 1.17, 5.23]. The risk of febrile neutropenia for all-grade fever was significantly lower in the PD-1/PD-L1 group compared to that of chemotherapy alone (OR = 0.02, 95% CI: 0.01, 0.05). A similar trend in the risk of febrile neutropenia was also found for grades 3–5 (OR = 0.02, 95% CI: 0.01, 0.05).

Conclusion: The increased risk of pyrexia for all grades could only be found when PD-1/PD-L1 plus CTLA-4 was compared with CTLA-4. Meanwhile, compared to chemotherapy, PD-1/PD-L1 inhibitors reduced the risk of febrile neutropenia.

Introduction

Fever, relating to drug, infections, or others, is frequently reported among cancer patients (13). In the course of antitumor therapy, drug-induced fever might be caused by chemotherapy (4), targeted therapy (5), or immunotherapy drugs (6). At present, in clinical practice, enough attention has been paid to drug-induced fever of cancer patients, and relevant guidelines have been developed in this regard (13). In order to control the fever of cancer patients in a timely manner, it is important to clarify the origin of the fever (16). In terms of drug-induced fever, stopping the offending agent remains the first choice of treatment (13). However, due to the delicate medical care in cancer patients, the sudden stoppage of antitumor therapy is very likely to lead to the rapid progression of such tumors. Therefore, the decision to stop antitumor drug-induced fever needs to be studied thoroughly.

In many clinical trials, immunotherapeutic drugs, especially those directed at the programmed cell death 1 (PD-1) and programmed cell death ligand 1 (PD-L1) pathways (737), have achieved satisfactory clinical efficacy and safety profiles in cancer patients. That being said, various treatment-emergent adverse events (TEAEs) were gradually discovered and reported in individual studies, including fever (737). However, to date, there has been no published systematic literature review studying the incidence or risk of drug-induced fever in cancer patients treated with PD-1/PD-L1 inhibitors (737). Therefore, in order to provide clear evidence in this regard, we conducted the current systematic review and meta-analysis to report the overall risk of drug-induced fever in cancer patients treated with PD-1/PD-L1 inhibitors.

Methods

This systematic review and meta-analysis was carried out in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines (38).

Types of Enrolled Studies

Clinical trials involving hematological malignancies were excluded first. Phase III clinical trials reporting the incidence or the risk of fever in patients with PD-1/PD-L1-positive solid tumors were prioritized. Clinical trials of other phases would be placed in an alternative position. All clinical trials had to have a control group to be eligible for inclusion in our study. At least one piece of fever-related data had to be available for inclusion; otherwise, the paper would be excluded. Various definitions of fever, such as pyrexia and febrile illness, were used to search for eligible studies, and any study reporting any definition of fever while being consistent with our eligibility criteria was included. We included articles that were originally published in the English language, while other trials published in other languages were excluded.

Search Strategy

A systematic electronic search was carried out for relevant clinical trials (reporting fever in cancer patients treated with anti-PD-1/PD-L1 agents) that were published in the past 10 years (May 29, 2010, to May 29, 2020) through PubMed using a set of keywords, as follows: “neoplasm,” “cancer,” “precancer,” “pre-cancer,” “malignant,” “premalignant,” “tumor,” “PD1/PD-L1,” “nivolumab,” “Opdivo,” “pembrolizumab,” “Keytruda,” “Imfinzi,” “MK-3475,” “atezolizumab,” “Tecentriq,” “MPDL3280A,” “avelumab,” “Bavencio,” “durvalumab,” “camrelizumab,” and “BMS-963558” (39). Three independent reviews carried out the electronic search phase of relevant human-limited literature that was published in English according to the aforementioned criteria. Eligibility and duplicates were checked independently by three reviewers (Dongmei Xu, Hongmei Liu, and Wentao Wang). Any discrepancies were solved through discussion among reviewers, and when needed, a senior reviewer would give the final decision on the matter. The baseline characteristics of all included clinical trials are summarized and presented in Table 1.

TABLE 1
www.frontiersin.org

Table 1. Baseline characteristics of the included clinical trials (n = 27).

Evaluation of Study Quality and Publication Bias

Publication bias was assessed using Egger's regression test, while the quality of the included trials was assessed by the Newcastle–Ottawa Scale, which was proposed by the Cochrane Collaboration (38, 4043). The quality assessment of included clinical trials was also carried out by the above three reviewers (Dongmei Xu, Hongmei Liu, and Wentao Wang). The quality assessment included assessing the risk of bias in the following points: random sequence generation, allocation concealment, blinding of participants and personnel, blinding of outcome assessment, incomplete outcome data, and selective outcome reporting. All these points were evaluated together, and the evaluation results would be summarized in a single graph. Harbord's test was used to check publication bias for all enrolled clinical trials (44) A P < 0.05 was considered indicative of publication bias.

Exposure and Outcome of Interest

Basic information of enrolled studies, including the first author's name, year of publication, trial number, trial title, the specific name of the anti-PD-1/PD-L1 agent, status of previous therapies, treatment regimens, number of participants, and number of fever events (rate), was collected and summarized in Table 1. Various definitions and terms of fever indicators, such as pyrexia and febrile neutropenia, were collected and used for the final comprehensive analysis. Both all-grade and grade 3–5 fever data were used for the final meta-analysis.

Assessment of Heterogeneity and Statistical Analysis

Cochrane's Q statistic and the I2 statistic were used to check the heterogeneity among analyzed studies, as proposed by Higgins et al. (38, 39, 43). The grade of heterogeneity was evaluated by the range of I2 values (38, 43). Heterogeneity was taken as low, moderate, or high according to I2 values <25, 25–50, and >50%, respectively (39). Odds ratio (OR) and the corresponding 95% confidence interval (CI) would be calculated by random effect (RE) (45). A P < 0.05 was considered the cutoff value for statistical significance. In order to clarify the relationship between fever indicators (pyrexia and febrile neutropenia) and PD-1/PD-L1 inhibitors, we performed a large number of subgroup analyses based on the type of tumor, the treatment regimen, and the specific administered drug. The software (Review Manager 5.3) was used for data consolidation and analysis. Statistical tests were all two-sided (39).

Results

Literature Search Results

According to our preliminary electronic search, a total of 651 articles discussing PD-1/PD-L1 inhibitors and cancer, including clinical trials, were identified on PubMed, and 65 related studies were added after conducting a manual search of articles. A total of 31 published articles (27 clinical trials), including 15,867 participants, were finally included in our review. The basic information of included studies is listed and summarized in Table 1 (737). The PRISMA flow diagram of our review is shown in Figure 1, while the risk of bias summary is presented in Figure 2 (737). Different stages of a clinical trial, named CheckMate 067, were reported by four articles (8, 3436). After reviewing and evaluating the data of the four articles, only the most comprehensive data provided by one of four articles were used for the final comprehensive analysis (35). After assessment and screening for all included clinical trials, the data relating to fever were mainly displayed in two forms: pyrexia and febrile neutropenia. The two variables would be analyzed separately.

FIGURE 1
www.frontiersin.org

Figure 1. A Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) flow diagram of the screening process of the systematic review.

FIGURE 2
www.frontiersin.org

Figure 2. Risk of bias summary: review authors' judgments about each risk of bias item for each included study.

Characteristics of Identified Trials

Out of the 27 included clinical trials, 24 articles were phase III trials, two were phase II trials, and one article was a phase II/III trial (9, 25, 28). PD-1 inhibitors were used in 17 clinical trials (7, 912, 17, 20, 22, 23, 2531, 35), while PD-L1 inhibitors were reported in the remaining 10 clinical trials (8, 1316, 18, 19, 21, 24, 32, 33). The drugs that were used in each individual trial are listed as follows: camrelizumab (PD-1, n = 1) (7), nivolumab (PD-1, n = 7) (11, 22, 27, 2931, 35), pembrolizumab (PD-1, n = 9) (9, 10, 12, 17, 20, 23, 25, 26, 28), avelumab (PD-L1, n = 2) (8, 12), durvalumab (PD-L1, n = 3) (13, 21, 32), and atezolizumab (PD-L1, n = 7) (1416, 19, 24, 33). In terms of cancer type, 13 trials included patients with non-small-cell lung cancer (NSCLC) (1621, 2426, 28, 3032), two trials included patients with small-cell lung cancer (SCLC) (13, 15), two trials included patients with esophageal squamous cell carcinoma (OSCC) (7, 11), three trials included patients with head and neck squamous cell carcinoma (HNSCC) (10, 12, 27), two trials included patients with urothelial cancer (UC) (23, 33), one trial included patients with breast cancer (BC) (14), three trials included patients with melanoma (9, 29, 35), one trial included patients with renal cell carcinoma (RCC) (8), and one trial included patients with gastric or junction cancer (22). PD-1/PD-L1 inhibitors were given as a first-line therapy in 13 clinical trials (8, 9, 1217, 20, 25, 26, 29, 35), while platinum-based antitumor regimens were prescribed before PD-1/PD-L1 inhibitors in the remaining 14 trials (7, 10, 11, 18, 19, 2124, 27, 28, 3033).

Risk of Bias

The overall risk of bias of all included studies is presented in a single graph (Figure 2, Supplementary Figure 2). Meanwhile, publication bias, evaluated by Harbord's test, shown in the form of funnel plots, was checked and displayed in Supplementary Figures 3–6 (38, 4043).

The Risk of Pyrexia

Among the included trials, pyrexia was reported in 21 trials (810, 12, 14, 1724, 2633, 35). The data were divided into five groups according to the treatment regimen: group A (PD-1/PD-L1 inhibitor + chemotherapy vs. chemotherapy) (14, 17, 20), group B (PD-1/PD-L1 inhibitor vs. chemotherapy alone) (10, 12, 18, 19, 23, 24, 2628, 30, 31, 33), group C (PD-1/PD-L1 inhibitor vs. placebo) (21, 22, 32), group D (PD-1/PD-L1 inhibitor + targeted therapy vs. targeted therapy alone) (8, 9), and group E [PD-1 inhibitor vs. PD-1 inhibitor + cytotoxic T lymphocyte-associated protein 4 (CTLA-4)] (29, 35). Then, the risk of pyrexia for all grades and grades 3–5 was analyzed.

Compared to chemotherapy (group A), our analysis revealed no statistically significant difference regarding the risk of pyrexia for all grades in cancer patients treated with PD-1/PD-L1 inhibitor plus chemotherapy (OR = 1.35, 95% CI: 0.86, 2.12; Figure 3A) (14, 17, 20). The analysis revealed high heterogeneity (I2 = 70%), which was suggested, by the subgroup analysis, to originate from the two included clinical trials on NSCLC (I2 = 48%; Figure 3A) (17, 20). The evaluation result of bias was shown in the form of funnel plots, which are present in Supplementary Figure 3A (14, 17, 20).

FIGURE 3
www.frontiersin.org

Figure 3. Forest plots of all-grade pyrexia. (A) The risk of all-grade pyrexia evaluated by random effect model [programmed cell death 1 (PD-1)/programmed cell death ligand 1 (PD-L1) + chemotherapy vs. chemotherapy]: subgroup analysis was put into practice based on tumor types in both groups. (B) The risk of all-grade pyrexia evaluated by random effect model (PD-1/PD-L1 vs. chemotherapy): subgroup analysis was put into practice based on the treatment regimen in both groups. (C) The risk of all-grade pyrexia evaluated by random effect model (PD-1/PD-L1 vs. placebo): subgroup analysis was put into practice based on the drug type of the experimental group. (D) The risk of all-grade pyrexia evaluated by random effect model (PD-1/PD-L1 + targeted therapy vs. targeted therapy): subgroup analysis was put into practice based on the involved drugs in both groups. (E) The risk of all-grade pyrexia evaluated by random effect model [PD-1/PD-L1 + cytotoxic T lymphocyte-associated protein 4 (CTLA-4) vs. CTLA-4].

Similar to the above finding, there was no statistically significant difference regarding the risk of all-grade pyrexia in group B (OR = 0.99, 95% CI: 0.77, 1.27; Figure 3B), with moderate heterogeneity (I2 = 42%) (10, 12, 18, 19, 23, 24, 2628, 30, 31, 33). That being said, a statistically significant difference in pyrexia risk was found in this particular subgroup (PD-1 vs. docetaxel) (OR = 0.56, 95% CI: 0.37, 0.85; Figure 3B) (28, 30, 31). In other words, the risk of pyrexia was obviously lower than that of the control group of docetaxel among NSCLC patients (28, 30, 31). Based on the tumor type, further subgroup analysis results were provided in Supplementary Figure 1. Through different subgrouping methods, we inferred that the moderate heterogeneity of the analysis results might come from the data themselves. The funnel plot is displayed in Supplementary Figure 3B.

Compared to placebo (group C), the risk of pyrexia was significantly higher in patients treated with PD-L1 inhibitor, in particular (OR = 1.74, 95% CI: 1.21, 2.49; Figure 3C), while no obvious statistically significant difference was noted for the overall group (PD-1/PD-L1 inhibitors) (OR = 1.41, 95% CI: 0.91, 2.18; Figure 3C), with moderate heterogeneity (I2 = 49%) (21, 22, 32). The results of the subgroup analysis suggested that the moderate heterogeneity might mainly originate from the included PD-1 clinical trial on gastric or junction cancer (Figure 3C) (22). The risk of bias is shown in the form of funnel plots in Supplementary Figure 3C (21, 22, 32).

The overall analysis results of group D revealed no statistically significant difference regarding pyrexia of all grades among the studied arms (OR = 1.05, 95% CI: 0.64, 1.71; Figure 3D) (8, 9). The funnel plot is provided in Supplementary Figure 3D.

Inconsistent with the above findings, the overall risk of pyrexia for all-grade fever in patients in group E was significantly different in the studied arms (OR = 2.48, 95% CI: 1.17, 5.23; Figure 3E) (29, 35). Moderate heterogeneity (I2 = 48%) was found among the included clinical trials. The corresponding funnel plot is provided in Supplementary Figure 3E (29, 35).

When the same grouping and analysis method were used to analyze the risk of pyrexia for grades 3–5, no statistically significant differences regarding the risk of pyrexia were found in each individual group (both overall and in different subgroups) (Figure 4) (8, 9, 13, 14, 18, 2024, 2629, 31, 32, 35). The corresponding funnel plots are provided in Supplementary Figure 4 (8, 9, 13, 14, 18, 2024, 2629, 31, 32, 35).

FIGURE 4
www.frontiersin.org

Figure 4. Forest plots of pyrexia for grades 3–5. (A) The risk of pyrexia for grade 3–5 fever evaluated by random effect model [programmed cell death 1 (PD-1)/programmed cell death ligand 1 (PD-L1) + chemotherapy vs. chemotherapy]: subgroup analysis was put into practice based on tumor types in both groups. (B) The risk of pyrexia for grade 3–5 fever evaluated by random effect model (PD-1/PD-L1 vs. chemotherapy): subgroup analysis was put into practice based on the treatment regimen and tumor type of the control group. (C) The risk of pyrexia for grade 3–5 fever evaluated by random effect model (PD-1/PD-L1 vs. placebo): subgroup analysis was put into practice based on the drug type of the experimental group. (D) The risk of pyrexia for grade 3–5 fever evaluated by random effect model [PD-1/PD-L1 + cytotoxic T lymphocyte-associated protein 4 (CTLA-4) vs. CTLA-4].

The Risk of Febrile Neutropenia

Sixteen clinical trials reported data of febrile neutropenia and were included in the final comprehensive meta-analysis (7, 11, 13, 15, 16, 18, 19, 2325, 2831, 33, 35). The data were divided into three groups according to the treatment regimen: group A (PD-1/PD-L1 inhibitor + chemotherapy vs. chemotherapy) (13, 15, 16, 25), group B (PD-1/PD-L1 inhibitor vs. chemotherapy) (7, 11, 18, 19, 23, 24, 28, 30, 31, 33), and group C (PD-1/PD-L1 inhibitor + CTLA-4 vs. CTLA-4) (29, 35). Then, the risk of febrile neutropenia for all grades and grades 3–5 was checked.

In group A, our analysis revealed no statistically significant difference between chemotherapy alone and PD-1/PD-L1 plus chemotherapy regarding febrile neutropenia for all grades (OR = 1.10, 95% CI: 0.59, 2.03; Figure 5A), with moderate heterogeneity (I2 = 46%) (13, 15, 16, 25). The results of the subgroup analysis suggested that the encountered moderate heterogeneity might mainly originate from the two included clinical trials on SCLC (I2 = 29%; Figure 5A) (13, 15). The evaluation of the risk of bias is shown in the form of funnel plots in Supplementary Figure 5A (13, 15, 16, 25). A similar trend in the risk of febrile neutropenia could also be seen when the data of grades 3–5 alone were analyzed (OR = 1.00, 95% CI: 0.53, 1.88; Figure 6A) (13, 15, 16, 25). Moderate heterogeneity (I2 = 47%) was found. The corresponding funnel plot is displayed in Figure 6A (13, 15, 16, 25).

FIGURE 5
www.frontiersin.org

Figure 5. Forest plots of all-grade febrile neutropenia. (A) The risk of all-grade febrile neutropenia evaluated by random effect model [programmed cell death 1 (PD-1)/programmed cell death ligand 1 (PD-L1) + chemotherapy vs. chemotherapy]: subgroup analysis was put into practice based on tumor types in both groups. (B) The risk of all-grade febrile neutropenia evaluated by random effect model (PD-1/PD-L1 vs. chemotherapy): subgroup analysis was put into practice based on the treatment regimen and tumor type of the control group. (C) The risk of all-grade febrile neutropenia evaluated by random effect model [PD-1/PD-L1 + cytotoxic T lymphocyte-associated protein 4 (CTLA-4) vs. CTLA-4].

FIGURE 6
www.frontiersin.org

Figure 6. Forest plots of febrile neutropenia for grades 3–5. (A) The risk of febrile neutropenia for grade 3–5 fever evaluated by random effect model [programmed cell death 1 (PD-1)/programmed cell death ligand 1 (PD-L1) + chemotherapy vs. chemotherapy]: subgroup analysis was put into practice based on tumor types in both groups. (B) The risk of febrile neutropenia for grade 3–5 fever evaluated by random effect model (PD-1/PD-L1 vs. chemotherapy): subgroup analysis was put into practice based on the treatment regimen and tumor type of the control group. (C) The risk of febrile neutropenia for grade 3–5 fever evaluated by random effect model [PD-1/PD-L1 + cytotoxic T lymphocyte-associated protein 4 (CTLA-4) vs. CTLA-4].

In group B, the risk of febrile neutropenia for all grades was significantly lower in the PD-1/PD-L1 inhibitor group compared to that of the control group (chemotherapy) (OR = 0.02, 95% CI: 0.01, 0.05; Figure 5B) (7, 11, 18, 19, 23, 24, 28, 30, 31, 33). A similar trend in the risk of febrile neutropenia could also be found for grades 3–5 (OR = 0.02, 95% CI: 0.01, 0.05; Figure 6B) (7, 11, 18, 19, 23, 24, 28, 30, 31, 33). No heterogeneity was found. The corresponding plots are provided in Supplementary Figures 5B, 6B (7, 11, 18, 19, 23, 24, 28, 30, 31, 33).

In group C, only two clinical trials were enrolled in the final meta-analysis (29, 35). The analysis results are summarized and displayed at the bottom of Figures 5C, 6C (29, 35). No statistically significant differences were found between the studied arms. The corresponding plots are provided in Supplementary Figures 5C, 6C (29, 35).

Discussion

With the development of antitumor immunotherapy, more and more clinical trials investigating immunotherapeutic drugs have been developed, and satisfactory clinical effects have been achieved (737). PD-1/PD-L1 inhibitors are currently the most widely used antitumor immunotherapeutic drugs in studied clinical trials, and they are also the most widely used antitumor immunotherapeutic drugs in clinical practice (737, 46, 47). In clinical trials related to PD-1/PD-L1 inhibitors, as well as in clinical work using PD-1/PD-L1 inhibitors for antitumor therapy, patients with drug-induced fever are frequently encountered and reported (737, 46, 47) In order to control the fever of cancer patients in a timely manner, it is important to clarify the origin of the fever (16). However, the specific role of PD-1/PD-L1 inhibitors in the etiology of fever is still unclear, especially when combined with chemotherapy for antitumor therapy. Therefore, when patients who are receiving combined antitumor therapy develop hyperthermia of grades 3–5, it is difficult for us to judge whether to stop the PD-1/PD-L1 inhibitor drugs to relieve the fever or not. Furthermore, due to the particularity of cancer patients, the sudden stoppage of antitumor therapy is very likely to lead to the rapid progression of the tumor. Therefore, the decision to stop or withdraw the offending drug (antitumor drug) needs to be carefully studied. In an attempt to explore the relationship between PD-1/PD-L1 inhibitors and drug-induced fever, this meta-analysis was designed and performed.

According to the guidelines of PRISMA, after screening and eligibility assessment,27 clinical trials reporting on the use of PD-1/PD-L1 inhibitors, including 15,867 cancer patients, were enrolled for the final comprehensive analysis (737). The quality of all included studies was evaluated and summarized in a single graph (Figure 2, Supplementary Figure 2) and was considered to be better. Therefore, the analysis conclusions drawn from the data of these clinical trials are much more inclined to be true and reliable (737). The data relating to fever were mainly displayed in two forms: pyrexia and febrile neutropenia. When the extracted data were verified, it was found that the incidence of pyrexia reported in clinical trials was mostly grades 1–2, while the incidence of febrile neutropenia was almost all grades 3–5 (737). Therefore, febrile neutropenia is the type of fever that is most likely to lead to the stoppage of the offending antitumor agent.

Comparing chemotherapy (control group), there was no statistically significant difference in the risk of pyrexia whether the PD-1/PD-L1 inhibitor was used alone or in combination with chemotherapy in the experimental arm (Figures 3A,B, 4A,B) (810, 12, 14, 1724, 2633, 35). However, we noted a statistically significant difference in the subgroup (PD-1 vs. docetaxel) (OR = 0.56, 95% CI: 0.37, 0.85; Figure 3B) (28, 30, 31). In other words, the risk of pyrexia for all-grade fever was obviously lower in the PD-1 inhibitor group compared to that of the control group among NSCLC patients (28, 30, 31). The results of the subgroup analysis suggested that the high heterogeneity (I2 = 70%; Figure 3A) might mainly originate from the two included clinical trials on NSCLC (I2 = 48%; Figure 3A) (17, 20). No publication bias was found in the funnel plot (Supplementary Figure 3A) (14, 17, 20). Through different subgrouping methods (Figure 3B, Supplementary Figure 1) (10, 12, 18, 19, 23, 24, 2628, 30, 31, 33), we inferred that the moderate heterogeneity (I2 = 42%; Figure 3B) of the analysis results (group B) might come from all studied data themselves. The funnel plot was displayed in Supplementary Figure 3B without any clue of publication bias (10, 12, 18, 19, 23, 24, 2628, 30, 31, 33).

Similar to the above results (Figures 3A,B), regardless of whether the control group was placebo or targeted therapy and regardless of whether PD-1/PD-L1 was used alone or in combination with targeted therapy (Figures 3C,D) (21, 22, 29, 32, 35), no statistically significant differences were found regarding the risk of pyrexia. In other words, PD-1/PD-L1 inhibitors did not result in a statistically significant increase in the risk of pyrexia. The results of the subgroup analysis suggested that the moderate heterogeneity of that analysis (I2 = 49%; Figure 3C) might originate from the included PD-1 clinical trial on gastric or junction cancer (Figure 3C) (22). Due to the small number of included clinical trials (reporting pyrexia in group D) to perform sufficient subgroup analysis, it was impossible for us to clarify the origin of low heterogeneity (I2 = 29%; Figure 3D) (8, 9).

Different from the above groups, the risk of pyrexia for the experimental group (PD-1) was higher than that of the control group (PD-1 + CTLA-4) with a statistically significant difference (OR = 2.48, 95% CI: 1.17, 5.23; Figure 3E) (29, 35). However, since only two clinical trials were enrolled in this group, the conclusion still needs to be verified by more clinical trials (29, 35). Moderate heterogeneity (I2 = 48%) was found among the included trials. The number of included trials in the above analysis was very small, and thus, it was impossible to conduct subgroup analysis to identify the origin of the resulting heterogeneity (29, 35). The corresponding funnel plot was provided in Supplementary Figure 3E (29, 35). No obvious publication bias was found.

When the same grouping and analysis methods were used to analyze the risk of pyrexia for grade 3–5 fever, no statistically significant differences were found in each group, either in the overall results or in various subgroups (Figure 4) (8, 9, 13, 14, 18, 2024, 2629, 31, 32, 35). In other words, PD-1/PD-L1 inhibitors did not have a statistically significant effect on the risk of pyrexia for grades 3–5 (8, 9, 13, 14, 18, 2024, 2629, 31, 32, 35).

Unsimilar to the trend of pyrexia risk, the majority of febrile neutropenia incidents were of grades 3–5 (7, 11, 13, 15, 16, 18, 19, 2325, 2831, 33, 35). Compared to chemotherapy, the risk of febrile neutropenia for all-grade fever was significantly lower in the PD-1/PD-L1 inhibitor group (OR = 0.02, 95% CI: 0.01, 0.05; Figure 5B) (7, 11, 18, 19, 23, 24, 28, 30, 31, 33). A similar trend could also be found for grades 3–5 (OR = 0.02, 95% CI: 0.01, 0.05; Figure 6B) (7, 11, 18, 19, 23, 24, 28, 30, 31, 33). On the other hand, statistically significant differences were found in other groups (Figures 5A,C, 6A,C) (13, 15, 16, 25, 29, 35). Moderate heterogeneity (I2 = 47%) was found in Figures 5A, 6A. The results of the subgroup analysis suggested that it might be related to the two enrolled clinical trials of SCLC (13, 15).

The good safety and satisfactory clinical efficacy of PD-1/PD-L1 inhibitors have been reported by a large number of clinical trials (737). The safety of PD-1/PD-L1 inhibitors was further confirmed by the findings of our meta-analysis. The increased risk of pyrexia for all grades could only be found when PD-1/PD-L1 plus CTLA-4 was compared with CTLA-4 alone (29, 35). Furthermore, no statistically significant differences in the risk of febrile neutropenia could be found in all studied groups, except for the PD-1/PD-L1 group, which was associated with a significantly lower risk of febrile neutropenia when compared with chemotherapy (7, 11, 13, 15, 16, 18, 19, 2325, 2831, 33, 35). It would be helpful for us to clarify the source of antitumor drug-induced fever and adopt the best treatment regimens for cancer patients.

Conclusions

The increased incidence risk of pyrexia for all grades could only be found when PD-1/PD-L1 plus CTLA-4 was compared with CTLA-4. Meanwhile, compared to chemotherapy, PD-1/PD-L1 inhibitors reduced the risk of febrile neutropenia.

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Author Contributions

YT had the right to deal with all the data and was responsible for the decision to submit the manuscript for publication. HL, DX, WW, FS, and XY had the data of all included clinical trials. DX, HL, and WW were responsible for checking and evaluating the quality of the collected data. All authors contributed to the article and approved the submitted version.

Funding

This study was funded by the Medicine and Health Technology Development Plan of Shandong Province (2017WSB04081), which was led by HL.

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fonc.2020.570080/full#supplementary-material

Abbreviations

PRISMA, Preferred Reporting Items for Systematic Reviews and Meta-Analyses; PD-1, programmed cell death-1; PD-L1, programmed cell death ligand 1; CTLA-4, cytotoxic T-lymphocyte antigen 4; HR, hazard ratios; OR, odds ratio; RD, risk difference; CI, confidence interval; RE, random effect; NSCLC, non-small-cell lung cancer; SCLC, small cell lung cancer; OSCC, esophageal squamous cell carcinoma; HNSCC, head and neck squamous cell carcinoma; UC, urothelial cancer; BC, breast cancer; RCC, renal cell carcinoma.

References

1. Taplitz RA, Kennedy EB, Bow EJ, Crews J, Gleason C, Hawley DK, et al. Outpatient management of fever and neutropenia in adults treated for malignancy: American Society of Clinical Oncology and Infectious Diseases Society of America Clinical practice guideline update. J Clin Oncol. (2018) 36:1443–53. doi: 10.1200/JCO.2017.77.6211

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Flowers CR, Seidenfeld J, Bow EJ, Karten C, Gleason C, Hawley DK, et al. Antimicrobial prophylaxis and outpatient management of fever and neutropenia in adults treated for malignancy: American Society of Clinical Oncology clinical practice guideline. J Clin Oncol. (2013) 31:794–810. doi: 10.1200/JCO.2012.45.8661

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Pasikhova Y, Ludlow S, Baluch A. Fever in patients with cancer. Cancer Control. (2017) 24:193–7. doi: 10.1177/107327481702400212

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Mody R, Naranjo A, Van Ryn C, Yu AL, London WB, Shulkin BL, et al. Irinotecan-temozolomide with temsirolimus or dinutuximab in children with refractory or relapsed neuroblastoma (COG ANBL1221): an open-label, randomised, phase 2 trial. Lancet Oncol. (2017) 18:946–57. doi: 10.1016/S1470-2045(17)30355-8

CrossRef Full Text | Google Scholar

5. Subbiah V, Kreitman RJ, Wainberg ZA, Cho JY, Schellens JHM, Soria JC, et al. Dabrafenib and trametinib treatment in patients with locally advanced or metastatic BRAF V600-mutant anaplastic thyroid cancer. J Clin Oncol. (2018) 36:7–13. doi: 10.1200/JCO.2017.73.6785

CrossRef Full Text | Google Scholar

6. Sikic BI, Lakhani N, Patnaik A, Shah SA, Chandana SR, Rasco D, et al. First-in-human, first-in-class phase i trial of the anti-CD47 antibody Hu5F9-G4 in patients with advanced cancers. J Clin Oncol. (2019) 37:946–53. doi: 10.1200/JCO.18.02018

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Huang J, Xu J, Chen Y, Zhuang W, Zhang Y, Chen Z, et al. Camrelizumab versus investigator's choice of chemotherapy as second-line therapy for advanced or metastatic oesophageal squamous cell carcinoma (ESCORT): a multicentre, randomised, open-label, phase 3 study. Lancet Oncol. (2020) 21:832–42. doi: 10.1016/S1470-2045(20)30110-8

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Motzer RJ, Penkov K, Haanen J, Rini B, Albiges L, Campbell MT, et al. Avelumab plus axitinib versus sunitinib for advanced renal-cell carcinoma. N Engl J Med. (2019) 380:1103–15. doi: 10.1056/NEJMoa1816047

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Ascierto PA, Ferrucci PF, Fisher R, Del Vecchio M, Atkinson V, Schmidt H, et al. Dabrafenib, trametinib and pembrolizumab or placebo in BRAF-mutant melanoma. Nat Med. (2019) 25:941–6. doi: 10.1038/s41591-019-0448-9

CrossRef Full Text | Google Scholar

10. Cohen EEW, Soulières D, Le Tourneau C, Dinis J, Licitra L, Ahn MJ, et al. Pembrolizumab versus methotrexate, docetaxel, or cetuximab for recurrent or metastatic head-and-neck squamous cell carcinoma (KEYNOTE-040): a randomised, open-label, phase 3 study. Lancet. (2019) 393:156–67. doi: 10.1016/S0140-6736(18)31999-8

CrossRef Full Text | Google Scholar

11. Kato K, Cho BC, Takahashi M, Okada M, Lin CY, Chin K, et al. Nivolumab versus chemotherapy in patients with advanced oesophageal squamous cell carcinoma refractory or intolerant to previous chemotherapy (ATTRACTION-3): a multicentre, randomised, open-label, phase 3 trial. Lancet Oncol. (2019) 20:1506–17. doi: 10.1016/S1470-2045(19)30626-6

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Burtness B, Harrington KJ, Greil R, Soulières D, Tahara M, de Castro G Jr, et al. Pembrolizumab alone or with chemotherapy versus cetuximab with chemotherapy for recurrent or metastatic squamous cell carcinoma of the head and neck (KEYNOTE-048): a randomised, open-label, phase 3 study. Lancet. (2019) 394:1915–28. doi: 10.1016/S0140-6736(19)32591-7

CrossRef Full Text | Google Scholar

13. Paz-Ares L, Dvorkin M, Chen Y, Reinmuth N, Hotta K, Trukhin D, et al. Durvalumab plus platinum-etoposide versus platinum-etoposide in first-line treatment of extensive-stage small-cell lung cancer (CASPIAN): a randomised, controlled, open-label, phase 3 trial. Lancet. (2019) 394:1929–39. doi: 10.1016/S0140-6736(19)32222-6

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Schmid P, Adams S, Rugo HS, Schneeweiss A, Barrios CH, Iwata H, et al. Atezolizumab and nab-paclitaxel in advanced triple-negative breast cancer. N Engl J Med. (2018) 379:2108–121. doi: 10.1056/NEJMoa1809615

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Horn L, Mansfield AS, Szczesna A, Havel L, Krzakowski M, Hochmair MJ, et al. First-line atezolizumab plus chemotherapy in extensive-stage small-cell lung cancer. N Engl J Med. (2018) 379:2220–9. doi: 10.1056/NEJMoa1809064

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Socinski MA, Jotte RM, Cappuzzo F, Orlandi F, Stroyakovskiy D, Nogami N, et al. Atezolizumab for first-line treatment of metastatic nonsquamous NSCLC. N Engl J Med. (2018) 378:2288–301. doi: 10.1056/NEJMoa1716948

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Paz-Ares L, Luft A, Vicente D, Tafreshi A, Gümüş M, Mazières J, et al. Pembrolizumab plus chemotherapy for squamous non-small-cell lung cancer. N Engl J Med. (2018) 379:2040–51. doi: 10.1056/NEJMoa1810865

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Barlesi F, Vansteenkiste J, Spigel D, Ishii H, Garassino M, de Marinis F, et al. Avelumab versus docetaxel in patients with platinum-treated advanced non-small-cell lung cancer (JAVELIN Lung 200): an open-label, randomised, phase 3 study. Lancet Oncol. (2018)19:1468–79. doi: 10.1016/S1470-2045(18)30673-9

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Hida T, Kaji R, Satouchi M, Ikeda N, Horiike A, Nokihara H, et al. Atezolizumab in Japanese patients with previously treated advanced non-small-cell lung cancer: a subgroup analysis of the phase 3 OAK study. Clin Lung Cancer. (2018) 19:e405–15. doi: 10.1016/j.cllc.2018.01.004

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Gandhi L, Rodríguez-Abreu D, Gadgeel S, Esteban E, Felip E, De Angelis F, et al. Pembrolizumab plus chemotherapy in metastatic non-small-cell lung cancer. N Engl J Med. (2018) 378:2078–92. doi: 10.1056/NEJMoa1801005

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Antonia SJ, Villegas A, Daniel D, Vicente D, Murakami S, Hui R, et al. Overall survival with durvalumab after chemoradiotherapy in stage III NSCLC. N Engl J Med. (2018) 379:2342–50. doi: 10.1056/NEJMoa1809697

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Kang YK, Boku N, Satoh T, Ryu MH, Chao Y, Kato K, et al. Nivolumab in patients with advanced gastric or gastro-oesophageal junction cancer refractory to, or intolerant of, at least two previous chemotherapy regimens (ONO-4538-12, ATTRACTION-2): a randomised, double-blind, placebo-controlled, phase 3 trial. Lancet. (2017) 390:2461–71. doi: 10.1016/S0140-6736(17)31827-5

CrossRef Full Text | Google Scholar

23. Bellmunt J, de Wit R, Vaughn DJ, Fradet Y, Lee JL, Fong L, et al. Pembrolizumab as second-line therapy for advanced urothelial carcinoma. N Engl J Med. (2017) 376:1015–26. doi: 10.1056/NEJMoa1613683

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Rittmeyer A, Barlesi F, Waterkamp D, Park K, Ciardiello F, von Pawel J, et al. Atezolizumab versus docetaxel in patients with previously treated non-small-cell lung cancer (OAK): a phase 3, open-label, multicentre randomised controlled trial. Lancet. (2017) 389:255–65. doi: 10.1016/S0140-6736(16)32517-X

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Langer CJ, Gadgeel SM, Borghaei H, Papadimitrakopoulou VA, Patnaik A, Powell SF, et al. Carboplatin and pemetrexed with or without pembrolizumab for advanced, non-squamous non-small-cell lung cancer: a randomised, phase 2 cohort of the open-label KEYNOTE-021 study. Lancet Oncol. (2016) 17:1497–508. doi: 10.1016/S1470-2045(16)30498-3

CrossRef Full Text | Google Scholar

26. Reck M, Rodríguez-Abreu D, Robinson AG, Hui R, Csoszi T, Fülöp A, et al. Pembrolizumab versus chemotherapy for PD-L1-positive non-small-cell lung cancer. N Engl J Med. (2016) 375:1823–33. doi: 10.1056/NEJMoa1606774

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Ferris RL, Blumenschein G Jr, Fayette J, Guigay J, Colevas AD, Licitra L, et al. Nivolumab for recurrent squamous-cell carcinoma of the head and neck. N Engl J Med. (2016) 375:1856–67. doi: 10.1056/NEJMoa1602252

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Herbst RS, Baas P, Kim DW, Felip E, Pérez-Gracia JL, Han JY, et al. Pembrolizumab versus docetaxel for previously treated, PD-L1-positive, advanced non-small-cell lung cancer (KEYNOTE-010): a randomised controlled trial. Lancet. (2016) 387:1540–50. doi: 10.1016/S0140-6736(15)01281-7

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Hodi FS, Chesney J, Pavlick AC, Robert C, Grossmann KF, McDermott DF, et al. Combined nivolumab and ipilimumab versus ipilimumab alone in patients with advanced melanoma: 2-year overall survival outcomes in a multicentre, randomised, controlled, phase 2 trial. Lancet Oncol. (2016) 17:1558–68. doi: 10.1016/S1470-2045(16)30366-7

PubMed Abstract | CrossRef Full Text | Google Scholar

30. Borghaei H, Paz-Ares L, Horn L, Spigel DR, Steins M, Ready NE, et al. Nivolumab versus docetaxel in advanced nonsquamous non-small-cell lung cancer. N Engl J Med. (2015) 373:1627–39. doi: 10.1056/NEJMoa1507643

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Brahmer J, Reckamp KL, Baas P, Crinò L, Eberhardt WE, Poddubskaya E, et al. Nivolumab versus docetaxel in advanced squamous-cell non-small-cell lung cancer. N Engl J Med. (2015) 373:123–35. doi: 10.1056/NEJMoa1504627

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Antonia SJ, Villegas A, Daniel D, Vicente D, Murakami S, Hui R, et al. Durvalumab after chemoradiotherapy in stage III non-small-cell lung cancer. N Engl J Med. (2017) 377:1919–29. doi: 10.1056/NEJMoa1709937

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Powles T, Durán I, van der Heijden MS, Loriot Y, Vogelzang NJ, De Giorgi U, et al. Atezolizumab versus chemotherapy in patients with platinum-treated locally advanced or metastatic urothelial carcinoma (IMvigor211): a multicentre, open-label, phase 3 randomised controlled trial. Lancet. (2018) 391:748–57. doi: 10.1016/S0140-6736(17)33297-X

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Wolchok JD, Chiarion-Sileni V, Gonzalez R, Rutkowski P, Grob JJ, Cowey CL, et al. Overall survival with combined nivolumab and ipilimumab in advanced melanoma. N Engl J Med. (2017) 377:1345–56. doi: 10.1056/NEJMoa1709684

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Hodi FS, Chiarion-Sileni V, Gonzalez R, Grob JJ, Rutkowski P, Cowey CL, et al. Nivolumab plus ipilimumab or nivolumab alone versus ipilimumab alone in advanced melanoma (CheckMate 067): 4-year outcomes of a multicentre, randomised, phase 3 trial. Lancet Oncol. (2018) 19:1480–92. doi: 10.1016/S1470-2045(18)30700-9

PubMed Abstract | CrossRef Full Text | Google Scholar

36. Larkin J, Chiarion-Sileni V, Gonzalez R, Grob JJ, Cowey CL, Lao CD, et al. Combined nivolumab and ipilimumab or monotherapy in untreated melanoma. N Engl J Med. (2015) 373:23–34. doi: 10.1056/NEJMoa1504030

CrossRef Full Text | Google Scholar

37. Larkin J, Chiarion-Sileni V, Gonzalez R, Grob JJ, Rutkowski P, Lao CD, et al. Five-Year Survival with Combined Nivolumab and Ipilimumab in Advanced Melanoma. N Engl J Med. (2019) 381:1535–46. doi: 10.1056/NEJMoa1910836

PubMed Abstract | CrossRef Full Text | Google Scholar

38. Moher D, Liberati A, Tetzlaff J, Altman DG, PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med. (2009) 151:264–69. doi: 10.7326/0003-4819-151-4-200908180-00135

CrossRef Full Text

39. Si Z, Zhang S, Yang X, Ding N, Xiang M, Zhu Q, et al. The association between the incidence risk of peripheral neuropathy and PD-1/PD-L1 inhibitors in the treatment for solid tumor patients: a systematic review and meta-analysis. Front Oncol. (2019) 9:866. doi: 10.3389/fonc.2019.00866

PubMed Abstract | CrossRef Full Text | Google Scholar

40. Higgins JP, Altman DG, Gøtzsche PC, Jüni P, Moher D, Oxman AD, et al. The Cochrane Collaboration's tool for assessing risk of bias in randomised trials. BMJ. (2011) 343:d5928. doi: 10.1136/bmj.d5928

PubMed Abstract | CrossRef Full Text | Google Scholar

41. Begg CB, Mazumdar M. Operating characteristics of a rank correlation test for publication bias. Biometrics. (1994) 50:1088–101. doi: 10.2307/2533446

PubMed Abstract | CrossRef Full Text | Google Scholar

42. Egger M, Davey Smith G, Schneider M, Minder C. Bias in meta-analysis detected by a simple, graphical test. BMJ. (1997) 315:629–34. doi: 10.1136/bmj.315.7109.629

PubMed Abstract | CrossRef Full Text | Google Scholar

43. Wells G, Shea B, O'Connell D, Peterson J, Welch V, Losos M, et al. The Newcastle–Ottawa Scale (NOS) for assessing the quality if nonrandomized studies in meta-analyses. 2009 http://www.ohri.ca/programs/clinical_epidemiology/oxford.asp (accessed July 6, 2012).

Google Scholar

44. Higgins JP, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta-analyses. BMJ. (2003) 327:557–60. doi: 10.1136/bmj.327.7414.557

PubMed Abstract | CrossRef Full Text | Google Scholar

45. DerSimonian R, Laird N. Meta-analysis in clinical trials. Control Clin Trials. (1986) 7:177–88. doi: 10.1016/0197-2456(86)90046-2

PubMed Abstract | CrossRef Full Text | Google Scholar

46. Singal G, Miller PG, Agarwala V, Li G, Kaushik G, Backenroth D, et al. Association of patient characteristics and tumor genomics with clinical outcomes among patients with non-small cell lung cancer using a clinicogenomic database. JAMA. (2019) 321:1391–9. doi: 10.1001/jama.2019.3241

PubMed Abstract | CrossRef Full Text | Google Scholar

47. Gonzalez-Cao M, Morán T, Dalmau J, Garcia-Corbacho J, Bracht JWP, Bernabe R, et al. Assessment of the feasibility and safety of durvalumab for treatment of solid tumors in patients with HIV-1 infection: the phase 2 DURVAST Study. JAMA Oncol. (2020) 6:1063–7. doi: 10.1001/jamaoncol.2020.0465

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: fever, PD-1, PD-L1, solid tumor, meta-analysis

Citation: Liu H, Xu D, Wang W, Sun F, Zhang S, Yang X and Tian Y (2020) Systematic Assessment of Risk of Fever in Solid Tumor Patients Treated With PD-1/PD-L1 Inhibitors: A Systematic Review and Meta-Analysis. Front. Oncol. 10:570080. doi: 10.3389/fonc.2020.570080

Received: 06 June 2020; Accepted: 21 September 2020;
Published: 29 October 2020.

Edited by:

Toshiyuki Murai, Osaka University, Japan

Reviewed by:

Kawaljit Kaur, University of California, Los Angeles, United States
Rodabe N. Amaria, University of Texas MD Anderson Cancer Center, United States

Copyright © 2020 Liu, Xu, Wang, Sun, Zhang, Yang and Tian. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Yuan Tian, tytytianyuan@aliyun.com; tytytianyuan@bjmu.edu.cn

These authors have contributed equally to this work

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.