A CT-Based Radiomics Approach to Predict Nivolumab Response in Advanced Non-Small-Cell Lung Cancer

Purpose: This study aims to develop a CT-based radiomics model to predict clinical outcomes of advanced non-small-cell lung cancer (NSCLC) patients treated with nivolumab.

Methods: Forty-six stage IIIB/IV NSCLC patients without EGFR mutation or ALK rearrangement who received nivolumab were enrolled. After segmenting primary tumors depicting on the pre-anti-PD1 treatment CT images, 1,106 radiomics features were computed and extracted to decode the imaging phenotypes of these tumors. A L1-based feature selection method was applied to remove the redundant features and build an optimal feature pool. To predict the risk of progression-free survival (PFS) and overall survival (OS), the selected image features were used to train and test three machine-learning classifiers namely, support vector machine classifier, logistic regression classifier, and Gaussian Naïve Bayes classifier. Finally, the overall patients were stratified into high and low risk subgroups by using prediction scores obtained from three classifiers, and Kaplan–Meier survival analysis was conduct to evaluate the prognostic values of these patients.

Results: To predict the risk of PFS and OS, the average area under a receiver operating characteristic curve (AUC) value of three classifiers were 0.73 ± 0.07 and 0.61 ± 0.08, respectively; the corresponding average Harrell’s concordance indexes for three classifiers were 0.92 and 0.79. The average hazard ratios (HR) of three models for predicting PFS and OS were 6.22 and 3.54, which suggested the significant difference of the two subgroup’s PFS and OS (p<0.05).

Conclusion: The pre-treatment CT-based radiomics model provided a promising way to predict clinical outcomes for advanced NSCLC patients treated with nivolumab.

Introduction

Over the past decade, immune checkpoint inhibitors targeting programmed cell death protein-1 (PD-1) or programmed cell death protein ligand-1 (PD-L1) have opened a new epoch of treatment for advanced non-small-cell lung cancer (NSCLC), with improved survival and durable responses compared with chemotherapy in patients both in first- and second-line treatment (1–5). PD-1 or PD-L1 inhibitors pembrolizumab, nivolumab, and atezolizumab, prolonged overall survival (OS) compared with chemotherapy in patients with previously treated advanced NSCLC based on the results of Keynote-010 (1), CheckMate 017/057 (2, 3) and OAK studies (4). The phase III study CheckMate 078 has demonstrated consistent results of superior OS by nivolumab compared with docetaxel in a predominantly Chinese population with previously treated advanced NSCLC (6).

Despite remarkable success of immunotherapy, up to 60% of patients with advanced NSCLC could not benefit from PD-1 or PD-L1 inhibitors (7). Different biomarkers have been investigated to predict the efficacy and prognosis, such as PD-L1 expression and copy number gains (1–4, 8–11), tumor mutation burden (TMB) (12–14), microsatellite instability (MSI) (15), tumor infiltrating lymphocytes (16–18) and inflammatory cytokines (19). Even though the PD-L1 expression of tumor cell has been identified as a predictive biomarker for response of immunotherapy in both newly diagnosed or previously treated NSCLC (3, 4, 11), the relationship between the PD-L1 expression and the therapeutic effects of nivolumab is still unclear. Tumor heterogeneity, instability of tissue specimens, non-standardized detection techniques and the dynamic nature of the immune microenvironment are also limitations of PD-L1 expression as a predictive biomarker (20, 21). The urgent need to discover and validate non-invasive, stable predictive biomarkers to select patients who will benefit from immunotherapy remains an ongoing challenge.

Since non-invasive diagnostic images can depict the phenotypes of lung tumor, recently studies have illustrated that utilization of imaging biomarker to predict the survival stratification of advanced NSCLC patients with different therapies is feasible. Among these non-invasive imaging based prediction or classification models, CT image based radiomics approach has been developed and applied to build the prognostic prediction model for evaluating the effectiveness and necessity of developing different therapies, e.g., targeted therapeutics, chemotherapy, radiation therapy, and for early prediction of clinical outcome. The non-invasive quantitative imaging technique may provide a new approach to assess the clinical outcome at an early stage of updated PD-1 therapeutic process.

In this study, we proposed a novel CT-based radiomics model to predict the progression probability to the recommended nivolumab therapy for individually patient. To decode the imaging phenotypes of lung tumor, we computed and extracted thousands of pretherapy CT features to deeply interpret the patients treated with immunotherapy to select critical PD-1/PD-L1 associated phenotypic features. Then, we used three machine-learning classifiers to develop the CT-based radiomics models to stratify the risk of progression-free survival (PFS) and overall survival (OS) in advanced stage NSCLC patients. Finally, we analyzed and compared the Kaplan–Meier survival estimators of the stratified subgroups with high and low risk for progression and death (Figure 1).

FIGURE 1

Figure 1 Flowchart of our proposed model.

Materials and Methods

Patients

Forty-six patients with previously treated NSCLC were prescribed with nivolumab from CheckMate 078 study, CheckMate 870 study or clinical practice between Apr 2016 and Jan 2019 at Fudan University Shanghai Cancer Center. All patients were histologically or cytologically-diagnosed with locally advanced or metastatic NSCLC. Patients were included regardless of tumor PD-L1 expression. Patients with epidermal growth factor receptor (EGFR)-mutation or anaplastic lymphoma kinase (ALK) translocation-positive tumors were excluded. We retrospectively collected clinical data and treatment outcomes from the patients’ medical records. The clinical stage was assigned according to the 8th edition of the TNM staging system.

The institutional review board of Fudan University Shanghai Cancer Center approved this study.

Treatment

Patients received intravenous nivolumab at dose of 3 mg/kg or fixed dose of 240mg every two weeks until disease progression or discontinuation owing to intolerance of toxicity. All patients received a diagnostic contrast-enhanced chest CT prior to immunotherapy. All the CT scans were reconstructed by using the standard convolution kernel. The pixel spacing of CT image ranges from 0.672 mm to 0.822 mm, and the slice thickness is 1 mm or 1.5 mm. Each axial slice image was reconstructed with a matrix 512×512 pixels. The pre-treatment CT scan was collected and used as baseline imaging data.

Efficacy

Efficacy was assessed by determining PFS, OS, overall response rate (ORR) and the disease control rate (DCR). PFS was defined as the time from initiation of nivolumab therapy to disease progression or death. Patients alive without progression at the time of analysis were censored at their last follow-up. OS was defined as the time from initiation of nivolumab therapy to death. DCR was defined as the percentage of patients with a complete response (CR), partial response (PR), and stable disease (SD), while ORR was defined as the percentage with CRs and PRs. The tumor response was initially assessed after 8 weeks of nivolumab therapy and subsequently thereafter every 8 weeks using the Response Evaluation Criteria In Solid Tumors (RECIST, version 1.1). Responses were defined as the best response from the start of treatment until disease progression.

Statistical Analysis

CT images were first interpreted qualitatively and quantitatively by two radiologists (Dr. Shengping Wang with 15 years experience and Dr. Quan Liu with 28 years experience). Figure 2 shows the radiomics feature extraction process. To evaluate the therapeutic effect, radiologists provided a standardized report to record lymph node status and common sites of distant metastasis (i.e., bones, liver, and brain) for each patient during the treatment cycles. Then, the radiologists delineated the 3D boundary of each primary tumor and segmented the tumor volume by using the CT scan examined before immune treatment. The largest tumor was defined as target lesion for subject with multiple lesions in this study. All the primary tumors were segmented manually in slice by slice fashion on CT images. Due to the variant of CT parameters, a B-spline curve interpolation algorithm was used to resample the 3D CT images to a spacing of (1, 1, and 1mm). In order to character the imaging phenotypes of each tumor, 1,106 CT based radiomics features were initially computed and extracted to quantitative the tumor. Among these features, 274 LoG features, 728 wavelet features, 14 shape features, 18 histogram features, and 68 texture features were involved. The LoG features were calculated based on image filtered with Laplacian of Gaussian (LOG) filter, and wavelet features were extracted by using image filtered with wavelet filter. Since each phenotypic feature has different value range, a feature normalization technique was used to transform these radiomics features to [0, 1].

FIGURE 2

Figure 2 The radiomics feature extraction process.

Due to a large number of redundant features in the initial feature pool, a L1-based feature selection method was applied to the redundant features and reduce the dimensionality of radiomics features remove. During this process, a linear support vector classifier was used to build the meta-transformer to select the robust imaging features. After feature selection, classification models were built by training three different machine-learning classifiers namely, support vector machine (SVM) classifier, logistic regression classifier (LRC), and Gaussian Naïve Bayes (GNB) classifier, respectively. To evaluate the performance of our proposed models, a leave-one-out cross-validation (LOOCV) was used to train and test the classifier. In order to avoid biases in portioning dataset, the feature selection process and machine-learning classifier were embedded into the LOOCV training/testing cycles.

Finally, several statistical data analysis methods were applied to measure the association between the model’s predicted low or high risk scores and patients’ PFS and OS, which include 1) a Harrell’s concordance index (C-index) analysis, 2) Kaplan–Meier plots, and 3) Cox proportional hazards regression models. To assess the model’s performance, the cases were divided into two groups of low and high risk in cancer progression by applying an operation threshold of 0.5 to the prediction scores generated by three classifiers namely, SVM, NBC, and LRC.

In this study, the prediction models were built by using Python programming software (version 3.6, https://www.python.org), and the statistical data analysis process was implemented on R software (version 3.5.2, https://www.r-project.org). To evaluate the performance of our proposed model, a maximum likelihood based receiver-operating characteristic (ROC) fitting program (ROCKIT, http://www-radiology.uchicago.edu/krl, University of Chicago) was used to compute the area under a ROC curve (AUC) value and the corresponding 95% confidence interval (CI). PFS and OS were estimated by the Kaplan-Meier method, along with hazard ratios (HRs). All outcome measures were calculated with 95% CIs, which were estimated by use of the Cox proportional hazard model. The significance level of statistical tests was set at p < 0.05. All expressed p values and CIs were two-tailed. All the medical image processes and performance evaluation processes were performed on a computer with Intel Core i7-8700 CPU 3.2GHz × 2, 16 GB RAM.

Results

Patient Characteristics

A total of 46 patients with previously treated advanced NSCLC were administrated with nivolumab at Fudan University Shanghai Cancer Center between Apr 2016 and Jan 2019. Their baseline characteristics at the initiation of nivolumab therapy are shown in Table 1. The patients’ median age was 62.0 years (range, 46 to 77 years). There was a higher proportion of males (34/46, 73.9%) than females, and of current/former smokers (30/46, 65.2%) than never smokers. Thirty-four patients (73.9%) were diagnosed with adenocarcinoma while 12 patients (26.1%) were diagnosed with squamous cell carcinoma; 42 (91.3%) had stage IV disease at baseline. All 46 patients had an Eastern Cooperative Oncology Group performance status (ECOG PS) of 1.

TABLE 1

Table 1 Baseline patient characteristics (N = 46).

All patients had a routine examination before initiation of nivolumab treatment, 22 patients (47.8%) had one metastatic site, 16 patients (34.8%) had two metastatic sites and 8 patients (17.4%) had more than two metastatic sites. In 42 patients (91.3%), nivolumab was used as second-line treatment and in 4 patients (8.7%) as third-line or later treatment.

Efficacy

Tumor responses are shown in Table 2. One patient (2.2%) achieved CR, 6 patients (13.0%) achieved PR and 12 (26.1%) had SD, resulting in an ORR of 15.2% (95% CI, 4.7–25.7%) and a DCR of 43.5% (95% CI, 29.0–58.0%).

TABLE 2

Table 2 Tumor responses.

At the cutoff date Dec 13^th 2019, median follow-up time was 11.5 months (range, 1.0–46.0 months). Nineteen patients (41.3%) were still alive, 2 patients (4.3%) were lost to follow-up and 25 patients (54.3%) were dead at the cutoff date. The median PFS (Figure 3) was 3.0 months (95% CI, 1.9 to 4.1 months) and the estimated median OS (Figure 4) was 17.0 months (95%CI, 7.3–26.7 months).

FIGURE 3

Figure 3 Kaplan-Meier curve of PFS of all patients.

FIGURE 4

Figure 4 Kaplan-Meier curve of OS of all patients.

Development of Prediction Model and Survival Analysis

Figure 5 shows the boxplots of three imaging features frequently selected in LOOCV process. By using the feature selection method, three imaging features were selected from the initial 1,106 feature pool in PFS prediction process. Two LoG image features and one wavelet feature were involved. The boxplots showed that PD and non-PD category have different distributions in three features. It indicated that the selected features had a potential to classify between PD and non-PD cases. Meanwhile, four imaging features were selected to build OS prediction model, involving three LoG image features and one wavelet feature.

FIGURE 5

Figure 5 Boxplots of the frequently selected imaging features in the LOOCV process. (A) shows the imaging features selected in PFS prediction process, (B) shows the imaging features in OS prediction process.

Figure 6 illustrates the ROC curves of PFS and OS classification models built with three classifiers. To predict the risk of PD, SVM, LRC and GNB generated AUC values of 0.73 ± 0.07 [95% CI: (0.57, 0.85)], 0.73 ± 0.07 [95% CI: (0.57, 0.86)], and 0.74 ± 0.07 [95% CI: (0.58, 0.86)], respectively. Meanwhile, SVM, LRC and GNB generated AUC values of 0.60 ± 0.08 [95% CI: (0.43, 0.75)], 0.60 ± 0.08 [95% CI: (0.44, 0.75)], and 0.64 ± 0.08 [95% CI: (0.48, 0.79)]. To evaluate the inter classifier differences; the p-values of the prediction scores generated by three classifiers were computed by using a univariate z-score test. It showed that the AUC values of three classifiers were no significant difference (p>0.05).

FIGURE 6

Figure 6 ROC comparisons of PFS and OS classification models built with three classifiers namely, SVM, LRC, and GNB, respectively. (A) Illustrates the ROCs of PFS classification models, (B) illustrates the ROCs of OS prediction models.

Figure 7 shows the survival analysis results of three PFS classification models. Figure 6A compares the Harrell’s C-indexes for PFS generated by three classifiers. For SVM, LRC and GNB classifier, the C-index was 0.93 [95% CI: (0.83, 1.0)], 0.91 [95% CI: (0.79, 1.0)], and 0.92 [95% CI: (0.80, 1.0)], respectively. Figures 6B–D illustrates the Kaplan–Meier plots of PFS by using SVM, LRC and GNB classifier, respectively. The Kaplan–Meier survival curves demonstrated that the low risk cohort predicted by three classifiers was significantly different from the high-risk group by using immune therapy (p<0.05). Table 3 lists the summary of data analyses of three cox regression models for PFS. The hazard ratios (HR) of three models reach over 5.6, which suggested the dramatic difference of the two subgroup’s PFS in immune treatment (p<0.05).

FIGURE 7

Figure 7 The results of survival analysis of three PFS classification models. (A) C-indexes generated by three PFS prediction models, (B–D) Kaplan–Meier PFS estimates from all 46 patients by using SVM, LRC and GNB classifier, respectively.

TABLE 3

Table 3 Summary of data analyses of three cox regression models for PFS and OS.

Figure 8 shows the survival analysis results of three OS classification models. Figure 8A compares the Harrell’s C-indexes for OS generated by three classifiers. For SVM, LRC and GNB classifier, the C-index was 0.76 [95% CI: (0.60, 0.93)], 0.76 [95% CI: (0.60, 0.92)], and 0.86 [95% CI: (0.74, 0.97)], respectively. Figures 8B–D illustrates the Kaplan–Meier plots of OS by three prediction models. It shows that the low risk OS cohort was significantly different from the high-risk OS group in Kaplan–Meier curve (p<0.05). Table 3 lists the summary of data analyses of three cox regression models for OS. The hazard ratios (HR) of three models reach over 2.5 (p<0.05).

FIGURE 8

Figure 8 The results of survival analysis of three OS classification models. (A) C-indexes generated by three OS prediction models, (B–D) Kaplan–Meier OS estimates from all 46 patients by using SVM, LRC and GNB classifier, respectively.

Discussion

Although immunotherapy has been a pivotal development in the management of advanced NSCLC, durable responses and improved survival have been observed only in 20–50% of patients (1–5, 11, 22). Predictive biomarkers of response for immunotherapy and superior survival are urgently needed to improve patient selection and avoid toxicity in potential non-responders.

PD-L1 expression is the only biomarker currently approved by the US Food and Drug Administration (FDA) to select patients who are most likely to benefit from immunotherapy. Compared with docetaxel, nivolumab demonstrated better overall survival, with PD-L1 expression conferring enhanced efficacy in pretreated patients with advanced non-squamous NSCLC in Checkmate 057 study (3). However, among patients with advanced, previously treated squamous-cell NSCLC in Checkmate 017 study (2), OS, ORR, and PFS were significantly better with nivolumab than with docetaxel, regardless of PD-L1 expression level. The survival benefit with nivolumab was also observed regardless of PD-L1 expression level in Chinese patients with previously treated NSCLC in Checkmate 078 study (6). Another study explained that PD-L1 expression alone was insufficient to determine whether patients should receive PD-1 or PD-L1 blockade therapy (23). Furthermore, more and more studies demonstrated that there were many factors associated with the PD-L1 expression, including copy number gains (24), heterogeneity (25), dynamic changes (20) and other participants of immune cell subsets (26–28) in NSCLC. In addition to PD-L1 expression, recent research indicated that TMB of 10 or more mut/Mb was associated with improved response and prolonged PFS in both tumor PD-L1 expression 1% or greater and less than 1% subgroups and was thus identified as a potential biomarker for first-line therapy of nivolumab plus ipilimumab in advanced NSCLC (29). Although research on predictors of response to immunotherapy has sprung up, there are still few well-recognized non-invasive biomarkers of immunotherapy with high-specificity, high-sensitivity and stability.

To assess the immunotherapy response, irRECIST (Immune-related Response Evaluation Criteria in Solid Tumors), iRECIST and imRECIST (Immune-Modified Response Evaluation Criteria In Solid Tumors) were proposed (30–33). In the previously reported studies, PET/CT based response evaluation models have been investigated and developed to evaluate the short-term or long-term response of immunotherapy for lung cancer (34, 35). These studies evaluated the treatment response of immunotherapy effectively, but series PET/CT images during the immunotherapy process were needed to analyze to build prediction models. In recent years, numerous studies have evaluated the potential clinical utility of radiomics features from CT images of NSCLC, correlated with tumor histology, staging and patient prognosis (36–48). Nardone V et al. (37) used pre- and post-contrast CT sequences to contour the gross tumor volume (GTV) of the target lesions prior to nivolumab treatment. The impact of variations on contouring was analyzed by two delineations, which were performed on each patient, and the CT texture analysis (TA) parameters were tested for reliability using the Intraclass Coefficient Correlation method (ICC). The study indicated that TA parameters could identify patients that will benefit from PD‐1 blockage by defining the radiological settings that were potentially suggestive of an active immune response. Xu et al. (41) evaluated deep-learning networks for predicting clinical outcomes through analyzing time-series CT-images of locally advanced NSCLC patients. In our study, only pre-immunotherapy CT images were used to evaluate and predict the response results of immunotherapy. Thus, the treatment response might be predicted before conducting the immunotherapy by using CT images.

In this study, a non-invasive CT-based radiomics model was developed to predict the effectiveness of immunotherapy for advanced NSCLC patients. Thousands of quantitative imaging features were computed and investigated to decode the phenotypes of primary lung tumor. Then, the optimal feature pool selected from initial radiomics features were used to train and test three machine-learning classifiers to build prognosis prediction models. A LOOCV method was applied to test and evaluate the model performance. The results demonstrated that it was an effective way to predict the effectiveness of immunotherapy for advanced NSCLC patients by using machine-learning based models (i.e., results showed in Figure 6). If our models were robust by testing on the more diverse and larger dataset in future studies, it would provide a new way to predict patient’s short-term treatment response before immunotherapy prescribed in the advanced lung cancer.

To further investigate that how much extra benefit we could obtain for predicting individual patient’s PFS and OS by using the risk scores predicted by our machine-learning models, we also analyzed the survival analysis to evaluate and compare the outcomes of patients with different risk factor. Three machine-learning classifiers yielded high concordance with clinical evaluation outcomes determined by independent radiology review (IRR) for predicting PFS (i.e., C-index for SVM: 0.93, LRC: 0.91, and GNB: 0.92) and OS (i.e., C-index for SVM: 0.60, LRC: 0.60, and GNB: 0.64). Then, the Kaplan–Meier survival analysis illustrated significant difference between the high and low risk patient group for PFS and OS analysis (p<0.05).

Despite of promising results, our study had some limitations. Firstly, to develop CT radiomics models, three machine-learning classifiers were trained and tested on a relatively small dataset with only forty-six cases. Although the LOOCV method was applied in the classifier training and testing process to avoid biases, the robustness and effectiveness of our model were still needed to be evaluated by using more diverse and larger data sets. Secondly, only CT-based radiomics features were used to predict the PFS and OS of advanced NSCLC patients. Some of the other potentially useful clinical information and image features (i.e., biomarkers, MRI image, PET image) have not been explored. Thus, different kinds of features needed to be investigated in our future studies. Thirdly, only the selected target lesions were analyzed instead of all the lesions; nevertheless, the degree of enhancement after CT enhanced scanning of target lesions in different tissues will be different. Lastly, this was only a primary technology development study that just developed a CT-based radiomics model to predict clinical outcomes of advanced NSCLC patients treated with nivolumab. Due to the incomplete data of retrospective studies, we did not include clinical data, genomics and other factors for analysis. Before our prediction models were applied into clinical practice, we will conduct more clinical validation studies to improve the performance of prediction model by combining imaging technologies, clinical characteristics, genomics and other factors.

In conclusion, the novel CT-based radiomics model has the ability to predict the progression probability for patients with advanced NSCLC receiving nivolumab therapy.

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics Statement

The studies involving human participants were reviewed and approved by the institutional review board of Fudan University Shanghai Cancer Center. Written informed consent to participate in this study was provided by the patient/participants.

Author Contributions

JW and SW designed the study, collected data and verified its integrity, and helped writing the manuscript. CL, JG, and HY were responsible for statistical analysis and writing the manuscript. SW and QL were responsible for interpreting CT images and verifying the integrity of the data. All authors contributed to the article and approved the submitted version.

Funding

This study was sponsored by the Natural Science Foundation of Shanghai (No. 19ZR1410400), China Postdoctoral Science Foundation (No. 2019M651372), and National Natural Science Foundation of China (No. 82001903).

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

References

1. Herbst RS, Baas P, Kim D-W, Felip E, Pérez-Gracia JL, Han J-Y, et al. Pembrolizumab versus docetaxel for previously treated, PD-L1-positive, advanced non-small-cell lung cancer (KEYNOTE-010): a randomised controlled trial. Lancet (2016) 387:1540–50. doi: 10.1016/s0140-6736(15)01281-7

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Brahmer J, Reckamp KL, Baas P, Crino L, Eberhardt WE, Poddubskaya E, et al. Nivolumab versus Docetaxel in Advanced Squamous-Cell Non-Small-Cell Lung Cancer. N Engl J Med (2015) 373:123–35. doi: 10.1056/NEJMoa1504627

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Borghaei H, Paz-Ares L, Horn L, Spigel DR, Steins M, Ready NE, et al. Nivolumab versus Docetaxel in Advanced Nonsquamous Non-Small-Cell Lung Cancer. N Engl J Med (2015) 373:1627–39. doi: 10.1056/NEJMoa1507643

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Rittmeyer A, Barlesi F, Waterkamp D, Park K, Ciardiello F, von Pawel J, et al. Atezolizumab versus docetaxel in patients with previously treated non-small-cell lung cancer (OAK): a phase 3, open-label, multicentre randomised controlled trial. Lancet (2017) 389:255–65. doi: 10.1016/s0140-6736(16)32517-x

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Gandhi L, Rodriguez-Abreu D, Gadgeel S, Esteban E, Felip E, De Angelis F, et al. Pembrolizumab plus Chemotherapy in Metastatic Non-Small-Cell Lung Cancer. N Engl J Med (2018) 378:2078–92. doi: 10.1056/NEJMoa1801005

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Wu YL, Lu S, Cheng Y, Zhou C, Wang J, Mok T, et al. Nivolumab Versus Docetaxel in a Predominantly Chinese Patient Population With Previously Treated Advanced NSCLC: CheckMate 078 Randomized Phase III Clinical Trial. J thoracic Oncol Off Publ Int Assoc Study Lung Cancer (2019) 14:867–75. doi: 10.1016/j.jtho.2019.01.006

CrossRef Full Text | Google Scholar

7. Prelaj A, Tay R, Ferrara R, Chaput N, Besse B, Califano R. Predictive biomarkers of response for immune checkpoint inhibitors in non-small-cell lung cancer. Eur J Cancer (Oxford Engl 1990) (2019) 106:144–59. doi: 10.1016/j.ejca.2018.11.002

CrossRef Full Text | Google Scholar

8. Ma W, Gilligan BM, Yuan J, Li T. Current status and perspectives in translational biomarker research for PD-1/PD-L1 immune checkpoint blockade therapy. J Hematol Oncol (2016) 9:47. doi: 10.1186/s13045-016-0277-y

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Kerr KM, Tsao MS, Nicholson AG, Yatabe Y, Wistuba II, Hirsch FR, et al. Programmed Death-Ligand 1 Immunohistochemistry in Lung Cancer: In what state is this art? J thoracic Oncol Off Publ Int Assoc Study Lung Cancer (2015) 10:985–9. doi: 10.1097/JTO.0000000000000526

CrossRef Full Text | Google Scholar

10. Meng X, Huang Z, Teng F, Xing L, Yu J. Predictive biomarkers in PD-1/PD-L1 checkpoint blockade immunotherapy. Cancer Treat Rev (2015) 41:868–76. doi: 10.1016/j.ctrv.2015.11.001

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Reck M, Rodriguez-Abreu D, Robinson AG, Hui R, Csoszi T, Fulop A, et al. Pembrolizumab versus Chemotherapy for PD-L1-Positive Non-Small-Cell Lung Cancer. N Engl J Med (2016) 375:1823–33. doi: 10.1056/NEJMoa1606774

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Rizvi H, Sanchez-Vega F, La K, Chatila W, Jonsson P, Halpenny D, et al. Molecular Determinants of Response to Anti-Programmed Cell Death (PD)-1 and Anti-Programmed Death-Ligand 1 (PD-L1) Blockade in Patients With Non-Small-Cell Lung Cancer Profiled With Targeted Next-Generation Sequencing. J Clin Oncol Off J Am Soc Clin Oncol (2018) 36:633–41. doi: 10.1200/jco.2017.75.3384

CrossRef Full Text | Google Scholar

13. Carbone DP, Reck M, Paz-Ares L, Creelan B, Horn L, Steins M, et al. First-Line Nivolumab in Stage IV or Recurrent Non-Small-Cell Lung Cancer. N Engl J Med (2017) 376:2415–26. doi: 10.1056/NEJMoa1613493

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Rizvi NA, Hellmann MD, Snyder A, Kvistborg P, Makarov V, Havel JJ, et al. Cancer immunology. Mutational landscape determines sensitivity to PD-1 blockade in non-small cell lung cancer. Sci (New York NY) (2015) 348:124–8. doi: 10.1126/science.aaa1348

CrossRef Full Text | Google Scholar

15. Vanderwalde A, Spetzler D, Xiao N, Gatalica Z, Marshall J. Microsatellite instability status determined by next-generation sequencing and compared with PD-L1 and tumor mutational burden in 11,348 patients. Cancer Med (2018) 7:746–56. doi: 10.1002/cam4.1372

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Miller BC, Sen DR, Al Abosy R, Bi K, Virkud YV, LaFleur MW, et al. Subsets of exhausted CD8(+) T cells differentially mediate tumor control and respond to checkpoint blockade. Nat Immunol (2019) 20:326–36. doi: 10.1038/s41590-019-0312-6

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Zito Marino F, Ascierto PA, Rossi G, Staibano S, Montella M, Russo D, et al. Are tumor-infiltrating lymphocytes protagonists or background actors in patient selection for cancer immunotherapy? Expert Opin Biol Ther (2017) 17:735–46. doi: 10.1080/14712598.2017.1309387

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Mittal D, Lepletier A, Madore J, Aguilera AR, Stannard K, Blake SJ, et al. CD96 Is an Immune Checkpoint That Regulates CD8(+) T-cell Antitumor Function. Cancer Immunol Res (2019) 7:559–71. doi: 10.1158/2326-6066.cir-18-0637

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Ayers M, Lunceford J, Nebozhyn M, Murphy E, Loboda A, Kaufman DR, et al. IFN-gamma-related mRNA profile predicts clinical response to PD-1 blockade. J Clin Invest (2017) 127:2930–40. doi: 10.1172/jci91190

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Gettinger S, Herbst RS. B7-H1/PD-1 blockade therapy in non-small cell lung cancer: current status and future direction. Cancer J (Sudbury Mass) (2014) 20:281–9. doi: 10.1097/ppo.0000000000000063

CrossRef Full Text | Google Scholar

21. McLaughlin J, Han G, Schalper KA, Carvajal-Hausdorf D, Pelekanou V, Rehman J, et al. Quantitative Assessment of the Heterogeneity of PD-L1 Expression in Non-Small-Cell Lung Cancer. JAMA Oncol (2016) 2:46–54. doi: 10.1001/jamaoncol.2015.3638

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Chen DS, Mellman I. Elements of cancer immunity and the cancer-immune set point. Nature (2017) 541:321–30. doi: 10.1038/nature21349

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Shen X, Zhao B. Efficacy of PD-1 or PD-L1 inhibitors and PD-L1 expression status in cancer: meta-analysis. BMJ (Clin Res ed) (2018) 362:k3529. doi: 10.1136/bmj.k3529

CrossRef Full Text | Google Scholar

24. Inoue Y, Yoshimura K, Mori K, Kurabe N, Kahyo T, Mori H, et al. Clinical significance of PD-L1 and PD-L2 copy number gains in non-small-cell lung cancer. Oncotarget (2016) 7:32113–28. doi: 10.18632/oncotarget.8528

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Yoshimura K, Inoue Y, Mori K, Iwashita Y, Kahyo T, Kawase A, et al. Distinct prognostic roles and heterogeneity of TTF1 copy number and TTF1 protein expression in non-small cell lung cancer. Genes Chromosomes Cancer (2017) 56:570–81. doi: 10.1002/gcc.22461

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Bocanegra A, Fernandez-Hinojal G, Zuazo-Ibarra M, Arasanz H, Garcia-Granda MJ, Hernandez C, et al. PD-L1 Expression in Systemic Immune Cell Populations as a Potential Predictive Biomarker of Responses to PD-L1/PD-1 Blockade Therapy in Lung Cancer. Int J Mol Sci (2019) 20:1631. doi: 10.3390/ijms20071631

CrossRef Full Text | Google Scholar

27. Thommen DS, Schreiner J, Muller P, Herzig P, Roller A, Belousov A, et al. Progression of Lung Cancer Is Associated with Increased Dysfunction of T Cells Defined by Coexpression of Multiple Inhibitory Receptors. Cancer Immunol Res (2015) 3:1344–55. doi: 10.1158/2326-6066.cir-15-0097

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Thommen DS, Koelzer VH, Herzig P, Roller A, Trefny M, Dimeloe S, et al. A transcriptionally and functionally distinct PD-1(+) CD8(+) T cell pool with predictive potential in non-small-cell lung cancer treated with PD-1 blockade. Nat Med (2018) 24:994–1004. doi: 10.1038/s41591-018-0057-z

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Ready N, Hellmann MD, Awad MM, Otterson GA, Gutierrez M, Gainor JF, et al. First-Line Nivolumab Plus Ipilimumab in Advanced Non-Small-Cell Lung Cancer (CheckMate 568): Outcomes by Programmed Death Ligand 1 and Tumor Mutational Burden as Biomarkers. J Clin Oncol Off J Am Soc Clin Oncol (2019) 37:992–1000. doi: 10.1200/jco.18.01042

CrossRef Full Text | Google Scholar

30. Seymour L, Bogaerts J, Perrone A, Ford R, Schwartz LH, Mandrekar S, et al. iRECIST: guidelines for response criteria for use in trials testing immunotherapeutics. Lancet Oncol (2017) 18:e143–52. doi: 10.1016/s1470-2045(17)30074-8

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Tazdait M, Mezquita L, Lahmar J, Ferrara R, Bidault F, Ammari S, et al. Patterns of responses in metastatic NSCLC during PD-1 or PDL-1 inhibitor therapy: Comparison of RECIST 1.1, irRECIST and iRECIST criteria. Eur J Cancer (Oxford Engl 1990) (2018) 88:38–47. doi: 10.1016/j.ejca.2017.10.017

CrossRef Full Text | Google Scholar

32. Beer L, Hochmair M, Haug AR, Schwabel B, Kifjak D, Wadsak W, et al. Comparison of RECIST, iRECIST, and PERCIST for the Evaluation of Response to PD-1/PD-L1 Blockade Therapy in Patients With Non-Small Cell Lung Cancer. Clin Nucl Med (2019) 44:535–43. doi: 10.1097/rlu.0000000000002603

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Hodi FS, Ballinger M, Lyons B, Soria JC, Nishino M, Tabernero J, et al. Immune-Modified Response Evaluation Criteria In Solid Tumors (imRECIST): Refining Guidelines to Assess the Clinical Benefit of Cancer Immunotherapy. J Clin Oncol Off J Am Soc Clin Oncol (2018) 36:850–8. doi: 10.1200/jco.2017.75.1644

CrossRef Full Text | Google Scholar

34. Sun R, Limkin EJ, Vakalopoulou M, Dercle L, Champiat S, Han SR, et al. A radiomics approach to assess tumour-infiltrating CD8 cells and response to anti-PD-1 or anti-PD-L1 immunotherapy: an imaging biomarker, retrospective multicohort study. Lancet Oncol (2018) 19:1180–91. doi: 10.1016/s1470-2045(18)30413-3

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Kwak JJ, Tirumani SH, Van den Abbeele AD, Koo PJ, Jacene HA. Cancer immunotherapy: imaging assessment of novel treatment response patterns and immune-related adverse events. Radiographics Rev Publ Radiol Soc North America Inc (2015) 35:424–37. doi: 10.1148/rg.352140121

CrossRef Full Text | Google Scholar

36. Vuong D, Bogowicz M, Denzler S, Oliveira C, Foerster R, Amstutz F, et al. Comparison of robust to standardized CT radiomics models to predict overall survival for non-small cell lung cancer patients. Med Phys (2020) 47:4045–53. doi: 10.1002/mp.14224

PubMed Abstract | CrossRef Full Text | Google Scholar

37. Nardone V, Tini P, Pastina P, Botta C, Reginelli A, Carbone SF, et al. Radiomics predicts survival of patients with advanced non-small cell lung cancer undergoing PD-1 blockade using Nivolumab. Oncol Lett (2020) 19:1559–66. doi: 10.3892/ol.2019.11220

PubMed Abstract | CrossRef Full Text | Google Scholar

38. Khorrami M, Prasanna P, Gupta A, Patil P, Velu PD, Thawani R, et al. Changes in CT Radiomic Features Associated with Lymphocyte Distribution Predict Overall Survival and Response to Immunotherapy in Non-Small Cell Lung Cancer. Cancer Immunol Res (2020) 8:108–19. doi: 10.1158/2326-6066.cir-19-0476

PubMed Abstract | CrossRef Full Text | Google Scholar

39. Dercle L, Fronheiser M, Lu L, Du S, Hayes W, Leung DK, et al. Identification of Non-Small Cell Lung Cancer Sensitive to Systemic Cancer Therapies Using Radiomics. Clin Cancer Res an Off J Am Assoc Cancer Res (2020) 26:2151–62. doi: 10.1158/1078-0432.ccr-19-2942

CrossRef Full Text | Google Scholar

40. Yang L, Yang J, Zhou X, Huang L, Zhao W, Wang T, et al. Development of a radiomics nomogram based on the 2D and 3D CT features to predict the survival of non-small cell lung cancer patients. Eur Radiol (2019) 29:2196–206. doi: 10.1007/s00330-018-5770-y

PubMed Abstract | CrossRef Full Text | Google Scholar

41. Xu Y, Hosny A, Zeleznik R, Parmar C, Coroller T, Franco I, et al. Deep Learning Predicts Lung Cancer Treatment Response from Serial Medical Imaging. Clin Cancer Res an Off J Am Assoc Cancer Res (2019) 25:3266–75. doi: 10.1158/1078-0432.ccr-18-2495

CrossRef Full Text | Google Scholar

42. van Timmeren JE, Carvalho S, Leijenaar RTH, Troost EGC, van Elmpt W, de Ruysscher D, et al. Challenges and caveats of a multi-center retrospective radiomics study: an example of early treatment response assessment for NSCLC patients using FDG-PET/CT radiomics. PloS One (2019) 14:e0217536. doi: 10.1371/journal.pone.0217536

PubMed Abstract | CrossRef Full Text | Google Scholar

43. Trebeschi S, Drago SG, Birkbak NJ, Kurilova I, Câlin AM, Delli Pizzi A, et al. Predicting response to cancer immunotherapy using noninvasive radiomic biomarkers. Ann Oncol (2019) 30:998–1004. doi: 10.1093/annonc/mdz108

PubMed Abstract | CrossRef Full Text | Google Scholar

44. Khorrami M, Khunger M, Zagouras A, Patil P, Thawani R, Bera K, et al. Combination of Peri- and Intratumoral Radiomic Features on Baseline CT Scans Predicts Response to Chemotherapy in Lung Adenocarcinoma. Radiol Artif Intell (2019) 1:e180012. doi: 10.1148/ryai.2019180012

PubMed Abstract | CrossRef Full Text | Google Scholar

45. Bak SH, Park H, Sohn I, Lee SH, Ahn MJ, Lee HY. Prognostic Impact of Longitudinal Monitoring of Radiomic Features in Patients with Advanced Non-Small Cell Lung Cancer. Sci Rep (2019) 9:8730. doi: 10.1038/s41598-019-45117-y

PubMed Abstract | CrossRef Full Text | Google Scholar

46. Hosny A, Parmar C, Coroller TP, Grossmann P, Zeleznik R, Kumar A, et al. Deep learning for lung cancer prognostication: A retrospective multi-cohort radiomics study. PloS Med (2018) 15:e1002711. doi: 10.1371/journal.pmed.1002711

PubMed Abstract | CrossRef Full Text | Google Scholar

47. He B, Zhao W, Pi JY, Han D, Jiang YM, Zhang ZG, et al. A biomarker basing on radiomics for the prediction of overall survival in non-small cell lung cancer patients. Respir Res (2018) 19:199. doi: 10.1186/s12931-018-0887-8

PubMed Abstract | CrossRef Full Text | Google Scholar

48. Sun W, Jiang M, Dang J, Chang P, Yin FF. Effect of machine learning methods on predicting NSCLC overall survival time based on Radiomics analysis. Radiat Oncol (London England) (2018) 13:197. doi: 10.1186/s13014-018-1140-9

CrossRef Full Text | Google Scholar