Skip to main content

ORIGINAL RESEARCH article

Front. Oncol., 16 September 2024
Sec. Thoracic Oncology

Transfer learning approach in pre-treatment CT images to predict therapeutic response in advanced malignant pleural mesothelioma

  • 1Laboratorio di Biostatistica e Bioinformatica, Istituto di Ricovero e Cura a Carattere Scientifico (IRCCS) Istituto Tumori ‘Giovanni Paolo II’, Bari, Italy
  • 2Struttura Semplice Dipartimentale di Oncologia Medica Toracica, Istituto di Ricovero e Cura a Carattere Scientifico (IRCCS) Istituto Tumori ‘Giovanni Paolo II’, Bari, Italy

Introduction: Malignant pleural mesothelioma (MPM) is a poor-prognosis disease. Owing to the recent availability of new therapeutic options, there is a need to better assess prognosis. The initial clinical response could represent a useful parameter.

Methods: We proposed a transfer learning approach to predict an initial treatment response starting from baseline CT scans of patients with advanced/unresectable MPM undergoing first-line systemic therapy. The therapeutic response has been assessed according to the mRECIST criteria by CT scan at baseline and after two to three treatment cycles. We used three slices of baseline CT scan as input to the pre-trained convolutional neural network as a radiomic feature extractor. We identified a feature subset through a double feature selection procedure to train a binary SVM classifier to discriminate responders (partial response) from non-responders (stable or disease progression).

Results: The performance of the prediction classifiers was evaluated with an 80:20 hold-out validation scheme. We have evaluated how the developed model was robust to variations in the slices selected by the radiologist. In our dataset, 25 patients showed an initial partial response, whereas 13 patients showed progressive or stable disease. On the independent test, the proposed model achieved a median AUC and accuracy of 86.67% and 87.50%, respectively.

Conclusions: The proposed model has shown high performance even by varying the reference slices. Novel tools could help to improve the prognostic assessment of patients with MPM and to better identify subgroups of patients with different therapeutic responsiveness.

1 Introduction

Malignant pleural mesothelioma (MPM) is a poor-prognosis disease, mainly correlated to asbestos exposure (17). In most patients, the diagnosis of MPM occurs at an advanced stage, and systemic chemotherapy is the frontline standard of care even if usually with a palliative intent. New therapeutic strategies, including immune checkpoint inhibitors (ICIs) and antiangiogenetic agents, have shown encouraging results. First-line therapies generally achieve a partial regression or stable disease lasting an average of 6 months and, in 15%–20% of cases, even 1 year (814).

The therapeutic response of MPM depends on multiple factors, but the identification of subgroups of patients with different prognoses and responsivity to therapies is still an unmet need (15, 16). Because of the recent availability of new therapeutic options, a better prognostic assessment and the search for biomarkers capable of predicting the response to treatments are increasingly needed. As a further matter, the initial clinical response could represent a parameter useful to identify patients with a better outcome (8, 17).

The last decade has added important insights for a more accurate definition of this heterogeneous disease; both for a correct staging and for a more accurate and updated assessment of the clinical–radiological response, researchers need to make the most of the characteristics of nuclear medicine and radiological imaging for better management of these patients (1820).

Currently, in clinical practice, the CT scan represents the baseline diagnostic tool available to the multidisciplinary team that provides crucial radiological information in the decision-making process of care.

The hypothesis that motivated this work is that there are specific patient characteristics, particularly quantitative characteristics extracted from pre-treatment radiological images, that can be informative about the early response to therapy. Morphological, morphometric, and textural characteristics not visible to the human eye, but quantifiable through innovative biomedical image analysis techniques using artificial intelligence (AI) techniques, could help guide the clinicians’ therapeutic decision-making.

Indeed, the predictive value of a radiomic signature extracted from radiological images is well established at the state of the art for different oncological settings (2126). Lung cancer imaging has been recently studied with AI techniques in several settings, focusing on the early detection of pulmonary nodules, histological diagnosis and prognostic assessment, and the prediction of treatment response.

In addition, in patients with MPM, this approach (including radiological and nuclear medicine techniques, such as PET and CT images) has been proposed to provide useful information about the diagnosis and outcome of patients (2629).

To the best of our knowledge, literature data about radiomic approaches for predicting response to therapy in patients with advanced mesothelioma are scarce. For this reason, AI approaches for a better definition of prognostic models assume an important role in modern medicine in general, and even more in rare pathologies such as the main focus of this work.

In our previous study, we evaluated the prognostic power of clinical factors in predicting the initial therapeutic response of patients with advanced pleural mesothelioma (30); the results have shown that the information power contained in the clinical features alone is not negligible to predicting the initial response to therapy. However, the clinical features alone did not allow us to develop a support instrument suitable for actual clinical application. Here, we have hypothesized that a radiomic signature obtained from CT images of patients with MPM could predict the initial response to the treatment. Accordingly, the radiomic characterization of CT images of target lesions at baseline and at the time of the first disease re-evaluation could represent a possible criterion for discriminating subgroups of patients based on different responsiveness to treatments. Indeed, as already suggested in other neoplastic diseases, this radiomic signature could play a role as an imaging biomarker correlated to the patient’s outcome (3135).

In the present study, we applied a transfer learning approach on baseline CT scans of patients with advanced/unresectable MPM with the aim to evaluate the ability to early predict the treatment response on the basis of a pre-trained convolutional neural network (CNN).

Pre-trained CNNs refer to a transfer learning technique (3639): the networks have been previously trained (pre-trained CNNs) on a huge number (millions) of natural non-medical images to learn how to automatically extract features of different levels of abstraction. The acquired knowledge during training is transferred and applied to never unseen images across diverse research fields (transfer learning), such as CT images, to solve a particular task.

Pre-trained CNNs have already been successfully applied to medical imaging to solve lung cancer detection, classification, or diagnosis tasks (3944). However, such a proposal represents the first effort towards the designing of a support tool to better guide the treatment planning in patients with MPM.

We have selected three slices of baseline CT scan as input to pre-trained CNN to automatically extract low-level features, i.e., related to the local structure of the image, thus overcoming manual feature extraction. Next, an optimal feature set was detected and used to train a support vector machine (SVM) classifier (45) to discriminate responders (partial response) from non-responder (stable or disease progression) patients. Such a model could allow for the early identification of non-responder patients, thus potentially representing a suitable guide for the choice of the treatment plan.

2 Materials and methods

2.1 Materials

From July 2017 to October 2021, we collected clinical data and CT scan images of 38 consecutive patients affected by advanced/unresectable pleural mesothelioma undergoing first-line systemic treatment. Patients were enrolled according to the following criteria:

● histological diagnosis of MPM,

● first-line systemic treatment for advanced/unresectable disease,

● evaluation after at least two cycles of treatment, and

● availability of the pre-treatment CT scan.

The population sample used in this study is a subsample used in a previous study (30) for which baseline CTs were available.

The study was approved by the Ethic Committee of IRCCS—Istituto Tumori “Giovanni Paolo II” Bari, Italy (Deliberation n. 506/2023). Patients’ characteristics, including the type of treatment, are shown in Table 1. The initial response to treatment was evaluated by both clinical examination and CT scan with the mRECIST criteria (18, 19) at baseline and after two to three treatment cycles. For each patient, we have collected pre-treatment CT images that were acquired by baseline CT scans with a thickness of 0.625–3 mm and an x-ray tube current at 124–699 mA at 80–140 kVp.

Table 1
www.frontiersin.org

Table 1. Patient characteristics.

2.2 Radiomic feature extraction by pre-trained CNN

All CT images, at baseline and after two to three treatment cycles, have been retrospectively selected and evaluated by an expert radiologist with more than 20 years of experience. For each patient, measurements at three levels of the pleural lesions were made, and three CT slices were selected, including the target lesions according to the mRECIST criteria (Figure 1). The CT scans were evaluated through the portal phase study after contrast medium injection, which allows the best visualization of the pleura in all its extension.

Figure 1
www.frontiersin.org

Figure 1. Example of slices selected according to the mRECIST criteria. The baseline CT scan was evaluated by the portal phase study after contrast medium injection, which allows the best visualization of the pleura. On the basis of the slices selected by the radiologist, radiomic features are extracted from the convolutional neural network and subsequently processed with machine learning techniques.

Given the recent success of the so-called transfer learning approach across disparate fields of medical application, we used a high-performing pre-trained CNN architecture, called AlexNet, as a feature extractor (3639). The transfer learning approach is used when the sample studied is small to circumvent the data requirement for the training process of a deep neural network; it consists of extracting radiomic features by using a pre-training CNN on millions of images of different natures. The knowledge learned by the network was here transferred to our images to fulfill our classification task. AlexNet is a CNN with eight deep layers (36); it has a hierarchical structure where deeper levels are built using the functionality of the previous level. AlexNet was previously trained on millions of images of different kinds to solve discrimination tasks; the data obtained were transferred to our images to extract features useful to train a classification model to predict the treatment response.

AlexNet needs an image input size of 227 × 227; therefore, each CT slice was first resized to patches of this size. The radiomic features were extracted from planning DICOM files. We have extracted features from the first pooling layer (called “pool2”) that had an output with a size of 13 × 13 × 256 that was flattened to a single 129,792-length feature vector. The extracted features are low-level features, i.e., local details of the image, such as edges, dots, and curves.

For each patient, three slices of the baseline CT scan were used as input to the pre-trained AlexNet. Therefore, three radiomic feature vectors were associated with each case. To obtain a single vector radiomic feature corresponding to each individual patient, we calculated the average value of each feature. Since the selection of the three slices of interest, used to assess the disease extent, is operator-dependent, in this study, we aimed to verify how robust the developed model was when subjected to variations of the analyzed slices. Consequently, we evaluated the classification performance by shifting randomly two slices up and down, with respect to those selected by our operator.

2.3 Classification model design

The purpose of this study was to predict the initial therapeutic response in patients with MPM. A machine learning model was trained to discriminate responders (partial response) from non-responders (stable or disease progression). Figure 2 illustrates the overall pipeline of the classification model. For each patient, radiomic features were extracted from pre-trained CNN (as described in section 3.2). Then, a wrapper feature selection was performed on the top 10 most discriminating features evaluated in terms of AUC. Specifically, a stepwise feature selection procedure was implemented. Such a method follows a search approach of optimal features by evaluating different possible combinations of features according to a specific assessment criterion. In this study, we performed a forward feature selection based on the SVM classifier (46). The SVM classifier is a supervised machine learning algorithm that estimates the optimal hyperplane to separate the two classes by means of a kernel function. We used the linear function. The forward sequential selection algorithm identifies a subset of the features that best predict the expected result by sequentially adding at each step the feature that increases the performance of the SVM classifier evaluated in terms of AUC value on the training set of cross-validation. The procedure stops when 10 features have been included. Evaluations on a larger number of features (greater than 10) were made; however, the model did not improve performance. Indeed, also considering the small number of available patients, a greater number of features probably leads to an overfitting of the training set. The performance of the prediction classifiers was evaluated with an 80:20 hold-out validation scheme. Training and test hold-out sets were randomly selected by stratifying with respect to the outcome of interest. Moreover, the classification performances on the hold-out training set were evaluated in 10 tenfold validation rounds and expressed in terms of median and interquartile range (1st and 3rd quantile).

Figure 2
www.frontiersin.org

Figure 2. Analysis workflow. A set of radiomic features was extracted from the “Pool2” layer of AlexNet. A stepwise feature selection procedure was performed on the top 10 most discriminating features evaluated in terms of AUC. The model was evaluated with an 80:20 hold-out validation scheme. Moreover, the classification performances on the hold-out training set were evaluated in 10 tenfold validation rounds.

The classification metrics were evaluated in percentage terms of AUC value, and accuracy, sensitivity, and specificity were calculated by identifying the optimal threshold using Youden’s index on the ROC curves (46).

The same approach was used to determine the classification performances by shifting two slices up and down, with respect to those selected by our operator.

3 Results

3.1 Characteristics of dataset

Table 1 summarizes the characteristics of patients. We have collected the following data: age, gender, comorbidities, previous asbestos exposure, ECOG performance status, body mass index (BMI), smoking habits with pack/year, histotype, disease stage, presence of pleural effusion, and type of first-line treatment.

A total of 38 patients with a median age at diagnosis of 70.27 (1st–3rd quartiles of 69.05–75.60) years afferent to our institute were studied. Among them, 25 patients (65.79%) showed an initial response to therapy, while stable or progressive disease was observed in the remaining patients.

3.2 Classification performances

As described in Materials and Methods, an SVM classifier algorithm was trained on the feature subsets selected by a double procedure of filtering and stepwise algorithm. The performance of the prediction classifiers was evaluated with 80:20 hold-out validation scheme and with 10 tenfold cross-validation rounds on the hold-out training set. Therefore, we split the sample of 38 patients into a training set of 30 patients and a test set of 8 patients used as an independent set.

Among the 30 patients in the training set, 20 had a partial initial response. The proposed model achieves the best performance when selecting seven features. Table 2 summarizes the results reached by considering the CT slices selected by our operator. The model is highly performing with an AUC, accuracy, sensitivity, and specificity value of 78.50%, 80.00%, 87.50% and 75%, respectively.

Table 2
www.frontiersin.org

Table 2. Classification performances achieved on the training and test set of the hold-out validation scheme by the radiomic-based model trained using the slices selected by our radiologist.

Among the eight patients in the test set, five had a partial initial response. The model achieved stable performances also on the test set. Indeed, our preliminary model has shown the values of median AUC value, accuracy, sensitivity, and specificity of 86.67%, 876.67%, 80.00%, and 100%, respectively.

The proposed model provides for the selection of the three reference slices by the radiologist according to the mRECIST criteria. We wanted to verify that the developed algorithm was robust with respect to variations in the selection of these slides. Therefore, we evaluated the model performances by shifting randomly two slices up or down in the pre-treatment CT images with respect to those identified by our operator. In this scenario, the number model selected four features and, as shown in Table 3, the model seems to remain highly performing even by varying the reference slices, by reaching an AUC value and an accuracy of 77.88% and 85.00% on the training set, whereas in the hold-out test set, they were 73.33% and 75.00%.

Table 3
www.frontiersin.org

Table 3. Classification performance achieved on the training and test set of the hold-out validation scheme by the radiomic-based model trained using the shifted slices from those selected by our radiologist.

4 Discussion

Our experience aimed to evaluate the radiomic approach for predicting therapeutic response in patients with advanced/unresectable MPM. Some previous studies, mainly in other malignancies, showed interesting results by using radiomics to assess prognosis and predict the patients’ outcome (21, 23, 2527, 29, 33, 35, 4044).

Regarding MPM, in the last few years, the search for selecting some clinical and imaging-based biomarkers has grown (47, 48); given the recent availability of new therapeutic regimens, there is a need to better select subgroups of patients with different prognoses and levels of treatment responsiveness.

In particular, the microenvironmental landscape of mesothelioma and some clinical–biological determinants as circulating immune cells and cytokines or genomic characteristics could be integrated into histopathological aspects (4958), thus better defining the prognosis and responsiveness to different therapeutic options. The AI techniques could be promising tools in the diagnostic and therapeutic management of pleural mesothelioma; indeed, the large amount of data that can be analyzed using these techniques could help to create algorithms potentially useful to the screening and/or early diagnosis of this disease as well as improve diagnostic accuracy through the introduction of digital pathology (59, 60). Based on previous studies that have highlighted the potential of radiomics, also in patients with MPM, this approach deserves further investigation.

It is noteworthy that the data extracted and processed by the AI techniques arise from imaging procedures, such as CT and PET scans, which are part of the diagnostic and therapeutic management of MPM according to clinical practice guidelines. Hence, such an approach could provide further information useful to MPM management without additional costs for the healthcare system and without any further and/or invasive diagnostic procedures.

The radiomics application to MPM has been generally investigated with the aim of improving the diagnosis and better defining the stage of disease (6165). Our experience arose from the idea of testing whether radiomics and transfer learning techniques could be useful to assist clinicians in the choice of therapeutic strategy on the basis of a more accurate prognostic assessment and on the possible early prediction of the treatment outcome.

Currently, the recent expansion of the therapeutic landscape of MPM makes it necessary to select patients likely responsive to innovative therapies now available; therefore, the research of clinical and imaging data as biomarkers could support the treatment planning (66, 67).

Literature data about the possible identification of patients and disease characteristics of early prediction of treatment response are lacking and needed.

In this scenario, starting from the imaging performed routinely, the herein proposed tool may provide an early prediction of the initial response to therapy, helping to identify patients who will not respond after the first two cycles of therapy and who will probably deserve a different therapeutic management, or at least require a closer monitoring.

Although preliminary, our data about the initial response prediction are promising. The proposed model has been evaluated with cross-validation scheme reaching an AUC value and an accuracy of 78.50% and 80.00%, respectively. The classification performance was stable on the hold-out test set validation scheme with an AUC value and an accuracy of 86.67% and 87.50%, respectively. Furthermore, since the model was developed starting from the three CT slices selected by the radiologist according to the mRECIST criteria, as per clinical practice in the tumor staging phase, we wanted to evaluate how robust the model was to variations in the operator choice of slices of reference analyzed. By randomly shifting the slides indicated by our radiologist by two slices, the model proved to be stable.

Our model exploits CT images commonly carried out in clinical practice at baseline, so it fits right into this initial phase of the treatment process. The automated radiomic-based system here proposed aims to support clinicians in planning a tailored treatment strategy.

The main limitation of this study is the small number of patients, although the results refer to a homogeneous sample population, allowing to better highlight the association between the radiomic signature and the outcome of interest. Therefore, the future goal is the collation of a larger number of patients and with a longer follow-up. Moreover, in this work, we decided to use the entire slice of CT scan instead of a specific region of interest, given the particular radiological and morphological presentation patterns of pleural mesothelioma that could lead to evaluation bias in the segmentation phase. However, further insights of our study will also concern the evaluation of the model on suitably segmented regions of interest.

Moreover, in this study, we have preferred to use a shallower pre-trained neural network such as AlexNet. Compared to other networks that perform concatenation of operations before arriving at pooling (e.g., ResNet or DenceNet class), AlexNet learns features that are more generalizable by increasing the classification capacity of the medical image database. However, in future studies, we will evaluate and compare other pre-trained CNN architectures (68). Finally, since these are radiomic features extracted from a pre-trained convolutional network, and not handcrafted features, it is not possible to explain the meaning of the selected features. Indeed, unlike handcrafted features for which the physical meaning of the extracted radiomic features is known, it is particularly complex to explain the meaning of radiomic features extracted from a pre-trained convolutional network because it is extracted on images that have undergone a series of convolutional operations, pooling, and normalization. However, the dense literature on biomedical image analysis has amply demonstrated that features extracted through pre-trained CNNs are more informative than handcrafted ones because they capture the local structure of the image at a deeper level (points, edges, textures, etc.). However, future developments of the study involve collecting a significantly larger study sample that will enable end-to-end training of a CNN. In that case, as the features are extracted directly from the image of interest and not by transfer of knowledge from a pre-trained network of a different nature (transfer learning), it is possible to identify at least the areas found to be most informative through the application of recent explainable AI techniques (69, 70).

A further future development, in the perspective of defining a highly personalized model, could be a multimodal model that can also jointly evaluate, in addition to radiomic characteristics, quantitative characteristics extracted from images of digitalized biopsy slides and genomic data. Certainly, it is a particularly ambitious project that requires a significant effort to collect a consistent and complete case history of information and data, especially given the rare nature of the pathology under examination. Nonetheless, the development of such a multimodal model could lead to valuable results useful for patient management.

5 Conclusions

The lack of screening tests, albeit for subjects at risk due to previous asbestos exposure, together with the generally late diagnosis due to the absence of specific symptoms, makes Malignant pleural mesothelioma a tumor with a poor prognosis. For this reason, AI approaches for a better definition of prognostic models assume an important role in modern medicine in general, even more so for rare pathologies such as the one object of this work. Our proposed approach is particularly valuable as it aims to provide these insights without the need for invasive procedures or incurring additional costs beyond those typically associated with standard clinical practice.

In addition, our model could represent a part of a multimodal strategy by including it in a clinical workflow not only to improve the prognostic assessment of patients with MPM but also to identify subgroups of patients with different responsiveness to treatments. A further qualifying element of this approach is represented by the possibility of using AI techniques based on CT scans and images normally used in clinical practice, therefore not requiring invasive or additional tests for patients. Although further validation on a larger sample population is needed, our study supports the hypothesis that AI techniques, by evaluating radiomics and other parameters (clinical, pathological, and genomic data), could generate algorithms potentially useful to predict patient outcomes. Such a global approach deserves further investigation given that innovative treatments are being studied and are about to become more widely available in MPM; in this scenario, the choice of the treatment strategy should consider the costs of new drugs and the need to avoid unnecessary toxicities, thus preserving the quality of life of unresponsive patients and finally leaning towards the goal of precision medicine in patients with MPM as well.

Data availability statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics statement

The studies involving humans were approved by Comitato Etico Locale “Gabriella Serio”. The studies were conducted in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study.

Author contributions

AF: Conceptualization, Data curation, Formal analysis, Methodology, Software, Validation, Writing – original draft, Writing – review & editing. AC: Conceptualization, Data curation, Formal analysis, Methodology, Resources, Supervision, Writing – original draft, Writing – review & editing. SB: Writing – review & editing. MCC: Writing – review & editing. MM: Writing – review & editing. AS: Data curation, Writing – review & editing. RS: Writing – original draft, Writing – review & editing. PPi: Conceptualization, Formal analysis, Writing – original draft, Writing – review & editing. PPe: Data curation, Writing – review & editing. DG: Resources, Supervision, Writing – review & editing. RM: Conceptualization, Formal analysis, Methodology, Resources, Supervision, Writing – review & editing.

Funding

The author(s) declare financial support was received for the research, authorship, and/or publication of this article. This work was supported by funding from the Italian Ministry of Health, Ricerca Corrente 2024 deliberation n.91/2024.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Author disclaimer

The authors affiliated with Istituto Tumori “Giovanni Paolo II,” IRCCS, Bari are responsible for the views expressed in this article, which do not necessarily represent the ones of the institute.

References

1. van der Bij S, Koffijberg H, Burgers JA, Baas P, Van de Vijver MJ, De Mol BAJM, et al. Prognosis and prognostic factors of patients with mesothelioma: a population-based study. Br J Cancer. (2012) 107:161–4. doi: 10.1038/bjc.2012.245

PubMed Abstract | Crossref Full Text | Google Scholar

2. Verma V, Ahern CA, Berlind CG, Lindsay WD, Shabason J, Sharma S, et al. Survival by histologic subtype of Malignant pleural mesothelioma and the impact of surgical resection on overall survival. Clin Lung Cancer. (2018) 19:e901–12. doi: 10.1016/j.cllc.2018.08.007

PubMed Abstract | Crossref Full Text | Google Scholar

3. Lin RT, Takahashi K, Karjalainen A, Hoshuyama T, Wilson D, Kameda T, et al. Ecological association between asbestos-related diseases and historical asbestos consumption: an international analysis. Lancet. (2007) 369:844–9. doi: 10.1016/S0140-6736(07)60412-7

PubMed Abstract | Crossref Full Text | Google Scholar

4. Gariazzo C, Gasparrini A, Marinaccio A. Asbestos consumption and Malignant mesothelioma mortality trends in the major user countries. Ann Global Health. (2023) 89:11. doi: 10.5334/aogh.4012

Crossref Full Text | Google Scholar

5. Alpert N, van Gerwen M, Taioli E. Epidemiology of mesothelioma in the 21st century in Europe and the United States, 40 years after restricted/banned asbestos use. Trans Lung Cancer Res. (2020) 9:S28. doi: 10.21037/tlcr

Crossref Full Text | Google Scholar

6. Yang H, Testa JR, Carbone M. Mesothelioma epidemiology, carcinogenesis, and pathogenesis. Curr Treat options Oncol. (2008) 9:147–57. doi: 10.1007/s11864-008-0067-z

PubMed Abstract | Crossref Full Text | Google Scholar

7. Taioli E, Wolf A, Alpert N, Rosenthal D, Flores R. Malignant pleural mesothelioma characteristics and outcomes: A SEER-Medicare analysis. J Surg Oncol. (2023) 128.1:134–41. doi: 10.1002/jso.27243

Crossref Full Text | Google Scholar

8. Terenziani R, Zoppi S, Fumarola C, Alfieri R, Bonelli M. Immunotherapeutic approaches in Malignant pleural mesothelioma. Cancers. (2021) 13:2793. doi: 10.3390/cancers13112793

PubMed Abstract | Crossref Full Text | Google Scholar

9. Cantini L, Hassan R, Sterman DH, Aerts JG. Emerging treatments for Malignant pleural mesothelioma: where are we heading? Front Oncol. (2020) 10:343. doi: 10.3389/fonc.2020.00343

PubMed Abstract | Crossref Full Text | Google Scholar

10. Baas P, Scherpereel A, Nowak AK, Fujimoto N, Peters S, Tsao AS, et al. First-line nivolumab plus ipilimumab in unresectable Malignant pleural mesothelioma (CheckMate 743): a multicentre, randomised, open-label, phase 3 trial. Lancet Jan. (2021) 30:397. doi: 10.1016/S0140-6736(20)32714-8

Crossref Full Text | Google Scholar

11. Scherpereel A, Mazieres J, Greillier L, Lantuejoul S, Dô P, Bylicki O, et al. Nivolumab or nivolumab plus ipilimumab in patients with relapsed Malignant pleural mesothelioma (IFCT-1501 MAPS2): A multicentre, open-label, randomised, non-comparative, phase 2 trial. Lancet Oncol. (2019) 20:239–53. doi: 10.1016/S1470-2045(18)30765-4

PubMed Abstract | Crossref Full Text | Google Scholar

12. Pinto C, Zucali PA, Pagano M, Grosso F, Pasello G, Garassino MC, et al. Gemcitabine with or without ramucirumab as second-line treatment for Malignant pleural mesothelioma (RAMES): a randomised, double-blind, placebo-controlled, phase 2 trial. Lancet Oncol. (2021) 22:1438–47. doi: 10.1016/S1470-2045(21)00404-6

PubMed Abstract | Crossref Full Text | Google Scholar

13. Zalcman G, Mazieres J, Margery J, Greillier L, Audigier-Valette C, Moro-Sibilot D, et al. French Cooperative Thoracic Intergroup (IFCT). (2016) Bevacizumab for newly diagnosed pleural mesothelioma in the Mesothelioma Avastin Cisplatin Pemetrexed Study (MAPS): a randomised, controlled, open-label, phase 3 trial. Lancet. 387:1405–14. doi: 10.1016/S0140-6736(15)01238-6

PubMed Abstract | Crossref Full Text | Google Scholar

14. Shavelle R, Vavra-Musser K, Lee J, Brooks J. Life expectancy in pleural and peritoneal mesothelioma. Lung Cancer Int. (2017) 2017:2782590. doi: 10.1155/2017/2782590

PubMed Abstract | Crossref Full Text | Google Scholar

15. Takamori S, Toyokawa G, Shimokawa M, Kinoshita F, Kozuma Y, Matsubara T, et al. The C-reactive protein/albumin ratio is a novel significant prognostic factor in patients with Malignant pleural mesothelioma: A retrospective multi-institutional study. Ann Surg Oncol. (2018) 25:1555–63. doi: 10.1245/s10434-018-6385-x

PubMed Abstract | Crossref Full Text | Google Scholar

16. Brims FJH, Meniawy TM, Duffus I, de Fonseka D, Segal A, Creaney J, et al. A novel clinical prediction model for prognosis in Malignant pleural mesothelioma using decision tree analysis. J Thorac Oncol. (2016) 11:573–82. doi: 10.1016/j.jtho.2015.12.108

PubMed Abstract | Crossref Full Text | Google Scholar

17. Chen M, Lu H, Copley SJ, Han Y, Logan A, Viola P, et al. A novel radiogenomics biomarker for predicting treatment response and pneumotoxicity from programmed cell death protein or ligand-1 inhibition immunotherapy in NSCLC. J Thorac Oncol. (2023) 18:718–30. doi: 10.1016/j.jtho.2023.01.089

PubMed Abstract | Crossref Full Text | Google Scholar

18. Byrne MJ, Nowak AK. Modified RECIST criteria for assessment of response in Malignant pleural mesothelioma. Ann Oncol. (2004) 15:257–60. doi: 10.1093/annonc/mdh059

PubMed Abstract | Crossref Full Text | Google Scholar

19. Armato SG III, Nowak AK. Revised modified response evaluation criteria in solid tumors for assessment of response in Malignant pleural mesothelioma (version 1.1). J Thorac Oncol. (2018) 13:1012–21. doi: 10.1016/j.jtho.2018.04.034

PubMed Abstract | Crossref Full Text | Google Scholar

20. Katz SI, Straus CM, Roshkovan L, Blyth KG, Frauenfelder T, Gill RR, et al. Considerations for imaging of Malignant pleural mesothelioma: A consensus statement from the international mesothelioma interest group. J Thorac Oncol. (2023) 18:278–98. doi: 10.1016/j.jtho.2022.11.018

PubMed Abstract | Crossref Full Text | Google Scholar

21. Comes MC, La Forgia D, Didonna V, Fanizzi A, Giotta F, Latorre A, et al. Early prediction of breast cancer recurrence for patients treated with neoadjuvant chemotherapy: a transfer learning approach on DCE-MRIs. Cancers. (2021) 13:2298. doi: 10.3390/cancers13102298

PubMed Abstract | Crossref Full Text | Google Scholar

22. Fanizzi A, Basile TMA, Losurdo L, Amoroso N, Bellotti R, Bottigli U, et al. Hough transform for clustered microcalcifications detection in full-field digital mammograms. In: Applications of digital image processing XL (2017) 10396: 218–29. SPIE.

Google Scholar

23. Comes MC, Fanizzi A, Bove S, Didonna V, Diotaiuti S, La Forgia D, et al. Early prediction of neoadjuvant chemotherapy response by exploiting a transfer learning approach on breast DCE-MRIs. Sci Rep. (2021) 11:1–12. doi: 10.1038/s41598-021-93592-z

PubMed Abstract | Crossref Full Text | Google Scholar

24. Tangaro S, Fanizzi A, Amoroso N, Bellotti R, Alzheimer’s Disease Neuroimaging Initiative. A fuzzy-based system reveals Alzheimer’s Disease onset in subjects with Mild Cognitive Impairment. Physica Med. (2017) 38:36–44. doi: 10.1016/j.ejmp.2017.04.027

Crossref Full Text | Google Scholar

25. Frix A-N, Cousin F, Refaee T, et al. Radiomics in lung diseases imaging : state-of-the-art for clinicians. J Pers.Med. (2021) 11:602. doi: 10.3390/jpm11070602

PubMed Abstract | Crossref Full Text | Google Scholar

26. Thawani R, McLane M, Beig N, Bottari F, Vaidyanathan A, Desir C, et al. Radiomics and radiogenomics in lung cancer: a review for the clinician. Lung Cancer. (2018) 115:34–41. doi: 10.1016/j.lungcan.2017.10.015

PubMed Abstract | Crossref Full Text | Google Scholar

27. Sugarbaker PH, Chang D, Jelinek JS. Concerning CT features predict outcome of treatment in patients with Malignant peritoneal mesothelioma. Eur J Surg Oncol. (2021) 47:2212–9. doi: 10.1016/j.ejso.2021.04.012

PubMed Abstract | Crossref Full Text | Google Scholar

28. Lee HY, Hyun SH, Lee KS, Kim BT, Kim J, Shim YM, et al. Volume-based parameter of 18F-FDG PET/CT in Malignant pleural mesothelioma: prediction of therapeutic response and prognostic implications. Ann Surg Oncol. (2010) 17:2787–94. doi: 10.1245/s10434-010-1107-z

PubMed Abstract | Crossref Full Text | Google Scholar

29. Pavic M, Bogowicz M, Kraft J, Vuong D, Mayinger M, Kroeze SGC, et al. FDG PET versus CT radiomics to predict outcome in Malignant pleural mesothelioma patients. EJNMMI Res. (2020) 10:1–8. doi: 10.1186/s13550-020-00669-3

PubMed Abstract | Crossref Full Text | Google Scholar

30. Massafra R, Catino A, Perrotti PMS, Pizzutilo P, Fanizzi A, Montrone M, et al. Informative power evaluation of clinical parameters to predict initial therapeutic response in patients with advanced pleural mesothelioma: A machine learning approach. J Clin Med. (2022) 11:1659. doi: 10.3390/jcm11061659

PubMed Abstract | Crossref Full Text | Google Scholar

31. Catino A, Fanizzi A, Perrotti PPS, Pizzutilo P, Montrone M, Galetta D, et al. 125P Radiomic signature from baseline CT Scan to predict initial response to treatment in advanced/unresectable pleural mesothelioma: Preliminary data. Ann Oncol. (2022) 33:S89–90. doi: 10.1016/j.annonc.2022.02.153

Crossref Full Text | Google Scholar

32. Denzler S, Vuong D, Bogowicz M, Ghose S, Prasanna P, Velcheti V, et al. Impact of CT convolution kernel on robustness of radiomic features for different lung diseases and tissue types. Br J Radiol. (2021) 94:20200947. doi: 10.1259/bjr.20200947

PubMed Abstract | Crossref Full Text | Google Scholar

33. Dercle L, Fronheiser M, Lu L, Du S, Hayes W, Leung DK, et al. Identification of non-small cell lung cancer sensitive to systemic cancer therapies using radiomics. Clin Cancer Res. (2020) 26:2151–62. doi: 10.1158/1078-0432.CCR-19-2942

PubMed Abstract | Crossref Full Text | Google Scholar

34. Zhou J, Xin H. Emerging artificial intelligence methods for fighting lung cancer: A survey. Clin eHealth. (2022) 5:19–34. doi: 10.1016/j.ceh.2022.04.001

Crossref Full Text | Google Scholar

35. Chetan MR, Gleeson FV. Radiomics in predicting treatment response in non-small-cell lung cancer: Current status, challenges and future perspectives. Eur Radiol. (2021) 31:1049–58. doi: 10.1007/s00330-020-07141-9

PubMed Abstract | Crossref Full Text | Google Scholar

36. LeCun Y, Bengio Y, Hinton G. Deep learning. Nature. (2015) 521:436–44. doi: 10.1038/nature14539

PubMed Abstract | Crossref Full Text | Google Scholar

37. Russakovsky O, Deng J, Su H, Krause J, Satheesh S, Ma S, et al. ImageNet large scale visual recognition challenge. Int J Comp Vis. (2015) 115:211–52. doi: 10.1007/s11263-015-0816-y

Crossref Full Text | Google Scholar

38. Bera K, Braman N, Gupta A, Velcheti V, Madabhushi A. Predicting cancer outcomes with radiomics and artificial intelligence in radiology. Nat Rev Clin Onc. (2022) 19:132–46. doi: 10.1038/s41571-021-00560-7

Crossref Full Text | Google Scholar

39. Krizhevsky A, Sutskever I, Hinton GE. ImageNet classification with deep convolutional neural networks. Communications of the ACM. (2017) 60(6):84–90.

Google Scholar

40. Sajja TK, Devarapalli RM, Kalluri HK. Lung cancer detection based on CT scan images by using deep transfer learning. Traitement du Signal. (2019) 36:339–44. doi: 10.18280/ts

Crossref Full Text | Google Scholar

41. Al-Huseiny MS, Sajit AS. Transfer learning with GoogLeNet for detection of lung cancer. Indonesian J Electrical Eng Comput Sci. (2021) 22:1078–86. doi: 10.11591/ijeecs.v22.i2

Crossref Full Text | Google Scholar

42. Xu Y, Hosny A, Zeleznik R, Parmar C, Coroller T, Franco I, et al. Deep learning predicts lung cancer treatment response from serial medical imaging. Clin Cancer Res. (2019) 25:3266–75. doi: 10.1158/1078-0432.CCR-18-2495

PubMed Abstract | Crossref Full Text | Google Scholar

43. Wang S, Dong L, Wang X, Wang X. Classification of pathological types of lung cancer from CT images by deep residual neural networks with transfer learning strategy. Open Med. (2020) 15:190–7. doi: 10.1515/med-2020-0028

Crossref Full Text | Google Scholar

44. Humayun M, Sujatha R, Almuayqil SN, Jhanjhi NZ A transfer learning approach with a convolutional neural network for the classification of lung carcinoma. Healthcare. (2022) 10 (6):1058. MDPI.

PubMed Abstract | Google Scholar

45. Cyran KA, Kawulok J, Kawulok M, Stawarz M, Michalak M, Pietrowska M, et al. Support Vector Machines in Biomedical and Biometrical Applications. In: Ramanna S, Jain L, Howlett R, editors. Emerging Paradigms in Machine Learning. Smart Innovation, Systems and Technologies, vol. 13 . Springer, Berlin, Heidelberg (2013) 379–417.

Google Scholar

46. Youden WJ. Index for rating diagnostic tests. Cancer. (1950) 3:32–5. doi: 10.1002/(ISSN)1097-0142

PubMed Abstract | Crossref Full Text | Google Scholar

47. Bera K, Velcheti V, Madabhushi A. Novel quantitative imaging for predicting response to therapy: techniques and clinical applications. Am Soc Clin Oncol Educ Book. (2018) 38:1008–18. doi: 10.1200/EDBK_199747

PubMed Abstract | Crossref Full Text | Google Scholar

48. Coroller TP, Agrawal V, Narayan V, Hou Y, Grossmann P, Lee SW, et al. Radiomic phenotype features predict pathological response in non-small cell lung cancer. Radiother Oncol. (2016) 119:480–6. doi: 10.1016/j.radonc.2016.04.004

PubMed Abstract | Crossref Full Text | Google Scholar

49. Takamori S, Toyokawa G, Shimokawa M, Kinoshita F, Kozuma Y, Matsubara T, et al. Potential diagnostic and prognostic role of microenvironment in Malignant pleural mesothelioma. J Thorac.Oncol. (2019) 14:1458–71. doi: 10.1016/j.jtho.2019.03.029

PubMed Abstract | Crossref Full Text | Google Scholar

50. Ujiie H, Kadota K, Nitadori J-I, Aerts JG, Woo KM, Sima CS, et al. The tumoral and stromal immune microenvironment in Malignant pleural mesothelioma: A comprehensive analysis reveals prognostic immune markers. OncoImmunology. (2015) 4:e1009285. doi: 10.1080/2162402X.2015.1009285

PubMed Abstract | Crossref Full Text | Google Scholar

51. Yeap BY, De Rienzo A, Gill RR, Oster ME, Dao MN, Dao NT, et al. Mesothelioma risk score: a new prognostic pretreatment, clinical molecular algorithm for Malignant pleural mesothelioma. J Thorac Oncol. (2021) 16:1925–35. doi: 10.1016/j.jtho.2021.06.014

PubMed Abstract | Crossref Full Text | Google Scholar

52. Mankor JM, Disselhorst MJ, Poncin M, Baas P, Aerts JGJV, Vroman H. Efficacy of nivolumab and ipilimumab in patients with Malignant pleural mesothelioma is related to a subtype of effector memory cytotoxic T cells: translational evidence from two clinical trials. EBioMedicine. (2020) 62. doi: 10.1016/j.ebiom.2020.103040

Crossref Full Text | Google Scholar

53. Brcic L, Kern I. Clinical significance of histologic subtyping of Malignant pleural mesothelioma. Transl Lung Cancer Res. (2020) 9:924–33. doi: 10.21037/tlcr

PubMed Abstract | Crossref Full Text | Google Scholar

54. Bueno R, Stawiski E, Goldstein L. Comprehensive genomic analysis of Malignant pleural Mesothelioma identifies recurrent mutations, gene fusions, and splicing alterations. Nat Genet. (2016) 48:407–16. doi: 10.1038/ng.3520

PubMed Abstract | Crossref Full Text | Google Scholar

55. Lettieri S, Bortolotto C, Agustoni F, Lococo F, Lancia A, Comoli P, et al. The evolving landscape of the molecular epidemiology of Malignant pleural mesothelioma. J Clin Med. (2021) 10:1034. doi: 10.3390/jcm10051034

PubMed Abstract | Crossref Full Text | Google Scholar

56. Paajanen J, Bueno R, DeRienzo A. The rocky road from preclinical findings to successful targeted therapy in pleural mesothelioma. Int J Mol Sci. (2022) 23:13422. doi: 10.3390/ijms232113422

PubMed Abstract | Crossref Full Text | Google Scholar

57. Perrino M, De Vincenzo F, Cordua N, Borea F, Aliprandi M, Santoro A, et al. Immunotherapy with immune checkpoint inhibitors and predictive biomarkers in Malignant mesothelioma: Work still in progress. Front Immunol. (2023) 14:1121557. doi: 10.3389/fimmu.2023.1121557

PubMed Abstract | Crossref Full Text | Google Scholar

58. Martini K, Frauenfelder T. Old borders and new horizons in multimodality imaging of Malignant pleural mesothelioma. Thorac Cardiovasc Surg. (2022) 70:677–83. doi: 10.1055/s-0041-1728714

PubMed Abstract | Crossref Full Text | Google Scholar

59. Sakamoto T, Furukawa T, Lami K, Pham HHN, Uegami W, Kuroda K, et al. A narrative review of digital pathology and artificial intelligence: focusing on lung cancer. Trans Lung Cancer Res. (2020) 9:2255. doi: 10.21037/tlcr

Crossref Full Text | Google Scholar

60. Comes MC, Fucci L, Mele F, Bove S, Cristofaro C, De Risi I, et al. A deep learning model based on whole slide images to predict disease-free survival in cutaneous melanoma patients. Sci Rep. (2022) 12:20366. doi: 10.1038/s41598-022-24315-1

PubMed Abstract | Crossref Full Text | Google Scholar

61. Gudmundsson E, Straus CM, Armato SG III. Deep convolutional neural networks for the automated segmentation of Malignant pleural mesothelioma on computed tomography scans. J Med Imaging. (2018) 5:034503–3. doi: 10.1117/1.JMI.5.3.034503

Crossref Full Text | Google Scholar

62. Gudmundsson E, Straus CM, Li F, Armato SG III. Deep learning-based segmentation of Malignant pleural mesothelioma tumor on computed tomography scans: application to scans demonstrating pleural effusion. J Med Imaging. (2020) 7:012705–5. doi: 10.1117/1.JMI.7.1.012705

Crossref Full Text | Google Scholar

63. Kitajima K, Matsuo H, Kono A, Kuribayashi K, Kijima T, Hashimoto M, et al. Deep learning with deep convolutional neural network using FDG-PET/CT for Malignant pleural mesothelioma diagnosis. Oncotarget. (2021) 12:1187. doi: 10.18632/oncotarget.v12i12

PubMed Abstract | Crossref Full Text | Google Scholar

64. Anderson O, Kidd AC, Goatman KA, Weir AJ, Voisey J, Dilys V, et al. Fully automated volumetric measurement of Malignant pleural mesothelioma from computed tomography images by deep learning: preliminary results of an internal validation. In Bioimaging. (2020), 64–73. doi: 10.1136/thoraxjnl-2021-217808

Crossref Full Text | Google Scholar

65. Kidd AC, Anderson O, Cowell GW, Weir AJ, Voisey JP, Evison M, et al. Fully automated volumetric measurement of Malignant pleural mesothelioma by deep learning AI: Validation and comparison with modified RECIST response criteria. Thorax. (2022) 77:1251–9. doi: 10.1136/thoraxjnl-2021-217808

PubMed Abstract | Crossref Full Text | Google Scholar

66. Wolf AS, Rosenthal A, Giroux DJ, Nowak AK, Bille A, de Perrot M, et al. The IASLC pleural mesothelioma staging project: updated modeling of prognostic factors in pleural mesothelioma. J Thorac Oncol. (2023) 18.12:1689–702. doi: 10.1016/j.jtho.2023.08.005

PubMed Abstract | Crossref Full Text | Google Scholar

67. Tagliamento M, Di Maio M, Remon J, Bironzo P, Genova C, Facchinetti F, et al. Brief report: Meta-analysis on chemotherapy and PD-(L) 1 blockade combination as first-line treatment for unresectable pleural mesothelioma. Journal of Thoracic Oncology: Official Publication of the International Association for the Study of Lung Cancer. (2023) S1556–0864. doi: 10.1016/j.jtho.2023.08.004

Crossref Full Text | Google Scholar

68. Alebiosu DO, Muhammad FP. (2019). Medical image classification: A comparison of deep pre-trained neural networks, in: 2019 IEEE Student Conference on Research and Development (SCOReD), pp. 306–10. IEEE.

Google Scholar

69. Fanizzi A, Comes MC, Bove S, Cavalera E, de Franco P, Di Rito A, et al. Explainable prediction model for the human papillomavirus status in patients with oropharyngeal squamous cell carcinoma using CNN on CT images. Sci Rep. (2024) 14:14276. doi: 10.1038/s41598-024-65240-9

PubMed Abstract | Crossref Full Text | Google Scholar

70. Nazir S, Dickson DM, Akram MU. Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks. Comput Biol Med. (2023) 156:106668. doi: 10.1016/j.compbiomed.2023.106668

PubMed Abstract | Crossref Full Text | Google Scholar

Keywords: malignant pleural mesothelioma, convolutional neural network, machine learning, mRECIST, CT images, response to therapy

Citation: Fanizzi A, Catino A, Bove S, Comes MC, Montrone M, Sicolo A, Signorile R, Perrotti P, Pizzutilo P, Galetta D and Massafra R (2024) Transfer learning approach in pre-treatment CT images to predict therapeutic response in advanced malignant pleural mesothelioma. Front. Oncol. 14:1432188. doi: 10.3389/fonc.2024.1432188

Received: 13 May 2024; Accepted: 15 August 2024;
Published: 16 September 2024.

Edited by:

Iacopo Petrini, University of Pisa, Italy

Reviewed by:

Lorenzo Belluomini, University of Verona, Italy
Emina Talakic, Medical University of Graz, Austria

Copyright © 2024 Fanizzi, Catino, Bove, Comes, Montrone, Sicolo, Signorile, Perrotti, Pizzutilo, Galetta and Massafra. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Samantha Bove, s.bove@oncologico.bari.it; Maria Colomba Comes, m.c.comes@oncologico.bari.it

These authors have contributed equally to this work

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.