Skip to main content

ORIGINAL RESEARCH article

Front. Immunol.
Sec. Cancer Immunity and Immunotherapy
Volume 15 - 2024 | doi: 10.3389/fimmu.2024.1453232
This article is part of the Research Topic Community Series in Novel Biomarkers in Tumor Immunity and Immunotherapy: Volume II View all 9 articles

Whole Slide Image-Based Weakly Supervised Deep Learning for Predicting Major Pathological Response in Non-Small Cell Lung Cancer Following Neoadjuvant Chemoimmunotherapy : a Multicenter, Retrospective, Cohort Study

Provisionally accepted
Dan Han Dan Han 1,2Hao Li Hao Li 2,3*Xin Zheng Xin Zheng 4*Shenbo Fu Shenbo Fu 5Ran Wei Ran Wei 6*Qian Zhao Qian Zhao 1*Chengxin Liu Chengxin Liu 1Zhongtang Wang Zhongtang Wang 1*WEI HUANG WEI HUANG 1*Shaoyu Hao Shaoyu Hao 7*
  • 1 Department of Thoracic Oncology, Shandong Cancer Hospital and Institute, Shandong First Medical University and Shandong Academy of Medical Sciences, Jinan, Shandong, China, Jinan, China
  • 2 Shandong Cancer Hospital, Shandong University, Jinan, Shandong Province, China
  • 3 Shandong Provincial Qianfoshan Hospital, Jinan, Shandong Province, China
  • 4 Chinese Medicine Hospital of Qingdao City, Qingdao, Shandong Province, China
  • 5 Shanxi Provincial Cancer Hospital, Taiyuan, China
  • 6 Jining First People's Hospital, Jining, Shandong, China
  • 7 Department of Thoracic Surgery, Shandong Cancer Hospital, Shandong University, Jinan, Shandong Province, China

The final, formatted version of the article will be published soon.

    Develop a predictive model utilizing weakly supervised deep learning techniques to accurately forecast major pathological response (MPR) in patients with resectable non-small cell lung cancer (NSCLC) undergoing neoadjuvant chemoimmunotherapy (NICT), by leveraging whole slide images (WSIs). Methods: This retrospective study examined pre-treatment WSIs from 186 patients with non-small cell lung cancer (NSCLC), using a weakly supervised learning framework. We employed advanced deep learning architectures, including DenseNet121, ResNet50, and Inception V3, to analyze WSIs on both micro (patch) and macro (slide) levels. The training process incorporated innovative data augmentation and normalization techniques to bolster the robustness of the models.We evaluated the performance of these models against traditional clinical predictors and integrated them with a novel pathomics signature, which was developed using multi-instance learning algorithms that facilitate feature aggregation from patch-level probability distributions.: Univariate and multivariable analyses confirmed histology as a statistically significant prognostic factor for MPR (P-value < 0.05). In patch model evaluations, DenseNet121 led in the validation set with an area under the curve (AUC) of 0.656, surpassing ResNet50 (AUC = 0.626) and Inception V3 (AUC = 0.654), and showed strong generalization in external testing (AUC = 0.611). Further evaluation through visual inspection of patch-level data integration into WSIs revealed XGBoost's superior class differentiation and generalization, achieving the highest AUCs of 0.998 in training and robust scores of 0.818 in validation and 0.805 in testing. Integrating pathomics features with clinical data into a nomogram yielded AUC of 0.819 in validation and 0.820 in testing, enhancing discriminative accuracy. Gradient-weighted Class Activation Mapping (Grad-CAM) and feature aggregation methods notably boosted the model's interpretability and feature modeling.The application of weakly supervised deep learning to WSIs offers a powerful tool for predicting MPR in NSCLC patients treated with NICT.

    Keywords: Non-small cell lung cancer, major pathological response, neoadjuvant chemoimmunotherapy, Whole slide image, Weakly supervised learning

    Received: 22 Jun 2024; Accepted: 27 Aug 2024.

    Copyright: © 2024 Han, Li, Zheng, Fu, Wei, Zhao, Liu, Wang, HUANG and Hao. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

    * Correspondence:
    Hao Li, Shandong Provincial Qianfoshan Hospital, Jinan, 250014, Shandong Province, China
    Xin Zheng, Chinese Medicine Hospital of Qingdao City, Qingdao, Shandong Province, China
    Ran Wei, Jining First People's Hospital, Jining, Shandong, China
    Qian Zhao, Department of Thoracic Oncology, Shandong Cancer Hospital and Institute, Shandong First Medical University and Shandong Academy of Medical Sciences, Jinan, Shandong, China, Jinan, China
    Zhongtang Wang, Department of Thoracic Oncology, Shandong Cancer Hospital and Institute, Shandong First Medical University and Shandong Academy of Medical Sciences, Jinan, Shandong, China, Jinan, China
    WEI HUANG, Department of Thoracic Oncology, Shandong Cancer Hospital and Institute, Shandong First Medical University and Shandong Academy of Medical Sciences, Jinan, Shandong, China, Jinan, China
    Shaoyu Hao, Department of Thoracic Surgery, Shandong Cancer Hospital, Shandong University, Jinan, Shandong Province, China

    Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.