Skip to main content

REVIEW article

Front. Med.
Sec. Pathology
Volume 11 - 2024 | doi: 10.3389/fmed.2024.1450103
This article is part of the Research Topic Advances in Deep Learning-Based Computational Pathology to Address Data Scarcity, Heterogeneity and Integration View all articles

Histopathology in Focus: A Review on Explainable Multi-Modal Approaches for Breast Cancer Diagnosis

Provisionally accepted
  • 1 Qatar University, Doha, Qatar
  • 2 University of Sharjah, Sharjah, United Arab Emirates

The final, formatted version of the article will be published soon.

    Precision and timeliness in breast cancer detection are paramount for improving patient outcomes. Traditional diagnostic methods have predominantly relied on unimodal approaches, but recent advancements in medical data analytics have enabled the integration of diverse data sources beyond conventional imaging techniques. This review critically examines the transformative potential of integrating histopathology images with genomic data, clinical records, and patient histories to enhance diagnostic accuracy and comprehensiveness in multi-modal diagnostic techniques. It explores early, intermediate, and late fusion methods, as well as advanced deep multimodal fusion techniques, including encoder-decoder architectures, attentionbased mechanisms, and graph neural networks. An overview of recent advancements in multimodal tasks such as Visual Question Answering (VQA), report generation, semantic segmentation, and cross-modal retrieval is provided, highlighting the utilization of generative AI and visual language models. Additionally, the review delves into the role of Explainable Artificial Intelligence (XAI) in elucidating the decision-making processes of sophisticated diagnostic algorithms, emphasizing the critical need for transparency and interpretability. By showcasing the importance of explainability, we demonstrate how XAI methods, including Grad-CAM, SHAP, LIME, trainable attention, and image captioning, enhance diagnostic precision, strengthen clinician confidence, and foster patient engagement. The review also discusses the latest XAI developments, such as X-VARs, LeGrad, LangXAI, LVLM-Interpret, and ex-ILP, to demonstrate their potential utility in multimodal breast cancer detection, while identifying key research gaps and proposing future directions for advancing the field.

    Keywords: breast cancer detection, histopathology, multi-modality, XAI, machine learning and AI

    Received: 16 Jun 2024; Accepted: 12 Sep 2024.

    Copyright: © 2024 Abdullakutty, Akbari, Al-Maadeed, Bouridane, Hamoudi and Talaat. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

    * Correspondence: Faseela Abdullakutty, Qatar University, Doha, Qatar

    Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.