Skip to main content

METHODS article

Front. Artif. Intell.
Sec. Pattern Recognition
Volume 7 - 2024 | doi: 10.3389/frai.2024.1353873

Image restoration in frequency space using complex-valued CNNs

Provisionally accepted
  • 1 Bielefeld University of Applied Sciences, Bielefeld, Germany
  • 2 Faculty of Physics, University of Bielefeld, Bielefeld, North Rhine-Westphalia, Germany
  • 3 Center of Cognitive Interaction Technology, Bielefeld University, Bielefeld, North Rhine-Westphalia, Germany

The final, formatted version of the article will be published soon.

    Real-valued convolutional neural networks (RV-CNNs) have outperformed classical approaches in many image restoration tasks such as image denoising and super-resolution. Recently, complex-valued convolutional neural networks (CV-CNNs) have shown remarkable performance in several computer vision tasks such as image classification and segmentation. However, the potential of CV-CNNs for image restoration problems in the frequency domain has not been fully investigated. Here, we first aim to explore the potential of CV-CNNs for image denoising and super-resolution in the frequency domain. Second, we propose two novel CV-CNN based models equipped with complexvalued attention gates for denoising and super-resolution problems. Third, we demonstrate that our CV-CNN based models outperform their real-valued counterparts for denoising super-resolution structured illumination microscopy (SR-SIM) and conventional image datasets. Additionally, the experimental results reveal that our proposed CV-CNN based models preserve the frequency spectrum better than their real-valued counterparts. Based on these findings we conclude that CV-CNN based methods provide a plausible and beneficial deep learning approach for image restoration in the frequency domain.

    Keywords: image restoration, image denoising, super-resolution, Convolutional neural networks (CNNs), Complex-valued convolutional neural 1 networks (CV-CNNs), Real-valued convolutional neural networks (RV-CNNs), Complex-valued operation, structured illumination microscopy

    Received: 11 Dec 2023; Accepted: 03 Sep 2024.

    Copyright: © 2024 Shah, Müller, Hübner, Ortkrass, Hammer, Huser and Schenck. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

    * Correspondence: Zafran Hussain Shah, Bielefeld University of Applied Sciences, Bielefeld, Germany

    Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.