AUTHOR=You Suhang , Reyes Mauricio TITLE=Influence of contrast and texture based image modifications on the performance and attention shift of U-Net models for brain tissue segmentation JOURNAL=Frontiers in Neuroimaging VOLUME=1 YEAR=2022 URL=https://www.frontiersin.org/journals/neuroimaging/articles/10.3389/fnimg.2022.1012639 DOI=10.3389/fnimg.2022.1012639 ISSN=2813-1193 ABSTRACT=

Contrast and texture modifications applied during training or test-time have recently shown promising results to enhance the generalization performance of deep learning segmentation methods in medical image analysis. However, a deeper understanding of this phenomenon has not been investigated. In this study, we investigated this phenomenon using a controlled experimental setting, using datasets from the Human Connectome Project and a large set of simulated MR protocols, in order to mitigate data confounders and investigate possible explanations as to why model performance changes when applying different levels of contrast and texture-based modifications. Our experiments confirm previous findings regarding the improved performance of models subjected to contrast and texture modifications employed during training and/or testing time, but further show the interplay when these operations are combined, as well as the regimes of model improvement/worsening across scanning parameters. Furthermore, our findings demonstrate a spatial attention shift phenomenon of trained models, occurring for different levels of model performance, and varying in relation to the type of applied image modification.