AUTHOR=Khoshboresh-Masouleh Mehdi , Shah-Hosseini Reza TITLE=Real-time multiple target segmentation with multimodal few-shot learning JOURNAL=Frontiers in Computer Science VOLUME=4 YEAR=2022 URL=https://www.frontiersin.org/journals/computer-science/articles/10.3389/fcomp.2022.1062792 DOI=10.3389/fcomp.2022.1062792 ISSN=2624-9898 ABSTRACT=

Deep learning-based target segmentation requires a big training dataset to achieve good results. In this regard, few-shot learning a model that quickly adapts to new targets with a few labeled support samples is proposed to tackle this issue. In this study, we introduce a new multimodal few-shot learning [e.g., red-green-blue (RGB), thermal, and depth] for real-time multiple target segmentation in a real-world application with a few examples based on a new squeeze-and-attentions mechanism for multiscale and multiple target segmentation. Compared to the state-of-the-art methods (HSNet, CANet, and PFENet), the proposed method demonstrates significantly better performance on the PST900 dataset with 32 time-series sets in both Hand-Drill, and Survivor classes.