The final, formatted version of the article will be published soon.
ORIGINAL RESEARCH article
Front. Robot. AI
Sec. Field Robotics
Volume 11 - 2024 |
doi: 10.3389/frobt.2024.1459570
This article is part of the Research Topic Advancing Autonomous Robots: Challenges and Innovations in Open-World Scene Understanding View all articles
Semantic Segmentation using Synthetic Images of Underwater Marine-Growth
Provisionally accepted- Aalborg University, Aalborg, Denmark
Subsea applications recently received increasing attention due to the global expansion of offshore energy, seabed infrastructure, and maritime activities; complex inspection, maintenance, and repair tasks in this domain are regularly solved with pilot-controlled, tethered remote-operated vehicles to reduce the use of human divers. Collecting precise submerged data is challenging due to uncontrollable and harsh environmental factors. This study explores using synthetic environments for subsea data synthesis with applications to machine learning. Synthetic environments offer cost-effective, controlled alternatives to real-world operations with access to detailed ground-truth data. Two synthetic datasets with over 1000 rendered images each were used to train DeepLabV3+ neural networks with an Xception backbone. The dataset includes environmental classes like seawater and seafloor, offshore structures components, ship hulls, and several marine growth classes. The machine-learning models were trained using transfer learning and data augmentation techniques, showing high accuracy in segmenting synthetic images. Testing on real-world imagery yielded promising results for two out of three of the studied cases, though challenges in distinguishing some classes persist. In conclusion, this study demonstrates the efficiency of synthetic environments for training subsea machine learning models but also highlights some important limitations. Improvements can be pursued by introducing layered species into synthetic environments and improving optical information quality -better color representation, reduced compression artifacts, and minimized motion blur -are key areas of focus.Future work involves quantitative validation with expert-labeled datasets to validate and enhance real-world application accuracy.
Keywords: Unmanned underwater vehicles (UUV), Synthetic Images Augmentation, Semantic segmentation, virtual environment, Underwater operations
Received: 04 Jul 2024; Accepted: 30 Sep 2024.
Copyright: © 2024 Mai, Liniger and Pedersen. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
* Correspondence:
Christian Mai, Aalborg University, Aalborg, Denmark
Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.