Skip to main content

ORIGINAL RESEARCH article

Front. Virtual Real.
Sec. Technologies for VR
Volume 5 - 2024 | doi: 10.3389/frvir.2024.1404865
This article is part of the Research Topic Interactive Audio Systems and Artefacts within Extended Reality: Innovation, Creativity and Accessibility View all articles

The Ballad of the Bots: Sonification Using Cognitive Metaphor to Support Immersed Teleoperation of Robot Teams

Provisionally accepted
  • University of the West of England, Bristol, United Kingdom

The final, formatted version of the article will be published soon.

    As an embodied and spatial medium, virtual reality is proving an attractive proposition for robot teleoperation in hazardous environments. This paper examines a nuclear decommissioning scenario in which a simulated team of semi-autonomous robots are used to characterise a chamber within a virtual nuclear facility. This study examines the potential utility and impact of sonification as a means of communicating salient operator data in such an environment. However, the question of what sound should be used and how it can be applied in different applications is far from resolved. This paper explores and compares two sonification design approaches. The first is inspired by the theory of cognitive metaphor to create sonifications that align with socially acquired contextual and ecological understanding of the application domain. The second adopts a computationalist approach using auditory mappings that are commonplace in the literature. The results suggest that the computationalist approach outperforms the cognitive metaphor approach in terms of predictability and mental workload. However, qualitative data analysis demonstrates that the cognitive metaphor approach resulted in sounds that were more intuitive, and were better implemented for spatialisation of data sources and data legibility when there was more than one sound source.

    Keywords: Virtual Reality, Sonification, Robotics, Nuclear decommissioning, teleoperation

    Received: 21 Mar 2024; Accepted: 04 Jun 2024.

    Copyright: © 2024 Bremner, Simmons, Mitchell, Bown and McIntosh. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

    * Correspondence: Paul Bremner, University of the West of England, Bristol, United Kingdom

    Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.