Skip to main content

ORIGINAL RESEARCH article

Front. Robot. AI
Sec. Humanoid Robotics
Volume 11 - 2024 | doi: 10.3389/frobt.2024.1391818

Effect of Simulated Hearing Loss on Automatic Speech Recognition for an Android Robot-Patient

Provisionally accepted
  • 1 University of Oldenburg, Oldenburg, Germany
  • 2 Klinikum Oldenburg, Oldenburg, Lower Saxony, Germany
  • 3 Institute for Information Technology (OFFIS), Oldenburg, Lower Saxony, Germany

The final, formatted version of the article will be published soon.

    The importance of simulating patient behavior for medical assessment training has grown in recent decades due to the increasing variety of simulation tools, including standardized/simulated patients, humanoid and android robot-patients. Yet, there is still a need for improvement of current android robot-patients to accurately simulate patient behavior, among which taking into account their hearing loss is of particular importance. This paper is the first to consider hearing loss simulation in an android robot-patient and its results provide valuable insights for future developments. For this purpose, an open-source dataset of audio data and audiograms from human listeners was used to simulate the effect of hearing loss on an automatic speech recognition (ASR) system. The performance of the system was evaluated in terms of both word error rate (WER) and word information preserved (WIP). Comparing different ASR models commonly used in robotics, it appears that the model size alone is insufficient to predict ASR performance in presence of simulated hearing loss. However, though absolute values of WER and WIP do not predict the intelligibility for human listeners, they do highly correlate with it and thus could be used, for example, to compare the performance of hearing aid algorithms.

    Keywords: Hearing loss simulation, automatic speech recognition, android robot-patient, simulated patient, Patient Simulation

    Received: 26 Feb 2024; Accepted: 31 Jul 2024.

    Copyright: © 2024 Röhl, Günther, Hein and Cauchi. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

    * Correspondence: Jan Hendrik Röhl, University of Oldenburg, Oldenburg, Germany

    Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.