Skip to main content

ORIGINAL RESEARCH article

Front. Rehabil. Sci.
Sec. Disability, Rehabilitation, and Inclusion
Volume 5 - 2024 | doi: 10.3389/fresc.2024.1368983
This article is part of the Research Topic Environmental Adaptation for Accessibility: A Global Perspective in the Field of Disability, Rehabilitation and Inclusion View all 10 articles

SONOICE! A Sonar-Voice Dynamic User Interface for Assisting Individuals with Blindness and Visual Impairment in Pinpointing Elements in 2D Tactile Readers

Provisionally accepted
Gaspar Ramôa Gaspar Ramôa 1*Vincent Schmidt Vincent Schmidt 2Thorsten Schwarz Thorsten Schwarz 3Rainer Stiefelhagen Rainer Stiefelhagen 3,4Peter König Peter König 2,5
  • 1 Inventivio GmbH, Nuremberg, Germany
  • 2 Institute of Cognitive Science, Osnabrück University, Osnabrück, Lower Saxony, Germany
  • 3 ACCESS@KIT, Karlsruhe Institute of Technology, Karlsruhe, Germany
  • 4 Karlsruhe Institute of Technology (KIT), Karlsruhe, Baden-Württemberg, Germany
  • 5 Institute for Neurophysiology and Pathophysiology, University Medical Center Hamburg-Eppendorf, Hamburg, Hamburg, Germany

The final, formatted version of the article will be published soon.

    Pinpointing elements on large tactile surfaces is challenging for individuals with blindness and visual impairment (BVI) seeking to access two-dimensional (2D) information. This is particularly evident when using 2D tactile readers, devices designed to provide 2D information using static tactile representations with audio explanations. Traditional pinpointing methods, such as sighted assistance and trial-and-error, are limited and inefficient, while alternative pinpointing user interfaces (UI) are still emerging and need advancement. To address these limitations, we develop three distinct navigation UIs using a user-centred design approach: Sonar (proximity-radar sonification), Voice (direct clock-system speech instructions), and Sonoice, a new method that combines elements of both. The navigation UIs were incorporated into the Tactonom Reader device to conduct a trial study with ten BVI participants. Our UIs exhibited superior performance and higher user satisfaction than the conventional trial-and-error approach, showcasing scalability to varied assistive technology and their effectiveness regardless of graphic complexity. The innovative Sonoice approach achieved the highest efficiency in pinpointing elements, but user satisfaction was highest with the Sonar approach. Surprisingly, participant preferences varied and did not always align with their most effective strategy, underscoring the importance of accommodating individual user preferences and contextual factors when choosing between the three UIs. While more extensive training may reveal further differences between these UIs, our results emphasise the significance of offering diverse options to meet user needs. Altogether, the results provide valuable insights for improving the functionality of 2D tactile readers, thereby contributing to the future development of accessible technology.

    Keywords: pinpoint navigation, user interface, sonification and speech interfaces, 2D tactile readers, access to graphical information, Blind and visually impaired, assistive technology SONOICE! A Sonar-Voice Dynamic Navigation UI

    Received: 11 Jan 2024; Accepted: 09 Aug 2024.

    Copyright: © 2024 Ramôa, Schmidt, Schwarz, Stiefelhagen and König. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

    * Correspondence: Gaspar Ramôa, Inventivio GmbH, Nuremberg, Germany

    Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.