Skip to main content

ORIGINAL RESEARCH article

Front. Comput. Sci.
Sec. Human-Media Interaction
Volume 6 - 2024 | doi: 10.3389/fcomp.2024.1371728

Designing Audio Processing Strategies to Enhance Cochlear Implant Users' Music Enjoyment

Provisionally accepted
Lloyd May Lloyd May 1*Aaron Hodges Aaron Hodges 1So Yeon Park So Yeon Park 1,2Blair Kaneshiro Blair Kaneshiro 1Jonathan Berger Jonathan Berger 1
  • 1 Center for Computer Research in Music and Acoustics, School of Humanities and Sciences, Stanford University, Stanford, California, United States
  • 2 Center for Design Research, School of Engineering, Stanford University, Stanford, California, United States

The final, formatted version of the article will be published soon.

    Cochlear implants (CIs) provide hundreds of thousands of users with increased access to sound, particularly speech, but experiences of music are more varied. Can greater engagement by CI users in the music mixing process mutually benefit them as well as audio engineers? This paper presents an exploratory mixed-methods study that leverages insights from CI users and professional audio engineers (AEs) in the investigation of techniques to enhance CI user music enjoyment and promote empathetic practices in AEs. Analysis of data collected over a multi-step process of surveys, interviews, and iterative cycles of sound mixing and feedback revealed two mixing strategies-namely essentializing and exaggeration of musical elements-common among mixes preferred by CI users. Participant responses also highlighted systemic ableism and audism in the music industry-an industry from which CI users report feeling excluded. Specifically, AEs felt inadequately trained around aural diversity considerations and experienced anxiety around their own aural diversity. In sum, this work contributes to insights into CI user music listening preferences; how AEs approach mixing for an aurally diverse audience; and discussion around the efficacy of CI simulation, user feedback, and AE peer feedback on mix enjoyment by CI users. Based on these findings, we offer several design insights that emphasize the need for customizable music listening tools centered around user agency and enjoyment.

    Keywords: accessibility, Aural Diversity, Music Personalization, cochlear implant, Music appreciation, Disability, deaf and hard-of-hearing

    Received: 16 Jan 2024; Accepted: 28 Aug 2024.

    Copyright: © 2024 May, Hodges, Park, Kaneshiro and Berger. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

    * Correspondence: Lloyd May, Center for Computer Research in Music and Acoustics, School of Humanities and Sciences, Stanford University, Stanford, 94305, California, United States

    Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.