AUTHOR=Duarte Carlos , Desart Simon , Costa David , Dumas Bruno TITLE=Designing Multimodal Mobile Interaction for a Text Messaging Application for Visually Impaired Users JOURNAL=Frontiers in ICT VOLUME=4 YEAR=2017 URL=https://www.frontiersin.org/journals/ict/articles/10.3389/fict.2017.00026 DOI=10.3389/fict.2017.00026 ISSN=2297-198X ABSTRACT=

While mobile devices have experienced important accessibility advances in the past years, people with visual impairments still face important barriers, especially in specific contexts when both their hands are not free to hold the mobile device, like when walking outside. By resorting to a multimodal combination of body based gestures and voice, we aim to achieve full hands and vision free interaction with mobile devices. In this article, we describe this vision and present the design of a prototype, inspired by that vision, of a text messaging application. The article also presents a user study where the suitability of the proposed approach was assessed, and a performance comparison between our prototype and existing SMS applications was conducted. Study participants received positively the prototype, which also supported better performance in tasks that involved text editing.