An in-depth characterization of the smartphone challenges blind people face; and a set of solutions that aim to improve user autonomy, and self-efficacy.
Mobile devices are fundamental tools for inclusion and independence. Yet, there are still many open research issues in smartphone accessibility for blind people. Currently, learning how to use a smartphone is non-trivial, especially when we consider that the need to learn new apps and accommodate to updates never ceases. When first transitioning from a basic feature-phone, people have to adapt to new paradigms of interaction. Where feature phones had a finite set of applications and functions, users can extend the possible functions and uses of a smartphone by installing new 3rd party applications. Moreover, the interconnectivity of these applications means that users can explore a seemingly endless set of workflows across applications. To that end, the fragmented nature of development on these devices results in users needing to create different mental models for each application. These characteristics make smartphone adoption, and at times, use, a demanding task.
We conducted multiple studies to characterize the smartphone challenges blind people face and found people often require synchronous, co-located assistance from family, peers, friends, and even strangers to overcome the different barriers they face. However, help is not always available, especially when we consider the disparity in each barrier, individual support network and current location.
We investigated if and how in-context human-powered solutions can be leveraged to improve current smartphone accessibility and ease of use. Building on a comprehensive knowledge of the smartphone challenges faced and coping mechanisms employed by blind people, we explored how human-powered assistive technologies can facilitate use. We developed and explored, question and answer services, in-context tutorials, and task assistants.
We envision a paradigm shift where interactions, and contributions by knowledgeable users can assist others beyond what app and OS provide. Thus, establishing a support network where there was none, enabling the creation of services, and tools that tackle accessibility challenges, informed by usage data.
We investigated the benefits and shortcomings of a personalizable, static and consistent interface (PSI) on mobile devices for non-visual access, alongside its acceptance by blind people (novice and expert users).
Open Challenges of Blind People using Smartphones
André Rodrigues, Hugo Nicolau, Kyle Montague, João Guerreiro and Tiago Guerreiro
arXiv preprint arXiv:1909.09078.
Understanding the Authoring and Playthrough of Nonvisual Smartphone Tutorials
André Rodrigues, André Santos, Kyle Montague, Hugo Nicolau, Tiago Guerreiro
17th IFIP TC13 International Conference on Human-Computer Interaction, Paphos, Cyprus, September, 2019
Tiago Guerreiro, Luís Carriço, André Rodrigues
Chapter 38 in S. Harper & Y. Yesilada (eds.), Web Accessibility: A Foundation for Research (2nd ed.). London, England, Springer-Verlag.
AidMe: Interactive Non-Visual Smartphone Tutorials
André Rodrigues, Leonardo Camacho, Hugo Nicolau, Kyle Montague, Tiago Guerreiro
20th International Conference on Human-Computer Interaction with Mobile Devices and Services, Barcelona, Spain, September, 2018
Data Donors: Sharing Knowledge for Mobile Accessibility
André Rodrigues, Kyle Montague, Tiago Guerreiro
Late Breaking Work - Extended Abstracts of the ACM Conference on Human Factors in Computing Systems, Montreal, Canada, May, 2018
Improving smartphone accessibility with personalizable static overlays
André Rodrigues, André Santos, Kyle Montague, Tiago Guerreiro
19th International ACM SIGACCESS Conference on Computers and Accessibility. Baltimore, Maryland, USA, October, 2017
In-context Q&A to Support Blind People Using Smartphones
André Rodrigues, Kyle Montague, Hugo Nicolau, João Guerreiro and Tiago Guerreiro
19th International ACM SIGACCESS Conference on Computers and Accessibility. Baltimore, Maryland, USA, October, 2017.
Getting Smartphones to Talkback: Understanding the Smartphone Adoption Process of Blind Users
André Rodrigues, Kyle Montague, Hugo Nicolau, Tiago Guerreiro
17th International ACM SIGACCESS Conference on Computers and Accessibility. Lisboa, Portugal, October, 2015