Mikaël

Problem Definition

Blind users often rely on screen readers and voice-over features to access content, type messages, or use apps. These tools can be challenging to use, especially in noisy environments like streets, bars, or coffee shops.

Existing solutions, such as bulky braille keyboards or limited mobile input methods, are often cumbersome or restricted by specific operating systems, making it difficult for blind users to switch devices or use someone else’s phone.

My goal was to create a more adaptable and efficient solution to support blind users in their daily interactions with technology.

Here are some braille keyboards available today. They are expensive, large and nececite hours of training and a power source:

Prototype #1: Initial Concept

The idea

I started by learning braille to better understand the input process. My first prototype allowed users to type on a blank screen, with the phone recognizing the pattern of 6 dots (forming each braille character), regardless of where they tapped. This prototype served as a foundational step toward a more intuitive input method.

UX research

In testing early prototypes, I found users struggled with the unfamiliar input system. Users where trying to figure out where to touch the screen rather than trusting the app to recognize their input. This was agreat learnign moment where I understood that even more so then sighted users, blind users create mental model of app and processes that I will have to understand and work with.

Prototype #3: User-Defined Gestures with Machine Learning

To address the feedback, I collaborated with a software engineer to integrate a machine learning system into my prototype.

This new prototype could map user-defined gestures to specific commands and actions, creating a personalized experience for each user and allow the system to learn each user’s unique gestures over time.

UX research

I partnered with a UX researcher to conduct a series of testing and interviews at a school for the blind near Berkeley CA.

We interviewed dozens of users and received many praises for the interface we created. Many students were excited about the potential application in specific apps and the type of control this could give them.

During our research, we also uncovered a generational shift in technology use: younger blind users were less and less fluent in braille and relied more and more on voice commands.

An unexpected finding was the concern many blind users had about safety and theft when using their expensive phones in public. Several participants mentioned feeling uneasy, worrying that someone might snatch their phone from their hands or even from a table. To address this, my next prototype will be a discreet physical device that allows users to control their phones without needing to take them out of their bags. This solution will be OS-agnostic, designed for ease of use and addressing similar pain points then the gesture system.

Key Takeaways

Working on Dingo taught me the value of deep empathy and immersion in understanding user needs, especially for those with disabilities. I learned that simply retrofitting accessible features onto existing designs often falls short. Instead, we need to create solutions that are specifically tailored to the unique experiences of each user group. This project reinforced my belief in the power of innovative, user-centered research and design to create more inclusive products and services.