There’s a great deal of activity in the fields of speech recognition and the “Internet of Things,” but one natural application of the two has gone relatively unpursued: helping the deaf and hard of hearing take part in everyday conversations. SpeakSee aims to do this[1] (after crowdfunding[2], naturally) with a clever hardware design that minimizes setup friction and lets everyone communicate naturally.
It’s meant to be used in situations where someone hard of hearing needs to talk with a handful of others — a meeting, a chat at dinner, asking directions and so on. There are speech-to-text apps out there that can transcribe what someone is saying, but they’re not really suited to the purpose.
“Many deaf people experienced a huge barrier in asking people to download the app and hold the phone close to their mouth. These limitations in the interface meant no one kept using it,” explained SpeakSee CEO and co-founder Jari Hazelebach. “But because we designed our own hardware, we were able to customize it towards the situations it will be used in.”
SpeakSee is simple to use: A set of clip-on microphones live in a little charger case, and when the user wants to have a conversation, they hand those microphones out to whoever will be talking. The case acts as a wireless hub for the mics and relays the audio to the smartphone with which it’s paired. This audio is sent off, transcribed quickly somewhere in the cloud, and displayed on the deaf user’s phone.
Critically, though, each microphone also intelligently and locally accounts for its speaker and background noise.
“Naturally the microphones pick up speech from multiple people,” said Hazelebach. “So we included sensors that tell the microphone what direction the...