An Alternative to Speech: Writing in the Air With ‘Sonic Ink’

Cuing up your ’80s playlist, scheduling a smart washer to start a cycle or controlling home lighting while you’re away can be as simple as giving instructions to a digital voice assistant though an Amazon Echo or Apple HomePod device. 

But for people with disabilities—especially those with speech impairments such as vocal cord damage, mutism or severe stuttering—interacting with Alexa or Siri can be difficult and frustrating.

Computer science researchers at the University of Maryland are working on a voice-free alternative—a system that would allow users to simply write words in the air using innovative technology based on voice processing software and a handwriting interface.

The digital tool, called Scribe, picks up the movements of a stylus-like device with sophisticated sensors, transferring the data to the voice assistant platform where it is analyzed as if the text were spoken out loud. The technology is unique in that it does not interfere with voice commands, allowing users to mix speech and air-writing as needed.

The researchers say Scribe could also be useful for people with autistic and neurodiverse conditions that often have minimal verbal output.

 “For some people, handwriting can feel less stressful and more intuitive than speaking,” says Yang Bai Ph.D. ’25. “It reduces cognitive load by allowing more time to process and formulate thoughts, which is especially helpful for those with language processing challenges. By supporting nonverbal and delayed communication, handwriting interfaces greatly enhance accessibility and independence.”

Bai co-developed the system with fellow doctoral students Irtaza Shahid, who is graduating in December of this year, and Harshvardhan Takawale, a third-year student, along with their adviser, Nirupam Roy, an assistant professor of computer science with an appointment in the University of Maryland Institute for Advanced Computer Studies.

Click HERE to read the full article