New technology translates lectures into sign language

Published: Feb 10, 2009

For most students, a laptop or a college-ruled notebook is enough to get through most lecture classes at the University. For hearing impaired students, the process is much more challenging. They need both a translator to transcribe the lecture and then extra time to read through the notes once class is over.

Using a cell phone, two University students have a plan to completely change the way hearing impaired students attend class.

Jason Gilbert and Judy Yu, graduate students in the College of Engineering’s Department of Atmospheric, Oceanic and Space Sciences, have developed a system that translates sign language into speech using cell phone technology. They say that their invention, Mobile Sign Language Systems (MSigns), will revolutionize communication for the hearing impaired.

“The idea behind it was to create some software that would take spoken English on any handheld device like a smart phone and translate it into a video of the sign language like an interpreter you can carry in your hand,” Gilbert said. “This will be really useful for deaf and hard-of-hearing people who needed to communicate on the spot and didn’t have a professional interpreter with them at the time.”

Gilbert and Yu began working on MSigns in January 2006. They entered their idea in a program at the Digital Media Commons in the Duderstadt Center, which awards cash grants to students who submit project ideas that incorporate digital media.

Gilbert, who is fluent in sign language and Yu, who has computer-programming experience, collaborated to develop the project.

Read more on Michigan Daily

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 3.0 License.

Back to top