Notifications
SpeakAR
Showcase
43
0
SpeakAR is an application for the Microsoft Hololens that listens to speech around the user and translates it into a language the user can understand. Especially for deaf users, the visual ASL translations are helpful because that is often their native language. I created the application along with three others in under 24 hours at PennApps XIV at UPenn. We utilized Unity's built-in dictation recognizer API to convert spoken word into text. Then, using a combination of gifs and 3D-modeled hands, we translated that text into ASL. The scripts were written in C# and we won the Grand Prize for this innovative approach to real-time speech visualization.

Tyler Roach
VR/AR Software Developer - Other
7
Comments