Sign Language Translation Tools

Hand Wave Uses Smart Glasses To Turn Sign Language Into Speech

Communicating through sign language with people who do not understand it can create a barrier in everyday conversations. Hand Wave is a sign language translation tool that uses the camera on Meta smart glasses to interpret signs and convert them into text and speech.

The tool also works across iOS and the web, giving users different ways to access the technology beyond the smart glasses themselves. Under the hood, Hand Wave uses a lightweight, open-source neural network trained on Google's FSBoard dataset. The model is being developed to run locally across devices, which could allow sign language processing to happen without continuously sending camera footage to the cloud. By combining wearable cameras with on-device AI, Hand Wave aims to make real-time sign language translation more portable and accessible.

Open at source ↗