Fingerspelling with Machine Learning — fingerspelling.xyz

Fingerspelling with Machine Learning — fingerspelling.xyz

Apr 25, 2021
|
158 views
Details
For every 1,000 children born in the US, 2 - 3 are deaf or hard-of-hearing. Without being introduced to sign language at an early stage, a deaf child may miss out on learning language. To address language deprivation and help bridge the communication barrier between the deaf and the hearing, we created Fingerspelling.xyz (https://fingerspelling.xyz). A browser-based app that uses your webcam and machine learning to analyze your hand shapes so you can learn to sign the ASL alphabet correctly. This is how it works: You are given a series of words and the computer shows you a 3D model of how your hand should be positioned for each letter. When you sign the word, the camera tracks your hand movements and gives you real time feedback so you can make corrections as needed. This helps you quickly develop your fingerspelling skills. And helps everyone get more familiar with the ASL Alphabet. Created by the American Society for Deaf Children (https://deafchildren.org/) and Hello Monday (https://hellomonday.com)

Comments
loading...