Creative studio Hello Monday has created an app that teaches and corrects hand positions in real-time to make it easier for people to learn the sign language alphabet.
Hello Monday worked with the American Society for Deaf Children to design Fingerspelling.xyz, an app that runs in web browsers.
Fingerspelling.xyz is an app that runs in web browsers
Not unlike the popular language-learning app Duolingo, Fingerspelling.xyz is able to assess its user's attempts to learn words in real-time.
The app makes use of a person's webcam to track their hand movements as they attempt the hand positions of the American Sign Language (ASL) alphabet, while an algorithm trained on images of correct hand positions analyses their accuracy.
The app gives instruction in the sign language alphabet tailored to the user "The fingerspelling game is a great way to introduce the basics of ASL in a fun and playful way," said Hello Monday founding partner Anders Jessen.
According to Jessen, the technology used by the app offers a more engaging learning experience than the traditional methods of learning the sign language alphabet ? through reading or watching videos.
The app targets parents of deaf children, who are unlikely to know sign language
"The game leverages advanced hand recognition technology, matched with machine learning, to give you real-time feedback via the webcam for each sign and word you spell correctly," Jessen said.
"It's fun to think about how this highly tr...