Type:

Experiences

Client:

American Society for Deaf Children

Deliverables:

UI, Development, UX, Concept, 3D Modeling, Animation, Copywriting, Design

Fingerspelling with Machine Learning

Every year 2 - 3 out of every 1,000 children born in the US are deaf or hard-of-hearing. 90% of these children are born to hearing parents, and in many cases, their child is the first deaf person these parents have ever encountered.

Without being introduced to sign language at an early stage, a deaf child may miss out on learning language. This can lead to language delay or deprivation, which has long-term negative impacts on a child’s life. That is why it is so important that parents of deaf children have the opportunity to learn American Sign Language (ASL) as soon as possible.

To address language deprivation and help bridge the communication barrier between the deaf and the hearing, we partnered with the American Society for Deaf Children to create Fingerspelling.xyz.

The concept

When you sign the word, the camera tracks your hand movements and gives you feedback so you can make corrections as needed. This helps you quickly develop your fingerspelling skills.

Concept

Fingerspelling.xyz is a browser-based app that uses a webcam and machine learning to analyze your hand shapes so you can learn to sign the ASL alphabet correctly.

Concept

The fingerspelling game is a great way to introduce the basics of ASL in a fun and playful way. It guides you step by step in how to master fingerspelling - hands on!

Project awarded:

Cannes Lion

Gold in Design
Silver in Design
Silver in Digital Craft


FWA

Site of the Month
Site of the Day



Awwwards

Site of the Day


Spell: Innovative

Something something
We creates joyful digital ideas, products, brand identities and experiences that connect the hearts of brands to the hearts of their audiences.