Google released SL2T which is a DeepMind model that turns sign language directly into text, debuting on the Pixel 11 in Gboard and Live Transcribe letting deaf and hard of hearing users sign to their phone anywhere they’d normally type and searching, writing messages, or talking to Gemini Kind of being pioneers into a real consumer product, not just a research demo plus an on-device model tracks pose points across the face, hands, arms and torso and only sends those coordinates to the server, so raw video never leaves your phone It also handles one-handed and left-handed signing and includes hallucination prevention so it doesn’t misread you just adjusting your grip The dataset includes training on 100,000+ hours of data across 50+ languages, about a quarter of it ASL, which is why ASL to English is the only pair supported at launch Currently Pixel 11-only, more languages and devices planned submitted by /u/ocean_protocol
Originally posted by u/ocean_protocol on r/ArtificialInteligence