/ai

Google DeepMind Releases SL2T Model for ASL Translation · Digg

Google DeepMind Releases SL2T Model for ASL Translation

It enables sign language input on Pixel phones through Gboard and Live Transcribe.

TLDR

Google DeepMind announced its SL2T sign language-to-text model. The system translates simultaneous hand, body, and face movements directly into text. It powers new features allowing users to sign into Gboard and Live Transcribe on Pixel phones starting with Pixel 11. The model was built with guidance from Deaf Googlers and an AI Sign Language Advisory Committee. Body pose tracking runs on device for privacy while servers handle the translation step. It supports one-handed signing and is optimized for real-world use.

Featured Source

Google DeepMind Releases SL2T Model for ASL Translation

It enables sign language input on Pixel phones through Gboard and Live Transcribe.

Combined views

1M

24 Sources, first seen 43d ago

9.3K likes

TagsGoogle DeepMind

TagsGoogle DeepMind

183012345678901234567890123456789

183012345678901234567890123456789

43d ago

first seen 43d ago

Combined views

1M

24 Sources, first seen 43d ago

9.3K likes453 comments999 saves1.5K reposts

43d ago

first seen 43d ago

TLDR

Google DeepMind announced its SL2T sign language-to-text model. The system translates simultaneous hand, body, and face movements directly into text. It powers new features allowing users to sign into Gboard and Live Transcribe on Pixel phones starting with Pixel 11. The model was built with guidance from Deaf Googlers and an AI Sign Language Advisory Committee. Body pose tracking runs on device for privacy while servers handle the translation step. It supports one-handed signing and is optimized for real-world use.

Featured Source

453 comments

999 saves

1.5K reposts

183012345678901234567890123456789

183012345678901234567890123456789

Sentiment

Positive——Negative

Summary

Not enough discussion yet.

No sentiment analysis available yet.

24 Sources

@GoogleDeepMindSL2T is our breakthrough sign language-to-text model powering new features for Deaf and hard of hearing users on @Android. Starting with American Sign Language-to-English on Pixel 11, people can sign directly into Gboard and Live Transcribe instead of typing.

@ai_for_successGoogle DeepMind is doing some crazy work. This is so good and is going to help so many people. They just launched SL2T (Sign Language to Text), an AI model that translates sign language directly into text. Most spoken language dictation tools rely on audio to text, but sign languages have their own grammars and involve complex 3D movements. Instead of using raw camera feeds or physical gloves, SL2T tracks body landmark coordinates locally with MediaPipe Holistic and translates those spatial points into text. It’s powering sign to text dictation on Pixel 11 in Gboard and Live Transcribe, starting with ASL. Users can sign naturally to search, draft messages, or respond in live conversations instead of typing everything out. This is seriously awesome.

@redponyI'm so happy to be able to announce the first general purpose sign-language-to-text translation (SL2T) model from my team that's out today and powering a new ASL input feature on @Android phones (and don't worry, we're not stopping at ASL).

@feishaAI@redpony @Android Congrats !

@egrefenAmazing launch, @redpony and team! Great to see Google ship technology in this space 🥰

@julien_cThis is a really cool model. Please consider publishing to HF!! 🙏

@fofrAIReally important AI work

@ZoubinGhahrama1Incredibly excited by this launch! Putting sign language AI into users’ hands. Our sign-language-to-text (SL2T) breakthrough model powers new sign language features for Deaf and hard of hearing users. https://deepmind.google/blog/putting-sign-language-ai-into-users-hands/ @GoogleDeepMind

@sundarpichaiOne of the most important updates coming out of Made by Google today is our new sign-to-text feature in Gboard & Live Transcribe. Built in partnership with the Deaf community, this can help people who sign ASL communicate more seamlessly with their phone or with those who don't sign, like in this Live Transcribe demo:

@yoavartziRT @ZoubinGhahrama1: Incredibly excited by this launch! Putting sign language AI into users’ hands. Our sign-language-to-text (SL2T) breakt…

Sentiment

Positive——Negative

Summary

Not enough discussion yet.

No sentiment analysis available yet.

Related

Logan Kilpatrick Shares Talk with Google DeepMind Lead

Conversation covers path to AGI, 3.7 Flash progress, and frontier focus.

Jon Barron Shares Sense on Explicit 3D Representations

Google DeepMind researcher Jon Barron posted part two of his talk on vision research.

Barrett Zoph Rejoins Google DeepMind for RL Role

Former Google Brain resident focuses on reinforcement learning and post-training at DeepMind.

Today's Rank

—

Not ranked yet

Today's Rank

—

Not ranked yet