Realtime AI in the Browser

Absolutely wild what's possible with @HuggingFace Transformers.js and WebGPU in the Browser using JavaScript!

🎙️Realtime in-browser speech-to-text with OpenAI Whisper!

📡 Broadcast to subscribed clients with @Supabase Realtime.

🌏 Translate to 200 languages with @meta NLLB-200!

Find the source code: https://supabase.link/babelfish-ai-gh

CHAPTERS:

00:00 Intro & Demo

02:55 Intro to Huggingface Transformers.js & ONNX Runtime

03:52 OpenAI Whisper with Transformers.js & WebGPU

05:30 Building the automatic speech recognition pipeline

11:38 Broadcast transcript with Supabase Realtime

13:18 Create a new Supabase project at database.new

13:46 Copy over the Supabase API credentials

14:33 Monitor the Realtime channel in the Supabase Dashboard

15:09 Supabase Realtime receiver listens to realtime broadcast

16:36 Multi-language translation pipeline with NLLB200 from Meta

21:57 Find the code on GitHub & the demo on GitHub Pages

💻 Videos to watch next:

▶ https://youtu.be/ibzlEQmgPPY

▶ https://youtu.be/cL4pVpaOH9o

▶ https://youtu.be/g5NjMqj22qI

👇 Learn more about Supabase 👇

🕸 Website: https://supabase.com/

🏁 Get started: https://app.supabase.com/

📄 Docs: https://supabase.com/docs

🔔 Subscribe for more tutorials and feature updates from Supabase: https://www.youtube.com/channel/UCNTVzV1InxHV-YR0fSajqPQ?sub_confirmation=1

📱 Connect with Us:

🐙 Github: https://www.github.com/supabase

💬 Discord: https://discord.supabase.com/

🐦 Twitter: https://www.twitter.com/supabase/

▶ Instagram (follow for memes): https://www.instagram.com/supabasecom/

ABOUT SUPABASE:

Supabase is the open source Firebase alternative. Supabase provides a full Postgres database for every project with pgvector, backups, realtime, and more. Add and manage email and password, passwordless, OAuth, and mobile logins to your project through a suite of identity providers and APIs.

Build in a weekend, scale to millions.

#Supabase #AppDevelopment #RealtimeApps #DeveloperTools #ai #browser #transformers