I Invented a New LLM

This is my biggest project yet!

Voice type with Peach Beta 🍑:

https://peach-voice.com

A new kind of AI.

0:00 - Intro: Building an AI That Thinks Differently

1:10 - How Standard Transformers Work (Simplified)

4:10 - Peach - Simple Voice Typing (Feel Free to Skip)

5:06 - The Core Limitation: Thinking is Outputting Words

5:37 - Designing the New Model: Encoder, Decoder & Latent Manipulator

6:47 - Understanding Latent Space with Autoencoders (Image Example)

8:41 - Applying Autoencoders to Text: Encoding Meaning

9:14 - The new design

13:37 - Why is it better

15:08 - Implementation

16:13 - Testing the New AI: Demo

20:25 - Final Thoughts

Auto-encoder base model:

https://huggingface.co/thesephist/contra-bottleneck-t5-base-wikipedia

Auto-encoder vis website:

https://douglasduhaime.com/posts/visualizing-latent-spaces.html

The music is created by my partner (AI) and me, feel free to use it commercially for your own projects but make sure to credit this video when you do:

https://drive.google.com/drive/folders/1WSKmpkQGOHb_jij4Ut2NpivTcljc7qLS?usp=sharing