Skip to main content
tech futures.Introduction to AI

Lesson 5: Under the Hood

Embeddings in real life

The video below illustrates what embeddings look like in a real transformer: lists of 1000 numbers. They sometimes have 2000+.

That's a lot of numbers - luckily computers are very good at working with them!

1,000 numbers in a single vector.