Embedding Meanings

A token ID tells the computer which token it is looking at.

An embedding adds meaning clues, based on how that token was used in training.

Think of it like a library sticker: a sticker for "dog" might say pet, animal, friendly, barks.

Tokens with similar stickers means they are more related.

These meaning clues or embeddings are represented as lists of numbers so the computer can understand them and manipulate them.