LLMs and Understanding

As you have learned, LLMs don't really understand language the way humans do.

They build a mathematical picture of how words relate to each other and generate text by choosing the most likely next token.

Despite this, the results of LLMs are very convincing and often correct.

This is because LLMs are trained on a huge amount of data and fine-tuned through RLHF.