Skip to main content
tech futures.Introduction to AI

Lesson 5: Under the Hood

The main steps in training

The main steps used for training LLMs that are covered in this lesson are shown in the diagram below.

The main steps in training LLMs

The main steps of training LLMs

  • Gathering training data
  • Tokenisation
  • Transformer (including Embeddings)
  • Reinforcement Learning from Human Feedback (RLHF)
PreviousNext