Smaller models

Not every LLM task needs the most powerful model and smaller models use a fraction of the energy of large ones.

Running a big cloud model can be hundreds of times more energy intensive than a smaller one doing the same job.

Companies are now building families of models at different sizes and trying to match the task to the right-sized model automatically; only reaching for the big one when it's actually needed.