When would you use local models?

Reasons for using local models:

• you're working with sensitive or private information; e.g. medical notes, personal diaries, confidential business documents.
• you need it to work without internet, like on a plane or in a remote area.
• you don't want your conversations stored by a company

A good example where you might use a local LLM is a doctor using AI to help write up patient notes. Patient records are private by law, and sending them to a cloud server could be a serious data breach.