How to Run LLMs Locally on iPhone: Private LLM

We hear about exciting new AI models all the time. Those of you who are using cloud-based LLMs know they have many limitations. Besides, you can’t expect to preserve your privacy while using those. Private LLM is an offline AI assistant app for iPhone. It lets you choose from various open source LLMs, such as Llama 3.2, Gemma, Phi-3,  Dolphin 3.0 and Mistral 7.

These models are optimized for your iOS device. The app support Siri commands and Shortcuts. Since AI runs on your iPhone, you won’t have to worry about  your privacy getting compromised. Just like every other model, you will be able to customize the personality of your favorite AI. This app was coded in C++, Metal and Swift. You can find out more about it here.