How to Join Local LLM: On-Device Beta on iOS
About Local LLM: On-Device
MITHRIL is a private AI assistant that runs on your iPhone and iPad. Your conversations are processed on the device and saved on the device. No account, no cloud, no tracking.
TWO KINDS OF MODELS
- Apple's on-device model, built into iOS 26 on devices with Apple Intelligence. Nothing to download.
- Open models from Hugging Face in GGUF format, from companies like Alibaba, Google, Meta, Microsoft, Mistral, DeepSeek and Liquid AI. Browse by company, see whether a model fits your device's memory before you download it, and switch any time.
AN ASSISTANT THAT CAN DO THINGS
It knows today's date, the time and your city from your device, and asks before it acts. Texts and emails open as drafts for you to review and send. Choose which abilities it can use:
- Reminders and calendar events
- Texts, email and phone calls
- Look up your contacts
- Directions and places nearby
- Run your Shortcuts
- Web search: Wikipedia, DuckDuckGo, or Brave with your own key
- Search your own documents
- Today's date and exact math
PRIVACY YOU CAN SEE
The Privacy map shows what runs on your device, what goes online, and exactly what is sent. A web search sends only the search words, never your conversation, and your location is only turned into a city name. A live list shows every network request MITHRIL makes.
VOICE
Dictate with Apple's speech recognition, or download NVIDIA Parakeet for more accurate on-device transcription. Hear answers in natural voices generated on the device. The floating assistant stays with you in Picture in Picture while you use other apps.
FOR THE CURIOUS
Tap the speed line under an answer for a live engine dashboard: tokens per second, time to first token, context use, cache hits and memory.
REQUIREMENTS
iOS 26. Apple's on-device model needs a device with Apple Intelligence. Open models run on any supported iPhone or iPad. Larger models need more memory, and MITHRIL shows what fits before you download.
Models are made by their publishers and downloaded from Hugging Face. MITHRIL doesn't train or host models.