LocalTavern is the first and only AI Chat tool that runs entirely on-device. The full power of llama.cpp combined with character card support for a complete, private chat experience. Available now on the App Store for all Apple platforms - macOS, iOS, and visionOS.
Thanks to exhaustive optimization, LocalTavern is capable of loading models with up to ~1B parameters for every 1.5GB of RAM the device has available on mobile platforms.