Local LLM Server - Edge AI icon

Local LLM Server - Edge AI

Transform your iPhone, iPad, or Mac into a Private, Local LLM AI Server

This powerful utility allows you to run Large Language Models (LLMs) powered by Apple Intelligence directly on your device, providing an OpenAI-compatible API for your development and testing needs.

Note: This app requires iOS 26.0/macOS 26.0 or above to run Apple Intelligence models.

Download on the App Store

Screenshots

Local LLM Server - Edge AI screenshot 1
Local LLM Server - Edge AI screenshot 2
Local LLM Server - Edge AI screenshot 3
Local LLM Server - Edge AI screenshot 4

Key Features

  • Local Server Hosting: Run a fully functional LLM server right from your pocket. No internet connection is required
  • OpenAI-Compatible API: Seamlessly integrate with existing tools and clients that support standard chat completion endpoints
  • Real-Time Monitoring: Keep track of your server's information with a live status dashboard showing IP address, active port, and logs
  • Live Logs: View real-time server logs to debug requests and monitor performance instantly
  • Developer Friendly: Includes built-in curl command example to quickly test your server

Perfect For

  • AI researchers
  • Developers building private apps
  • Enthusiasts exploring local intelligence

This app provides the local LLM AI infrastructure you need using the devices you already have.

Available now for iOS and macOS.