oMLX: A Local LLM Server for Apple Silicon, Reachable From Anywhere with Pinggy
OMLX
Local LLM
Self-Hosted AI
oMLX turns a Mac into an OpenAI-compatible inference server with continuous batching and SSD-backed KV caching. Here's how it works, its new multi-Mac clustering, and how to reach it from your phone or a coding agent with Pinggy.