Self hosted ai

oMLX turns a Mac into an OpenAI-compatible inference server with continuous batching and SSD-backed KV caching. Here's how it works, its new multi-Mac clustering, and how to reach it from your phone or a coding agent with Pinggy.

Fine-tune LLMs locally with Unsloth: QLoRA on a single GPU, Unsloth Studio, Dynamic GGUF quants, and sharing your model over a Pinggy tunnel.

OmniRoute is a free MIT-licensed AI gateway you run yourself: one OpenAI-compatible endpoint in front of 290+ providers and 500+ models. We ran v3.8.48 in Docker, got 99 models resolving with zero configuration, tested combos, compression, MCP, and the CLI, then shared the whole thing over a public HTTPS URL with Pinggy.

Compare the best OpenClaw alternatives in 2026 - Nanobot, NanoClaw, ZeroClaw, Hermes Agent, and TrustClaw. See how each stacks up on performance, sandboxing, security, features, licensing, and self-hosting.

A guide to the best open-weight text-to-speech models you can self-host in 2026, ranked by Artificial Analysis Speech Arena Elo. Compare Breeze TTS 2, Fish Audio S2 Pro, Step Audio EditX, Voxtral TTS, Qwen3-TTS, VoxCPM2, GLM-TTS, Higgs Audio V3, Kokoro 82M and Chatterbox on quality, licensing, hardware and deployment.

A single-file C engine called Colibrì streams GLM-5.2's 744B mixture-of-experts weights off an NVMe drive to run the full model on 25 GB of RAM at 0.05-2 tokens/second. Here's how it works, what Hacker News made of it, and how to check on a queued run from your phone with Pinggy.

OpenMontage is the world's first open-source agentic video production system. Learn how it works, how to set it up for free, and how to share Remotion previews online with Pinggy.

whichllm auto-detects your GPU, CPU, and RAM, then ranks local models by real benchmarks rather than parameter count. Here's how to use it, run your pick with Ollama, and share it remotely via Pinggy.

A practical hardware guide for self-hosting LLMs in 2026. Compare consumer GPUs, Apple Silicon, enterprise cards, and pre-built AI workstations. Find the right setup for 7B to 405B models at every budget.

Discover the best open source LLMs for coding and development that you can self-host. Compare Kimi K3, Qwen3.8-Max, GLM-5.3, GLM-5.3-Flash, DeepSeek-V4-Pro, MiniMax M3, Qwen3.8-27B, Muse Glimmer 30B, Nemotron 3.5 Lightning and more with benchmarks, hardware requirements, and deployment guides.