Local llm

Bonsai 27B compresses a 27B-parameter Qwen3.6 model to 3.9GB using native 1-bit weights and runs on an iPhone at 11 tok/s. Here's what it gives up.

A single-file C engine called Colibrì streams GLM-5.2's 744B mixture-of-experts weights off an NVMe drive to run the full model on 25 GB of RAM at 0.05-2 tokens/second. Here's how it works, what Hacker News made of it, and how to check on a queued run from your phone with Pinggy.

whichllm auto-detects your GPU, CPU, and RAM, then ranks local models by real benchmarks rather than parameter count. Here's how to use it, run your pick with Ollama, and share it remotely via Pinggy.

A practical hardware guide for self-hosting LLMs in 2026. Compare consumer GPUs, Apple Silicon, enterprise cards, and pre-built AI workstations. Find the right setup for 7B to 405B models at every budget.

Discover the best open-source alternatives to ChatGPT in 2026. Compare Open WebUI, Jan, GPT4All, LibreChat, LobeChat, AnythingLLM, and more self-hosted AI chat platforms you can run locally with full privacy.

Learn how to self-host n8n's AI Starter Kit and access your AI workflows remotely with Pinggy. Step-by-step guide to privacy-focused AI solutions with local LLMs.