Self hosted ai

Blog posts tagged “Self-Hosted AI”


Self hosting a 744B param LLM with only 25 GB RAM

GLM-5.2 Local LLM Mixture of Experts

A single-file C engine called Colibrì streams GLM-5.2's 744B mixture-of-experts weights off an NVMe drive to run the full model on 25 GB of RAM at 0.05-2 tokens/second. Here's how it works, what Hacker News made of it, and how to check on a queued run from your phone with Pinggy.

Picking the Right Hardware to Run LLMs Locally in 2026

Local LLM Self-Hosted AI Apple Silicon

A practical hardware guide for self-hosting LLMs in 2026. Compare consumer GPUs, Apple Silicon, enterprise cards, and pre-built AI workstations. Find the right setup for 7B to 405B models at every budget.

Best Open Source LLMs for Coding to Self-Host in 2026

Open Source LLM Self-Hosted AI Local LLM

The best open-weight coding LLMs you can self-host as of October 2026, from MiMo-V2.6-Pro and GLM-5.3 down to Qwen3.8-27B on one GPU, with current benchmark scores, licenses and the hardware each one needs.

Best Open-Source Alternatives to ChatGPT in 2026

Open Source AI Self-Hosted AI Local LLM

Discover the best open-source alternatives to ChatGPT in 2026. Compare Open WebUI, Jan, GPT4All, LibreChat, LobeChat, AnythingLLM, and more self-hosted AI chat platforms you can run locally with full privacy.

How to Self-Host Any LLM – Step by Step Guide

Self-Hosted AI Ollama Open WebUI

Complete guide to self-hosting large language models locally using Ollama and Open WebUI with Docker. Learn to run AI models privately with full control over your data.

Best Local LLM Tools and Models in 2026: What Fits in 128GB

Local LLM Self-Hosted AI Ollama

The best local LLM tools in 2026 (LM Studio, Unsloth, Ollama, LocalAI and more) and the open-weight models that fit in 128GB of memory, with measured 4-bit sizes for Qwen3.8, Gemma 4 and gpt-oss.

How to Run DeepSeek Locally

DeepSeek Ollama Self-Hosted AI

Learn how to run powerful DeepSeek AI models locally on your computer using Ollama for privacy-focused, cost-effective AI development with data control.