Self-Hosting LLMs on the 512GB M5 Ultra Mac Studio: What Actually Fits
Apple's M5 Ultra Mac Studio tops out at 512GB of unified memory at 1.2TB/s. Here is the memory math, which large open-weight LLMs actually fit, measured tokens per second, and three ways to run a model bigger than 4-bit allows: Unsloth GGUF quants, streaming weights off SSD, or a Thunderbolt 5 cluster.









