Running a 0.5B LLM on Seven ESP32-S3 Boards
How an open-source cluster of seven ESP32-S3 microcontrollers splits a Qwen2-0.5B model into 1.58-bit ternary layers, why it fits in 16 MB of flash per board, and why it is slow.
Bit net
Blog posts tagged “BitNet”