Wednesday, July 15, 2026

Bonsai

★2,138

1-bit models small enough for phones, with vision and tools in the demo.

Bonsai

Why it matters

Local models usually lose quality when they get small enough for real devices. Bonsai pushes 1-bit and ternary weights far enough that an 8B fits around a gigabyte and the newer 27B line adds vision, tool calling, and long context. The useful change is edge deployment that still looks like a modern assistant stack, not a toy chat demo.

local-llm1-bitedge
Source ↗

Via github

X