Ternary Bonsai 2 (2B, 4B, and 9B) just released on Hugging Face. The 2B can run entirely locally in the browser at up to 500 tok/s on an M4 Max with custom WebGPU kernels.

🌐 链接: https://www.reddit.com/r/LocalLLaMA/comments/1x6w658/ternary_bonsai_2_2b_4b_and_9b_just_released_on/
🏷️ 分组: Reddit｜AI·自托管·VPS
🕒 时间: 2026-10-16 04:09:00
Reddit
From the LocalLLaMA community on Reddit: Ternary Bonsai 2 (2B, 4B, and 9B) just released on Hugging Face. The 2B can run entirely…
From the LocalLLaMA community on Reddit: Ternary Bonsai 2 (2B, 4B, and 9B) just released on Hugging Face. The 2B can run entirely…
Explore this post and more from the LocalLLaMA community