[Boole-32B-A2.5B-preview] 9GB 1.8-bit MoE, 565 token/s on 1 RTX 5090

🌐 链接: https://www.reddit.com/r/LocalLLaMA/comments/1xv3h93/boole32ba25bpreview_9gb_18bit_moe_565_tokens_on_1/
🏷️ 分组: Reddit｜AI·自托管·VPS
🕒 时间: 2026-11-13 17:29:51
Reddit
From the LocalLLaMA community on Reddit
From the LocalLLaMA community on Reddit
Explore this post and more from the LocalLLaMA community