Running Next Flash IQ3_XXS at ~70 tok/s with 100k context or 2 instances of Qwen 3.6 35B A3B IQ4 at ~145 tok/s with 256k all on $500 of ex mining BC-250 boards

🌐 链接: https://www.reddit.com/r/LocalLLaMA/comments/1x2yv1b/running_next_flash_iq3_xxs_at_70_toks_with_100k/
🏷️ 分组: Reddit｜AI·自托管·VPS
🕒 时间: 2026-10-11 12:27:44
Reddit
From the LocalLLaMA community on Reddit: Running Next Flash IQ3_XXS at ~70 tok/s with 100k context or 2 instances of Qwen 3.6 35B…
From the LocalLLaMA community on Reddit: Running Next Flash IQ3_XXS at ~70 tok/s with 100k context or 2 instances of Qwen 3.6 35B…
Explore this post and more from the LocalLLaMA community