Qwen3.8-Flash-Next on six 3090s with vLLM: 7 users at 262k, 6.5k t/s prefill, 57 t/s decode solo / 206 t/s aggregate with all 7 generating. Fixes for the upstream included.

🌐 链接: https://www.reddit.com/r/LocalLLaMA/comments/1x3wjzf/qwen38flashnext_on_six_3090s_with_vllm_7_users_at/
🏷️ 分组: Reddit｜AI·自托管·VPS
🕒 时间: 2026-10-12 16:37:36
Reddit
From the LocalLLaMA community on Reddit: Qwen3.8-Flash-Next on six 3090s with vLLM: 7 users at 262k, 6.5k t/s prefill, 57 t/s decode…
From the LocalLLaMA community on Reddit: Qwen3.8-Flash-Next on six 3090s with vLLM: 7 users at 262k, 6.5k t/s prefill, 57 t/s decode…
Explore this post and more from the LocalLLaMA community