Running unsloth/Qwen3.8-27B-UD-IQ4_XS 262k q4_0 KV + vision on 16GB VRAM @ 80t/s and 1500pp

🌐 链接: https://www.reddit.com/r/LocalLLaMA/comments/1x4cmfc/running_unslothqwen3827budiq4_xs_262k_q4_0_kv/
🏷️ 分组: Reddit｜AI·自托管·VPS
🕒 时间: 2026-10-13 04:14:03
Reddit
From the LocalLLaMA community on Reddit: Running unsloth/Qwen3.8-27B-UD-IQ4_XS 262k q4_0 KV + vision on 16GB VRAM @ 80t/s and 1500pp
From the LocalLLaMA community on Reddit: Running unsloth/Qwen3.8-27B-UD-IQ4_XS 262k q4_0 KV + vision on 16GB VRAM @ 80t/s and 1500pp
Explore this post and more from the LocalLLaMA community