Qwen3.8-27B UD-IQ4_XS Heretic + MTP on a 16 GB card with 55-68 tok/s (24gb and 12gb versions available too)

🌐 链接: https://www.reddit.com/r/LocalLLaMA/comments/1x1zhnx/qwen3827b_udiq4_xs_heretic_mtp_on_a_16_gb_card/
🏷️ 分组: Reddit｜AI·自托管·VPS
🕒 时间: 2026-10-10 06:54:37
Reddit
From the LocalLLaMA community on Reddit
From the LocalLLaMA community on Reddit
Explore this post and more from the LocalLLaMA community