QFN Q_2 strata configs for 8gb vram and 32gb ram. 36 tps | 340 prefill 176128 context.

🌐 链接: https://www.reddit.com/r/LocalLLaMA/comments/1x5p822/qfn_q_2_strata_configs_for_8gb_vram_and_32gb_ram/
🏷️ 分组: Reddit｜AI·自托管·VPS
🕒 时间: 2026-10-14 19:54:40
Reddit
From the LocalLLaMA community on Reddit
From the LocalLLaMA community on Reddit
Explore this post and more from the LocalLLaMA community