RustingStrata runs Flint 40B on a 12 GB card: 64 tok/s decode, 1.3x llama.cpp

🌐 链接: https://www.reddit.com/r/LocalLLaMA/comments/1xw5nzn/rustingstrata_runs_flint_40b_on_a_12_gb_card_64/
🏷️ 分组: Reddit｜AI·自托管·VPS
🕒 时间: 2026-11-14 23:51:48
Reddit
From the LocalLLaMA community on Reddit: RustingStrata runs Flint 40B on a 12 GB card: 64 tok/s decode, 1.3x llama.cpp
From the LocalLLaMA community on Reddit: RustingStrata runs Flint 40B on a 12 GB card: 64 tok/s decode, 1.3x llama.cpp
Explore this post and more from the LocalLLaMA community