110+ TPS through 100K tokens with 27b on a single 3090, with 400k ctx

🌐 链接: https://www.reddit.com/r/LocalLLaMA/comments/1xhpqhz/110_tps_through_100k_tokens_with_27b_on_a_single/
🏷️ 分组: Reddit｜AI·自托管·VPS
🕒 时间: 2026-10-28 22:33:35
Reddit
From the LocalLLaMA community on Reddit
From the LocalLLaMA community on Reddit
Explore this post and more from the LocalLLaMA community