sFNX can run qwen 27B now, if you have the right hardware with P2P support. I get 114-300 tok/s depending on prompt, or 224 combined for 6 requests in parallel on my 3xV100 system running Q8.

1. 

   消息推送

   sFNX can run qwen 27B now, if you have the right hardware with P2P support. I get 114-300 tok/s depending on prompt, or 224 combined for 6 requests in parallel on my 3xV100 system running Q8.

   3小时前

   sFNX can run qwen 27B now, if you have the right hardware with P2P support. I get 114-300 tok/s depending on prompt, or 224 combined for 6 requests in parallel on my 3xV100 system running Q8.
   
   🌐 链接: https://www.reddit.com/r/LocalLLaMA/comments/1xjp0mi/sfnx_can_run_qwen_27b_now_if_you_have_the_right/
   🏷️ 分组: Reddit｜AI·自托管·VPS
   🕒 时间: 2026-10-31 03:33:21

   Reddit

   

   From the LocalLLaMA community on Reddit

   Explore this post and more from the LocalLLaMA community

   3小时前