I have an ESC4000 G3 with 8x T4s in it - what is the fastest way I can deploy Qwen3.5-9B for about 10-15 users concurrently: currently using llama.cpp

1. 

   消息推送

   I have an ESC4000 G3 with 8x T4s in it - what is the fastest way I can deploy Qwen3.5-9B for about 10-15 users concurrently: currently using llama.cpp

   14:55 · 2026年10月10日 · 周六

   I have an ESC4000 G3 with 8x T4s in it - what is the fastest way I can deploy Qwen3.5-9B for about 10-15 users concurrently: currently using llama.cpp
   
   🌐 链接: https://www.reddit.com/r/LocalLLaMA/comments/1x252xy/i_have_an_esc4000_g3_with_8x_t4s_in_it_what_is/
   🏷️ 分组: Reddit｜AI·自托管·VPS
   🕒 时间: 2026-10-10 11:35:42

   Reddit

   

   From the LocalLLaMA community on Reddit

   Explore this post and more from the LocalLLaMA community

   14:55 · 2026年10月10日 · 周六